SuccessCOACHING · Emma Enablement · EEMS™

Tool 3: L1 Reaction Measurement Design

Enablement Effectiveness Measurement System · Phase 3 — Instrument Design
EEMS™ v1.0
Tool 3 of 7  ·  Phase 3 — Instrument Design
Purpose: Design utility-oriented L1 instruments that provide directional signal about transfer intent. Satisfaction questions (r=.02 with learning) must be replaced or supplemented with utility questions (r=.26 with application).
Critical distinction: "Did you enjoy the training?" has essentially zero predictive value for whether it worked. "Will you apply this in the next two weeks?" is what you actually need to ask. Design your L1 instrument around utility reactions.
Survey Design
Utility reactions (use as primary measures): Relevance to current challenges, likelihood of application, application intent.  |  Affective reactions (use only for facilitation diagnostics, not effectiveness claims): Enjoyment, satisfaction, would-recommend.
#Question TextResponse ScaleQuestion TypeAction Threshold
1
2
3
4
5
Administration Protocol
L1 Data Log Populated during Phase 4 execution
Session / ModuleDateResponsesResponse RateAvg Utility ScoreAvg Relevance ScoreNotable Open-Text Patterns