Purpose: Design the full measurement framework before the program launches. Baselines must be established before the program runs — this cannot be done retroactively. The L3 behavior definitions must match the CAF™ Behavioral Indicator Matrix.
Rule: Baseline data collection must begin BEFORE the program launches. A program without pre-established baselines cannot credibly demonstrate impact.
Document Header
Level 1 — Reaction Optimize for utility reactions, not affective reactions. L1 affective reactions correlate with learning at r = .02.
Metric
Instrument
Timing
Action Threshold
Utility reaction — "Will I apply this to my work?"
Perceived relevance — "This is relevant to my current challenges"
Application intent — "One thing I'll do differently this week"
Level 2 — Learning Assessment must match Bloom's level of objectives — multiple choice cannot assess Evaluate-level objectives
Objective
Assessment Type
Bloom's Level
Pre-Assessment?
Pass Threshold
Timing
Level 3 — Behavior Transfer The most important level and the most commonly skipped. Uses CAF™ Behavioral Indicator Matrix as the observation standard.
L3 behavior definitions must exactly match the Level 3 indicators in the CAF™ Behavioral Indicator Matrix. If they differ, L3 data will not be comparable to competency assessment data.