Kirkpatrick's four levels of evaluation
Training programs are often evaluated with a four-level model. Reaction measures participants' satisfaction. Learning measures the knowledge or skills gained. Behavior measures whether participants apply what they learned on the job. Results measure outcomes for clients or the organization, such as fewer errors. The educator wants to know whether nurses now apply what they learned in daily work, which is the behavior level. Audited independent double-checks rising from 60% to 94% of high-alert doses directly measure behavior in practice, showing transfer of learning to daily work.
| Level | Question answered | Example from the options |
|---|
| Reaction | Did they like it? | Rating of 4.8 out of 5 |
| Learning | Did they learn it? | Post-test rose from 62% to 88% |
| Behavior | Do they use it at work? | Double-checks rose from 60% to 94% |
| Results | Did outcomes improve? | Reported errors fell (confounded) |
Why the audit is the best evidence
An audit observes or reviews actual practice. Comparing the rate of independent double-checks before the workshop (60%) and after (94%) shows a change in what nurses do on the ward. Independent double-checks of high-alert medications such as insulin, heparin, and concentrated electrolytes are a key error-prevention behavior, so the measure is directly linked to the workshop content.
Why the other findings fall short
Post-test scores show that nurses learned the content, but knowing is not proof of doing. Satisfaction ratings measure reaction, the lowest level; liking a workshop does not show a change in practice. The fall in reported errors would be a results-level outcome, but a new barcode scanner was installed in the same month, so the improvement cannot be credited to the workshop. This is a confounding factor.
Watch out! The results level is the highest, so the error data may look like the strongest answer. But the stem asks whether nurses apply what they learned, and the error data are confounded. Answer the question that is asked.
Exam takeaway
Key point! To show transfer of training to practice, measure behavior on the job, for example by auditing practice before and after training.