A Predictive Level 1 Evaluation
Deborah Spring Laurel - Management Trainer
Management training | Train the trainer | Curriculum design/ I strengthen nonprofit teams to achieve the greatest impact
“The real goal of classroom assessment is to improve student performance, not merely audit it.” David Sousa and Carol Ann Tomlinson
Kirkpatrick’s Level 1 evaluation has often been characterized as the “feel good” evaluation since it measures participant satisfaction with a training program. Unfortunately, it is the most used, most subjective, and least useful gauge of a program’s effectiveness.
Predictive Questions Can Save the Day
Ken Phillips suggests that incorporating predictive questions is a way to gain greater value from Level 1 evaluations. Although the predictive data collected can’t provide proof that certain outcomes will occur, he believes it will forecast likely results.
The following Level 1 evaluation incorporates Phillips’ predictive questions for Level 2 learning, Level 3 training transfer, and Level 4 business results.
New and Improved Level 1 Evaluation Questions
?Level 2 learning:
?1.?????On a scale of 1 to 7, with 1 being no knowledge and 7 being thorough knowledge, how much knowledge did you have about the materials before attending the program?
?2.?????On a scale of 1 to 7, with 1 being no knowledge and 7 being thorough knowledge, how much knowledge do you have about the material after participating in the program?
?Level 3 training transfer:
领英推荐
3.?????On a scale of 1 to 7, with 1 being not at all relevant and 7 being extremely relevant, how relevant was this program to you and the tasks and requirements of your work?
?4.?????On a scale of 1 to 7, with 1 being not at all confident and 7 being extremely confident, how confident are you in your ability to apply the new information you learned in this program back on the job?
?5.?????On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely are you to have an immediate opportunity to apply the new information you learned in this program back on the job?
?6.?????What obstacles, if any, may keep you from applying what you learned?
?7.?????On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely is your manager to actively engage you in discussing your use of the new information you learned in this program?
?Level 4 business results:
?8.?????On a scale of 1 to 7, with 1 being not at all likely and 7 being extremely likely, how likely are any of your department's tracked crucial business metrics to improve as a result of you applying the information you learned in this program?
?9.?????How confident are you in your response to the previous question, where 0 percent equals no confidence and 100 percent equals high confidence?
?Question:?Do you agree that these Level 1 questions can provide great value concerning a training program’s effectiveness?
Management training | Train the trainer | Curriculum design/ I strengthen nonprofit teams to achieve the greatest impact
3 年You can read Ken Phillips article: Predictions and Probabilities in Training Evaluation at https://www.td.org/magazines/td-magazine/predictions-and-probabilities-in-training-evaluation?cm_mmc=newsletter-_-email-_-undefined-_-BRAND-TalentBrief-Email-TopicNewsletter-TalentBrief-22586&utm_source=newsletter&utm_medium=email&utm_campaign=BRAND-TalentBrief-Email-TopicNewsletter-TalentBrief-22586&lid=cu4xbhccnpon