What are the best methods and tools for collecting and analysing training evaluation data?

1 Kirkpatrick's model

One of the most widely used and recognized frameworks for training evaluation is Kirkpatrick's four-level model, developed by Donald Kirkpatrick in the 1950s. It consists of four levels of evaluation: reaction, learning, behaviour, and results. Reaction refers to the learners' satisfaction and engagement with the training. Learning refers to the knowledge, skills, and attitudes acquired by the learners. Behaviour refers to the changes in the learners' performance and actions as a result of the training. Results refer to the outcomes and impacts of the training on the organization's goals and objectives. Each level of evaluation requires different types of data and methods to collect and analyse them.

2 Data collection methods

When evaluating training, there are various methods and tools to collect data that depend on the level of evaluation, its purpose, and available resources. Surveys and questionnaires, for example, can be written or online forms that ask learners to rate their training experience or learning outcomes. Tests and assessments measure learners' knowledge, skills, or attitudes before and after the training. Interviews and focus groups involve verbal conversations with learners or other stakeholders about their training experience. Observations and feedback involve observing learners’ performance and providing feedback or coaching to help them improve.

3 Data analysis tools

Once you have collected your training evaluation data, it is necessary to analyse them in order to draw conclusions and recommendations. Depending on the type and amount of data you have, there are various tools and software that can assist with this task. Excel is a spreadsheet program that can help organize, summarize, and visualize data with formulas, charts, graphs, or pivot tables. It is capable of handling both quantitative and qualitative data, as well as basic or advanced statistical analysis. SPSS is a statistical software that can help to perform more complex analysis of quantitative data such as regression, correlation, ANOVA, or factor analysis. It can also be used to test hypotheses, compare groups, or identify patterns and trends. NVivo is a qualitative software that is useful for coding, organizing, and interpreting qualitative data such as text, audio, video, or images. It can help to identify themes, patterns, or relationships among the data and generate reports or visualizations.

4 Evaluation reports

The final step of your training evaluation process is to communicate your findings and recommendations to stakeholders, such as learners, managers, sponsors, or clients. This can be done through evaluation reports, which are documents that summarize and present data analysis results, conclusions, and suggestions for improvement. These reports should be clear, concise, and relevant to the audience, and structured in a logical way. An executive summary should provide an overview of the main points; the introduction should provide context; the methodology should describe data collection and analysis methods; the findings should present and interpret data analysis results; the conclusions should summarize the main findings and implications; and the recommendations should provide actionable suggestions for improving the training program or future evaluations.

5 Tips and best practices

To ensure that your training evaluation process is effective and efficient, you should plan your evaluation strategy in advance. This should include what you want to evaluate, how you will collect and analyse data, who will be involved, and when and how you will report your results. Additionally, make sure your evaluation is aligned with your SMART (specific, measurable, achievable, relevant, and time-bound) training objectives. Using multiple sources and methods of data collection and analysis such as surveys, tests, interviews, observations, or feedback can help increase the credibility and validity of your evaluation. Involvement of stakeholders is also important to ensure the relevance of the evaluation process and gain their buy-in and commitment to your training program and evaluation results.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?