How can you use mixed-methods to evaluate training programs?

1 What are mixed-methods?

Mixed-methods are research approaches that integrate both quantitative and qualitative data in a single study or a series of studies. Quantitative data are numerical and can be measured, analyzed, and compared using statistical methods. Qualitative data are descriptive and can be collected, interpreted, and presented using textual, visual, or audio methods. By combining both types of data, mixed-methods can address different research questions, enhance the validity and reliability of findings, and generate richer and deeper insights into training phenomena.

2 Why use mixed-methods for training evaluation?

Training evaluation is the systematic process of collecting and using data to assess the value and effectiveness of training programs. It can help you answer questions such as: Did the learners achieve the learning objectives? How did the training affect their performance, behavior, and attitudes? What were the benefits and challenges of the training for the learners, the trainers, and the organization? How can the training be improved in the future? Mixed-methods can help you answer these questions by providing multiple sources of evidence, capturing the complexity and diversity of training contexts and outcomes, and revealing the underlying mechanisms and processes of training effects.

3 How to design mixed-methods for training evaluation?

There are different ways to design mixed-methods for training evaluation, depending on your research purpose, questions, and resources. One common framework is the Kirkpatrick model, which proposes four levels of evaluation: reaction, learning, behavior, and results. You can use mixed-methods to collect and analyze data at each level, or to compare and integrate data across levels. For example, you can use quantitative methods such as surveys, tests, and observations to measure the learners' satisfaction, knowledge, skills, and performance before and after the training, and use qualitative methods such as interviews, focus groups, and documents to explore their opinions, experiences, and challenges related to the training. You can then use both types of data to assess the impact and value of the training for the learners and the organization.

4 How to implement mixed-methods for training evaluation?

To implement mixed-methods for training evaluation, you need to follow some basic steps. First, you need to plan your evaluation strategy, including your research questions, data sources, sampling methods, instruments, and timeline. Second, you need to collect your data, ensuring that you follow ethical principles, obtain informed consent, and maintain data quality and security. Third, you need to analyze your data, using appropriate techniques and software for each type of data, and identifying patterns, themes, and relationships among them. Fourth, you need to report your findings, using clear and concise language, tables, graphs, and quotes to illustrate your results, and discussing their implications and limitations.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?