What are the best practices for conducting level 3 evaluations of learning transfer and behavior change?

1 Define the objectives and criteria

Before conducting a level 3 evaluation, you need to define the objectives and criteria for measuring learning transfer and behavior change. These should be aligned with the learning outcomes and the business goals of the intervention. You also need to identify the indicators and metrics that will demonstrate the extent and quality of the transfer and change. For example, you can use performance indicators, such as sales, productivity, quality, or customer satisfaction, or behavioral indicators, such as feedback, observation, or self-report.

2 Choose the methods and tools

The next step is to choose the methods and tools that will help you collect and analyze the data for the level 3 evaluation. You can use a combination of quantitative and qualitative methods, such as surveys, interviews, focus groups, tests, assessments, or observations. You can also use different tools, such as questionnaires, checklists, rubrics, or rating scales. The methods and tools you choose should be valid, reliable, and relevant to the objectives and criteria. You should also consider the feasibility, cost, and time of the data collection and analysis.

3 Involve the stakeholders

One of the key factors for conducting a successful level 3 evaluation is to involve the stakeholders, such as the learners, managers, peers, customers, or sponsors. They can provide valuable input, feedback, and support for the evaluation process and the results. You should communicate with them regularly, and inform them about the purpose, expectations, and benefits of the evaluation. You should also solicit their opinions, suggestions, and concerns, and address them accordingly. You should also acknowledge their contributions, and share the findings and recommendations with them.

4 Plan the timing and frequency

Another important factor for conducting a level 3 evaluation is to plan the timing and frequency of the data collection and analysis. You should consider when and how often you will measure the learning transfer and behavior change, and how long you will follow up with the learners and stakeholders. You should also consider the factors that may influence or interfere with the transfer and change, such as organizational culture, climate, or support. You should aim to capture both the short-term and long-term effects of the intervention, and compare them with the baseline data.

5 Analyze and report the results

The final step is to analyze and report the results of the level 3 evaluation. You should use appropriate statistical or qualitative methods to analyze the data, and identify the patterns, trends, gaps, or outliers. You should also interpret the results in relation to the objectives and criteria, and evaluate the strengths, weaknesses, opportunities, or threats of the intervention. You should also report the results in a clear, concise, and compelling way, using charts, graphs, or stories. You should also highlight the achievements, challenges, and recommendations for improvement.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?