What are the best tools and methods for measuring learning impact on change?

1 Define your learning and change objectives

Before you can measure the impact of learning on change, you need to have a clear and specific definition of what you want to achieve with your learning and change interventions. What are the desired behaviors, skills, knowledge, attitudes, and results that you want to see in your learners and your organization as a result of your change initiative? How do they align with your change vision and strategy? How will you measure them and when? These are some of the questions that you need to answer to define your learning and change objectives, and to create a logic model or a theory of change that links your learning inputs, activities, outputs, outcomes, and impacts.

2 Choose your evaluation framework

Once you have established your learning and change objectives, you must select an evaluation framework that meets your requirements and context. An evaluation framework is a combination of criteria, indicators, methods, and tools used to collect and analyze data on your learning and change interventions. There are numerous evaluation frameworks available, but some of the most popular and widely used are Kirkpatrick's four levels of evaluation, Brinkerhoff's success case method, Phillips' ROI methodology, and the CIPP model. Kirkpatrick's framework evaluates the reaction, learning, behavior, and results of your learning interventions, and how they contribute to your change goals. Brinkerhoff's success case method identifies the most and least successful cases of learning transfer and impact, and examines the factors that influence them. Phillips' ROI methodology calculates the return on investment of your learning interventions, by comparing the monetary benefits and costs of your change initiative. Lastly, the CIPP model evaluates the context, input, process, and product of your learning and change interventions, and provides feedback and recommendations for improvement.

3 Collect and analyze your data

After choosing your evaluation framework, you need to collect and analyze your data on your learning and change interventions. Depending on your framework, you may use different methods and tools, such as surveys, interviews, focus groups, observations, tests, assessments, performance indicators, financial data, etc. You may also use different sources of data, such as learners, managers, stakeholders, customers, etc. The key is to use a mix of quantitative and qualitative data, and to triangulate your data from different methods and sources, to ensure validity and reliability. You also need to analyze your data in a systematic and rigorous way, using appropriate statistical and thematic techniques, and to interpret your findings in relation to your learning and change objectives.