You want to evaluate digital learning, but where do you start?

1 Define your purpose

Before you dive into any evaluation method or tool, you need to clarify why you want to evaluate digital learning in the first place. What are your goals and objectives? What are your success criteria and indicators? What are the questions that you want to answer or the problems that you want to solve? Having a clear purpose will help you focus your evaluation efforts and align them with your digital learning strategy and outcomes.

2 Choose your approach

When it comes to evaluating digital learning, the approach you take depends on your purpose, context, and resources. Formative evaluation is a continuous process which involves collecting feedback and data during the design and development stages. This helps to identify strengths and weaknesses, make adjustments, and improve quality before launching or delivering the digital learning solution. Summative evaluation is a final process that measures the results and impact of digital learning after it has been completed or implemented. It allows you to determine the effectiveness, relevance, and value of your digital learning solution in relation to your goals and objectives. The Kirkpatrick model is a widely used framework that evaluates digital learning on four levels: reaction, learning, behavior, and results. The CIPP model is a comprehensive framework which evaluates digital learning on four dimensions: context, input, process, and product. It helps to analyze the needs, resources, activities, and outcomes of digital learning systematically.

3 Select your methods

There are various methods to collect and analyze data for digital learning evaluation, depending on your approach, questions, and indicators. Surveys are questionnaires that ask learners or stakeholders to rate or comment on digital learning. Interviews are conversations that allow you to explore in-depth the opinions of learners or stakeholders about digital learning. Observations are recordings or notes that capture the behaviors of learners or stakeholders during digital learning. Tests are assessments that measure the knowledge, skills, or attitudes of learners before, during, or after digital learning. Analytics are data that track and measure the performance, progress, or patterns of learners or stakeholders using digital learning platforms, tools, or resources. All of these methods can be administered online or offline, before, during, or after digital learning and can be formal or informal, objective or subjective.

5 Report your findings

The last step in evaluating digital learning is to report your findings and recommendations. This involves summarizing and interpreting the data that you have collected and analyzed, and presenting them in a clear, concise, and meaningful way. You can use various formats and media to communicate your evaluation results, such as reports, dashboards, infographics, or videos. You should also include the limitations, implications, and suggestions for improvement or action based on your evaluation findings. A good report will help you share your evaluation insights and outcomes with your learners, stakeholders, or audience.

Evaluating digital learning is not a one-size-fits-all process. It requires careful planning, execution, and communication. By following these steps, you can start your evaluation journey and discover how to enhance your digital learning initiatives and impact.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?