How do you conduct educational technology evaluations?

1 Define the purpose and scope

The first step in conducting an educational technology evaluation is to define the purpose and scope of the evaluation. What are the goals and objectives of the technology intervention? Who are the stakeholders and beneficiaries of the evaluation? What are the evaluation questions and criteria? How will the evaluation results be used and disseminated? These questions can help you clarify the rationale, focus, and scope of the evaluation, as well as the resources, timeline, and ethical considerations involved.

2 Choose the evaluation approach and design

The next step is to choose the evaluation approach and design that best suits your purpose and scope. There are different types of evaluation approaches, such as formative, summative, developmental, or participatory, that can serve different purposes, such as improvement, accountability, learning, or empowerment. There are also different evaluation designs, such as experimental, quasi-experimental, or non-experimental, that can provide different levels of evidence, such as causal, correlational, or descriptive. You should choose the evaluation approach and design that aligns with your evaluation questions and criteria, as well as the availability and quality of data.

3 Collect and analyze data

The third step is to collect and analyze data that can answer your evaluation questions and criteria. You should select the data sources, methods, and tools that are appropriate for your evaluation approach and design, as well as the characteristics and needs of your target population. You can use different types of data, such as quantitative, qualitative, or mixed, and different methods, such as surveys, interviews, observations, tests, or artifacts, to collect and analyze data. You should also ensure the validity, reliability, and credibility of your data collection and analysis procedures, as well as the ethical protection of your participants.

4 Interpret and report findings

The final step is to interpret and report your findings in a clear, concise, and meaningful way. You should synthesize your data analysis results and draw conclusions and recommendations based on your evaluation questions and criteria. You should also discuss the limitations, implications, and lessons learned from your evaluation. You should present your findings in a format and style that is suitable for your intended audience and purpose, such as a report, a presentation, a dashboard, or a blog post. You should also solicit feedback and suggestions from your stakeholders and beneficiaries to improve your evaluation process and outcomes.

5 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?