What is the best way to design an evaluation framework for research impact?

1 Evaluation framework

An evaluation framework is a plan that guides the collection, analysis, and reporting of data to assess the performance and impact of your research. It helps you to clarify your research purpose, scope, questions, criteria, and standards. It also helps you to select the most suitable data sources, methods, and tools for your evaluation. An evaluation framework should be flexible and adaptable to the changing context and needs of your research and its stakeholders.

2 Evaluation methods

Evaluation methods are the techniques and procedures that you use to collect and analyze data for your evaluation. They can be quantitative, qualitative, or mixed, depending on the type and level of evidence that you want to generate. Quantitative methods use numerical data and statistical analysis to measure and compare the outcomes and impacts of your research. Qualitative methods use textual, visual, or audio data and thematic analysis to explore and understand the processes, experiences, and meanings of your research. Mixed methods use both quantitative and qualitative data and analysis to triangulate and complement the findings and insights of your evaluation.

3 Evaluation indicators

Evaluation indicators are the specific measures that you use to track and demonstrate the progress, results, and impact of your research. They can be input, output, outcome, or impact indicators, depending on the stage and scope of your evaluation. Input indicators measure the resources and activities that you invest in your research. Output indicators measure the products and services that you produce from your research. Outcome indicators measure the short-term and medium-term changes that your research brings to your direct beneficiaries. Impact indicators measure the long-term and wide-scale changes that your research contributes to your broader stakeholders.

4 Evaluation communication

Evaluation communication is the process of sharing and disseminating your evaluation findings and recommendations to your relevant audiences and stakeholders. It helps you to demonstrate the value and impact of your research, to inform and influence decision-making and policy-making, and to improve and enhance your research practice and quality. Evaluation communication should be clear, concise, and credible, using appropriate formats, channels, and languages for your target groups. Evaluation communication should also be timely, responsive, and interactive, inviting feedback and dialogue from your stakeholders.

5 Evaluation use

Evaluation use is the application and utilization of your evaluation findings and recommendations to inform, improve, or change your research or its context. It helps you to achieve your research goals, objectives, and impact, to learn from your successes and challenges, and to adapt to the emerging opportunities and needs. Evaluation use can be instrumental, conceptual, or symbolic, depending on the purpose and nature of your evaluation. Instrumental use applies your evaluation results directly to your research decisions and actions. Conceptual use applies your evaluation results indirectly to your research knowledge and understanding. Symbolic use applies your evaluation results strategically to your research advocacy and legitimacy.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?