What are the benefits and challenges of using mixed methods in policy evaluation?

1 What are mixed methods?

Mixed methods are research approaches that combine quantitative and qualitative data and analysis in a single study or a series of studies. Quantitative methods use numerical data and statistical techniques to measure, compare, and test variables and hypotheses. Qualitative methods use textual, visual, or audio data and interpretive techniques to explore, describe, and understand phenomena and meanings.

2 Why use mixed methods in policy evaluation?

Using mixed methods in policy evaluation can provide a more comprehensive and nuanced understanding of the policy problem, context, and impact. This is achieved by integrating multiple sources and types of evidence. Different evaluation questions and purposes can be addressed by leveraging the strengths of quantitative and qualitative methods. The credibility and validity of the evaluation findings can be enhanced by triangulating, corroborating, or expanding the results from different methods. Additionally, the relevance and usefulness of the evaluation for different audiences and stakeholders can be increased by presenting the findings in various forms and formats.

3 How to use mixed methods in policy evaluation?

Careful planning, design, and execution are essential when using mixed methods in policy evaluation. It's important to clarify the objectives, questions, and criteria, and make sure they are aligned with the policy goals, logic, and theory of change. The appropriate mixed methods design should be chosen based on the level of integration, priority, and timing of the quantitative and qualitative components. Additionally, suitable data collection and analysis methods should be selected for each component to ensure compatibility, feasibility, and rigor. Quantitative and qualitative data and analysis should be integrated at one or more stages of the evaluation process. Lastly, the evaluation findings should be communicated and disseminated in a clear, coherent, and accessible way with an emphasis on the mixed methods contribution and implications.

5 How to collaborate interdisciplinarily in policy evaluation?

Interdisciplinary collaboration is the process of working together with people from different disciplines or fields of knowledge to address a common problem or goal. In policy evaluation, interdisciplinary collaboration can enrich the evaluation design, methods, and findings by bringing diverse expertise, perspectives, and insights from different disciplines. It can also enhance the relevance and impact of the evaluation by engaging with different stakeholders and beneficiaries, as well as foster learning and innovation through cross-fertilization and exchange of ideas. However, interdisciplinary collaboration requires overcoming some barriers such as developing a shared language and understanding among collaborators, building trust and respect among them, and balancing the integration and differentiation of disciplines involved in the evaluation.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?