What are the top strategies for evaluating public administration program effectiveness?

1 Define the program logic model

A program logic model is a visual representation of how a program works, what it aims to achieve, and how it measures its success. It shows the logical connections between the program inputs, activities, outputs, outcomes, and impacts. A program logic model helps evaluators to identify the key evaluation questions, indicators, data sources, and methods for each stage of the program cycle. It also helps stakeholders to understand the program theory, assumptions, and risks, and to communicate the program value and contribution to the public interest.

2 Choose the appropriate evaluation design

An evaluation design is a plan that specifies how the evaluation will be conducted, what data will be collected and analyzed, and how the findings will be reported and used. An evaluation design should be aligned with the program logic model, the evaluation purpose and scope, and the stakeholder needs and expectations. There are different types of evaluation designs, such as experimental, quasi-experimental, non-experimental, mixed-methods, and participatory. Each design has its strengths and limitations, depending on the evaluation context, criteria, and questions. Evaluators should choose the most suitable and feasible evaluation design for their program, based on the evidence standards, ethical principles, and practical constraints.

3 Apply the relevant evaluation methods

Evaluation methods are the techniques and tools that evaluators use to collect and analyze data, and to generate and validate findings. Evaluation methods can be classified into quantitative and qualitative methods, depending on the nature and source of data. Quantitative methods use numerical data to measure and compare the program performance, efficiency, effectiveness, and impact. Qualitative methods use textual or visual data to explore and understand the program processes, experiences, perceptions, and meanings. Evaluators should apply the relevant evaluation methods for their program, based on the evaluation design, indicators, and data availability and quality. They should also use triangulation, validation, and verification techniques to enhance the credibility, validity, and reliability of their data and findings.

4 Engage the key stakeholders

Stakeholders are the individuals or groups that have an interest or stake in the program or its evaluation. They can include program beneficiaries, staff, managers, funders, partners, policymakers, and other relevant parties. Engaging stakeholders is an important strategy for evaluating public administration program effectiveness, as it helps to ensure the relevance, usefulness, and legitimacy of the evaluation. Stakeholders can be involved in different stages and aspects of the evaluation process, such as defining the evaluation purpose and questions, selecting the evaluation design and methods, collecting and analyzing data, interpreting and disseminating findings, and applying and learning from the evaluation results. Evaluators should use appropriate and inclusive methods and mechanisms to engage stakeholders, such as consultations, workshops, surveys, interviews, focus groups, and feedback sessions.

5 Report and communicate the evaluation findings

Reporting and communicating the evaluation findings is the final and essential step of evaluating public administration program effectiveness. It involves presenting and sharing the evaluation results, conclusions, and recommendations with the intended audiences and users, in a clear, concise, and accessible manner. Reporting and communicating the evaluation findings can serve multiple purposes, such as informing decision-making, improving program quality, demonstrating accountability, enhancing learning, and influencing policy. Evaluators should use different formats and channels to report and communicate the evaluation findings, such as reports, briefs, summaries, dashboards, infographics, presentations, webinars, podcasts, and social media.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?