What are the skills and competencies needed for program evaluators in the 21st century?

In the 21st century, program evaluators need a diverse set of skills and competencies for critical thinking. These include strong analytical abilities to assess data objectively, creativity to explore innovative evaluation methods, adaptability to navigate complex contexts, effective communication to convey findings persuasively, and collaboration to work across diverse teams. Above all, they must possess a curious and open-minded mindset to challenge assumptions and drive continuous improvement in program evaluation practices.

Data always tell multiple stories, and these stories are embedded within a wide variety of contexts. Therefore, evaluators must be able to think through many lens and depths to extract useful information from their data. This underscores their need for critical thinking. It is an indispensable skills.

One revelation most recently is global development is increased complexity. Without critically thinking, it will be difficult to select appropriate methodologies to get the best out of evaluation efforts; and critical thinking thrives on knowledge. Evaluators must consistently learn and be abreast with latest trends too.

First and foremost, strong analytical skills are essential, enabling evaluators to collect, interpret, and synthesize data accurately. Proficiency in data visualization and interpretation tools, as well as a solid understanding of statistical methods, is crucial for deriving meaningful insights. Communication skills play a vital role, as evaluators must convey complex findings to diverse stakeholders in a clear and accessible manner. Given the increasing reliance on technology, evaluators should be adept at leveraging digital tools and platforms for data collection and analysis. Flexibility and adaptability are also key, as program evaluators often work across different sectors and contexts.

Multicultural awareness is a critical skill for evaluation because culture vary from place to place, and social constructs are a continum. In doing evaluations, one must be mindful of the cultural context and be aware that what is socially viable here will differ from what is socially viable there.

More recently, I have experienced the value of cultural humility. The CDC describes cultural humility as an active and ongoing process of self-reflection. In this process, we set out to: 1.) examine our personal history/background (I highly recommend engaging in ongoing self-reflection using Hay's ADDRESSING framework), 2.) reflect on ways interpersonal interactions are impacted by the history and biases of our professional organizations, 3.) gain deeper understanding and respect for cultural differences, and 4.) recognize areas where we lack relevant experience and expertise (This encourages us to learn from others' lived experience and expertise). It is vital to embrace cultural humility in the 21st century.

In an education program evaluation, cultural competence means recognizing and respecting diverse learning styles and cultural backgrounds. Evaluators should ensure that assessment tools are culturally sensitive, language-appropriate, and inclusive. Building rapport with students, educators, and families from different cultural backgrounds is essential for gathering meaningful insights.

In the 21st century, program evaluators need a versatile skill set to excel in communication. This includes active listening to understand diverse perspectives, clear articulation to convey findings effectively, data visualization for impactful presentations, and adaptability to communicate across various platforms and audiences. Strong interpersonal skills, cultural competence, and the ability to translate technical jargon into accessible language are also crucial. Ultimately, program evaluators must be adept at fostering collaboration, building trust, and synthesizing complex information to drive meaningful change.

In this area, writing seems to be the priority means of communication for evaluation even though many process and methods of data collection require other forms of communication. So, it's important to specifically improve writing skills more consistently.

Evaluation is a bundle of many exchanges and knowledge sharing. You have to just be a good communicator to get along here. Communication skills is necessary.

Negotiation skills are crucial in the field of evaluation, as they facilitate effective collaboration and conflict resolution among diverse stakeholders. Evaluators often work with various parties, including clients, funders, program staff, and community members, each with their own interests and perspectives. Strong negotiation skills enable evaluators to align these differing viewpoints

Effective communication and reporting skills are vital for program evaluators in the 21st century. These include being able to clearly articulate evaluation findings, write comprehensive reports, and present information in a concise and accessible manner to various stakeholders. Visual storytelling and data visualization skills are also valuable in this regard

Innovation and creativity are paramount for 21st-century program evaluators. Skills like critical thinking, problem-solving, and adaptability are essential. Competencies in data analysis, trend-spotting, and collaboration are crucial for identifying novel solutions and driving impactful evaluations. Above all, an openness to experimentation and a passion for continuous learning are key to staying ahead in an ever-evolving landscape.

One time at work, I started to sense staff burnout. Imagine setting out an entire evaluation plan, and then realizing those you hoped to have on your team (program staff) were just not into it. This presented an opportunity to reassess, reimagine, and innovate! We kept our data methods the same (e.g., garnering participants' feedback through surveys, conducting qualitative interviews with program staff, and collecting program-level administrative data), but revised and reimaged our strategy for implementing it. We met staff and assessed their 'pain points.' We engaged in force-field analysis to understand their perceived barriers. We garnered staff feedback about ways to make data collection more appealing. We moved forward as a result!

In a technology-based youth engagement program evaluation, innovation means exploring unconventional data sources such as social media analytics to gauge program reach and impact. Evaluators might also use interactive digital platforms for participant feedback. Creativity comes into play when designing compelling narratives or multimedia presentations that capture the program's essence.

I've heard people say you mustn't be tech-savvy to be an evaluator. It is literally impossible. Everything that is done in today's evaluation is done with some tech tool. You may not be an expert with these tools but have some level of basic familiarity.

In an environmental conservation program evaluation, technology and data literacy involve using geographic information systems (GIS) to map biodiversity trends, employing statistical software to analyze ecological data, and creating visualizations to communicate the findings. Evaluators must navigate various data sources, ensuring accuracy and relevance in the evaluation process.

This cannot be overemphasized. Evaluation practice is dynamic, and constantly changing. It's important that practitioners continue to learn, and try new approaches. A contemporary evaluator should always have a learning agenda. It could be a tool, methodology or even programmatic aarareareaarea theme. But learning should always be part of the plan. Sometimes they end in certifications, and sometimes they're reflected in how we do our work.

Continuous learning for program improvement and professional development is another critical skillset and competency for program evaluators. This means staying abreast of new evaluation methods, emerging trends, and best practices which are essential to provide high-quality evaluations.

In a poverty alleviation program evaluation, continuous professional development might involve attending workshops on the latest socioeconomic indicators, participating in webinars on innovative evaluation methodologies, and networking with experts in the field. Staying informed about emerging trends ensures that evaluators bring fresh perspectives and methodologies to their work.

Program evaluators in the 21st century require diverse skills. Technical expertise in renewable energy projects like subsea/offshore wind turbines demands knowledge in engineering, grid code compliance, and manufacturing. Analytical skills for feasibility studies are crucial, along with proficiency in data interpretation and statistical analysis. Communication skills are vital for conveying findings to diverse stakeholders. Adaptability to evolving technologies is essential in this dynamic field. For instance, expertise in advanced monitoring systems for offshore wind farms and competence in emerging sustainable manufacturing practices contribute to effective evaluation in the renewable energy sector.

Courage and resilience are essential for professionals in a new and complex field, such as evaluation. They empower evaluation professionals to confront obstacles head-on, deliver impactful results, continuously progress in their practice, drive them to venture into uncharted territories, persevere through difficult tasks etc.