How can R&D users and beneficiaries be involved in R&D impact evaluation?

I would suggest this has to be far more than stakeholder mapping. What we need is systems mapping. We need to broaden and deepen our view in our attempt to better understand nth degree consequences. We can never do this perfectly, but we can do this far better than it is commonly done today. So don’t just map stakeholders. Map systems. Map relationships. From this basis you are better placed to see the woods for the trees, and thus intervene more positively in complex systems.

The involvement of R&D users and beneficiaries in impact evaluation is paramount for a user-centered analysis. Hosting workshops and surveys offers direct insights into their experiences and needs. Engaging them in prototyping sessions provides hands-on feedback, while participatory evaluations empower them as co-assessors. Case studies and interviews personalize the impact narrative. Crucially, feedback loops ensure that their input directly refines R&D processes. Collaborative workshops and public forums further enhance dialogue. By intertwining their insights throughout evaluation, we provide our R&D that resonates deeply with its intended audience, optimizing relevance and efficacy.

Early engagement of R&D users and beneficiaries in the project's inception and design stages along with stakeholder mapping is another key. Employ methods such as focus groups, surveys, and interviews to capture their insights regarding project objectives and anticipated outcomes. Furthermore, establish a routine of frequent stakeholder meetings to keep them informed about project developments and to welcome their input for any necessary adjustments, ensuring continuous alignment with their needs and expectations.

A lot of folks confuse co and participatory design. Co design tends to involve many diverse folks from day one. You map the system, problem / opportunity frame, explore the ecology of responses, deeply consider the moral implications etc. on this process everyone is effectively equal. Participatory design is a little different. This process is clearly stewarded and led by a certain party (or small group). From this basis, others are invited into the process. Neither is better or worse, but they can be more or less effectively applied to different situations. I’d suggest settling back, assessing your context, then drawing from the toolkit of either practice more explicitly.

It's important to clarify goals and metrics with all R&D users and beneficiaries. Collaborate with R&D users and beneficiaries to establish precise project objectives and measurable success indicators. Work together to define key performance metrics that align with their specific needs and expectations, ensuring a clear focus on the desired outcomes.

No future about me without me. This is a heuristic that may well serve the collective us very well. Life is an active process that we live together. It’s inherently relational. R&D ought to be the same. To some extent, recognising certain opportunity costs when success is measured ‘traditionally’, the more diverse participation to more wholesome the response to a given problem will be. Less undesirable / unconscious bias, fewer unintended and harmful consequences, more world views to call upon… if stewarded effectively, this can lead to wiser research, development and real world outcomes.

The word empowerment assumes one party has power over others, and is this granting a little bit of that to someone who may not have it. Although this has traditionally been accurate, one can argue it ought not be the case. I’d suggest we all have power in our capacity to participate. But we have far more power when we connect, collaborate and coordinate wise action.

Evaluation and learning are instrumental in involving R&D users and beneficiaries in impact assessment. They create a continuous feedback loop, allowing stakeholders to share their experiences and needs. This iterative process leads to improved solutions that better align with user requirements. It fosters user-centered design and enhances solution relevance. Learning through evaluation helps users discover new ways to maximize the benefits of R&D outputs. Transparent communication of results builds trust, while capacity-building empowers users to make the most of R&D resources. Additionally, evaluation ensures alignment with user goals, informs policy decisions, and strengthens user engagement and ownership in R&D projects.

Don’t forget the most important stakeholder of them all; earth. Every single species on this planet relies to a greater or lesser extent on the stability of earth systems. We have eroded that stability. But all hope is not lost. By collectively orienting our values and actions towards custodianship for life itself, we may well be able to benefit from truly wise innovation.