What are the most effective ways to measure the success of a CPS-based social innovation strategy?

IMO. a compеlling picturе of social impact is crеatеd by combining quantitativе data with compеlling human narrativеs. > еvaluatе progrеss on kеy indicators for thе social issuе with targеt population by conducting prе- and post-survеys or intеrviеws > track sеntimеnt and еngagеmеnt associatеd with initiativе via social mеdia, wеbsitеs, and othеr digital channеls > conduct еthnographic and obsеrvational rеsеarch to еvaluatе thе impact of a solution on rеal-world bеhaviour > collеct qualitativе insights from usеrs and bеnеficiariеs through fееdback channеls likе focus groups and community forums > usе in-dеpth storytеlling to crеatе casе studiеs that dеmonstratе thе positivе impact of a solution on individuals > considеr anеcdotal еvidеncе

In my experience, the best way to check strategy, beyond the KPIs x goals, is about hearing customers by checking the adoption of solution offered, how your solution is impacting customer journey... innovation is based on needs and this is the key driver to be measured constantly.

The way I was taught in creative problem solving is very different from how this article describes CPS. The perspective here is from convergent thinking, where creative thinking is an emergent process. Setting goals and measuring progress is great, but creative problem solving is about reviewing existing facts and coming up with many goals. If you have a product, convergent thinking makes you think about how to sell more (demographics, needs, etc). Emergent thinking would be like “what other ways can I use this product for?” And then you’ll find target markets you never thought of before. E.g.: YouTube was meant to be a dating platform, like those 90s dating services where you record a video of yourself for matching making. “You”-tube.

In my experience, you should regularly review and adapt the strategy based on the collected data, feedback, and evaluation findings. This continuous learning approach will ensure that the strategy remains relevant and effective over time.

In my experience to measure the success of A CPS based social innovation, it’s important to consider the following key indicators 1. Impact Assessment: Evaluate the extent of social change achieved. 2. Stakeholder Feedback: Gather opinions from beneficiaries, partners, and community members. 3. Quantitative Metrics: Count the number of beneficiaries, behavior changes, and reduction in targeted social issues. 4. Cost-effectiveness Analysis: Compare costs with the outcomes to ensure optimal resource use. 5. Long-term Sustainability: Evaluate scalability, replicability, and potential for continued funding or support. By defining these goals and methodologies, it is easier to obtain a scope of understanding your progress and it’s sucess

To measure the success of a CPS-based social innovation strategy, evaluate impact via set objectives, assess scalability and adaptability, ensure long-term sustainability, and gather stakeholder feedback. Check the innovation level of solutions and the effectiveness of the CPS process in fostering collaboration and incorporating feedback. Monitor learning and adaptation capabilities, and calculate the social return on investment to understand the value created against resources spent. Use a mix of surveys, interviews, and data analytics for a comprehensive assessment.

The indicators that help me daily to evaluate any aspect of my team activity are 1) engagement level in each project of each team member working on for each development that I coordinate; 2) good management time to blend with all the project aspects and personal life; 3) professional, productive, etc approach to finish the project in time; 4) good communication, etc., which each team member included in that project plus with all the community departments and the client team members that needs the support, etc., to make the project successful for the client. These four indicators help me to measure my team member's progress and to find the right solution for any surprise situation that needs to be solved faster to do the final project.

The chosen indicators must directly align with the objectives of the social innovation strategy. They should reflect the intended outcomes and impact. Indicators should be relevant to the social issue being addressed. They should provide meaningful insights into the problem and the effectiveness of the solution. Indicators should be quantifiable and measurable, allowing for clear data collection and analysis. This may involve defining specific metrics or KPIs. Consider how the indicators will be used to compare progress to a baseline or a previous state. Involve stakeholders, including the community and experts in the field, to ensure that the selected indicators resonate with those affected by the social issue.

When choosing indicators for impact measurement, I have learnt to ensure that the indicators are meaningful and relatable to the specific goals. Likewise, we must prioritize data that is accessible and obtainable. They must also be able to effectively capture both short-term and long-term impact. Finally, indicators must be adapted to reflect the unique circumstances, target population, and other contextual factors that may affect outcomes.

Measuring the impact in terms of numbers is the most common indicator. However, measuring the impact in terms of happiness or the satisfaction index in the form of surveys is very crucial. Additionally, you need to keep measuring return on investment over time.

When collecting data for impact measurement, I ensure to define the data sources specific to the initiative's context from early on. Also, collected data must be directly tied to the chosen indicators to guarantee alignment with set goals and outcomes. I have discovered that a blend of quantitative and qualitative methods usually gives more robust feedback. It's important to adhere to ethical standards, obtain consent, protect privacy, and maintain confidentiality where necessary.

My team member's method of collecting data is observation, a simple online survey, online interviews, focus groups, online meetings, etc. But this mentioned example is the most used by team members to collect data more efficiently and to provide a better understanding of what it’s for the client to find to do the right product or to target the correct category of clients that use that product very well, etc.

Ensure data quality by using validated instruments and rigorous data collection techniques to minimize bias and errors. Maintain consistency in data collection across different time points to enable meaningful comparisons. Adhere to ethical standards in data collection, handling, and storage, especially when dealing with sensitive social issues. Utilize appropriate statistical or qualitative analysis methods to interpret the data and draw meaningful insights.

In our context, the third step involves data collection, a critical phase in our strategy assessment. We'll be gathering and recording information aligned with our chosen indicators. To do this, we can utilize various methods like surveys, interviews, observations, experiments, or existing records. It's essential to select methods and sources that are most suitable and trustworthy for our project while ensuring they adhere to ethical and privacy standards within the dental field. We should also establish a clear plan for the frequency, quantity, and management of data.

I collect my data from observation on LinkedIn from reactions, texts that I receive and applications to our platform. Also, when people connect with me and generally in any way that they react/approach me.

I agree, but a huge part of social innovation is the qualitative impact this experience/ project will have on the initiative and that can be difficult to measure from quantitative analysis. From past experiences, we’ve used market research, along with data analysis, and longer attribution periods to measure success and impact.

Start with descriptive statistics to understand the basic characteristics of the data. This includes calculating means, medians and standard deviations. Ensure the data is clean and well-organized. Remove any outliers or errors that might skew the analysis. Compare data across different time periods or groups. This could involve before-and-after comparisons or analyzing data by demographics. Use correlation analysis to identify relationships between variables. Regression analysis helps predict outcomes based on various factors. If applicable, analyze qualitative data (e.g., open-ended survey responses) by identifying recurring themes and patterns.

In conducting effective analysis of the data, we must understand no dataset can provides access to everything you need to know. More importantly, this is a valuable opportunity to engage meaningfully with the dataset, validate findings, create useful models, detect patterns, and derive insights. It is quite useful too to link analysis with predetermined objectives. This is because it enables the extraction of insights that directly address the questions being explored.

In our role, the fourth step involves data analysis, a crucial phase in understanding the information we've collected. We'll employ various tools and techniques like statistics, graphs, charts, or thematic analysis to interpret the data. It's vital to choose methods that align with our project's goals and help address our evaluation questions. Additionally, we'll assess data validity and reliability while being vigilant about any potential limitations or biases that could impact our results.

For me it's more about the general vibe of my network and how they react/contribute with me and everything that I do. Generally I don't go further into detail on analyzing data.

Even you can think it is a contradiction, in my opinion the most important before communicating any kind of result is to know about your audience and their main interests. Once you know that, organize the presentation according to their interests and you goals. There are many ways of presenting a results but few of them making the audience interiorize them.

Present the results in a clear, concise and easy-to-understand manner. Avoid jargon and technical language. Use visual aids like charts, graphs and infographics to illustrate key findings. Visuals are often more accessible and impactful. Provide a narrative that contextualizes the data. Explain what the results mean in the context of the strategy's goals and the social issue it addresses. Share results regularly, not just at the end of the strategy. This keeps stakeholders informed and engaged. Utilize digital platforms, such as websites, social media and online reports, to reach a broader audience. Highlight actionable insights and recommendations based on the results. This helps guide decision-making and future strategy adjustments.

When it comes to communicating results, we should focus on delivering a clear and concise report or presentation. This should include a detailed overview of our CPS-based social innovation strategy evaluation, highlighting the methodology used, key findings, and their implications. Tailoring our communication to the specific needs and interests of our audience, whether it's our partner specialty dental practices or other stakeholders, is essential. We should emphasize the actionable insights and recommendations that have arisen from our data analysis to facilitate informed decision-making.

Qualitative Stories and Case Studies: Collect and share qualitative stories and case studies that illustrate the real-life impact of your social innovation strategy. Personal narratives can provide a compelling perspective on its success. Short stories or interviews bring visual and proof to results.

The whole point of this process is to provide an opportunity to use data for action. As such, effective reporting and communication of findings are useful in transforming data collection and analysis into actionable insights for decision-making. Tailor your communication style to the specific context to ensure that the information resonates with the intended stakeholders. Also, emphasize the most relevant recommendations for data-driven next steps, providing clear guidance for informed actions.

I do believe that the most important thing is to stimulate all of your employees to be more engaged with the company project, etc., for the company clients by giving them the ability to be more creative, free to say anything that they think, etc. anytime in each brainstorming session on each department. It can be helpful to find an innovative solution for that particular project, client, etc., that can help the team and the company to be more successful and influential on the market on that segment or more segments, as my insight can open an excellent starting point to a new future of more successful teams work in each company.

I believe the most obvious way to know if the solution is successful is to test it on the ground. If the solution proves effective, the individuals involved will provide feedback on whether it has resolved the problem or not.

In a social innovation project, we aimed to provide affordable yet durable kitchen cabinets to underserved communities. We implemented a Creative Problem Solving approach. We gathered feedback from the community members who received the cabinets. They reported increased convenience and satisfaction with their kitchens. We assessed the impact on the community, noting improved living conditions and increased access to safe and functional kitchens. We tracked the project's financials, ensuring that the innovation remained cost-effective and sustainable. The success of our CPS-based social innovation strategy was determined through real-world user feedback, impact assessments, and financial sustainability checks.

Partnership and Collaboration Assessment: Evaluate the success of your strategy by examining the strength and growth of partnerships and collaborations with various stakeholders, including local organizations, government agencies, and businesses. Strong partnerships can indicate the strategy's effectiveness in mobilizing resources and support. Innovation and Adaptation: Assess the extent to which your strategy encourages innovation and adaptation. Measure how well it fosters creative solutions to community problems and adapts to changing circumstances.