Show us the evidence: key questions to ask edtech providers

In January 2024 more than 30,000 education professionals from over 130 countries descended on London, UK for what is described as the world’s largest educational technology conference: Bett. This year the conference featured around 500 exhibitors, sharing ideas and pitching their products and services to broad audiences, ranging from government officials to business and educational leaders.

At Cambridge University Press and Assessment, we rounded off Bett week by welcoming a delegation of education experts from Brazil and Mexico to our offices in central Cambridge. ?In a morning of talks and networking, we extended the conversations to education reform more generally, noting of course that the implementation of educational technology is a common theme when it comes to discussions about change and laying the foundations for future success.

It was perhaps no surprise to hear that in the ever-evolving landscape of education, leadership teams have found themselves navigating a sea of edtech options which, despite all of the promises, have not always delivered on what matters most: evidence of improved learning outcomes. As a result, whilst everyone in the room remained convinced that new technology does have a key role to play in education now and in the future, decision makers are assessing edtech with an increasingly critical eye and are demanding more from those they partner with. The crucial question being: “Can you show us the evidence of positive impact on learning?”

Our presenters from Cambridge delivered an overview of how we meet the needs of learners and educational institutions by combining research, teaching, learning and assessment, and in doing so furthering Cambridge University’s mission “to contribute to society through the pursuit of education, learning and research at the highest international levels of excellence”. As discussions with the delegates inevitably turned to edtech, we touched on some of the ways in which our research-informed expertise, combined with frameworks, experience and of course new technology, has helped us partner with governments, schools and universities, to drive reform and positive long-term outcomes.

With this evidence-based approach in mind, here are a few thoughts on the kinds of questions that education leaders should be posing to edtech providers, and what is reasonable to expect when evaluating the value and impact of edtech solutions.

Why asking for evidence matters:

1.Demonstrating ROI. Educational budgets are limited, and every expense must be justified. By asking for evidence of positive learning outcomes, educators can start to determine the return on investment of an edtech product or service.

2. Effective resource allocation. With countless edtech options available, educators must allocate their resources wisely. Evidence-based decision making ensures that time, effort, and funds are directed towards tools with a proven track record of improving learning.

3.?Improved outcomes for students. The ultimate goal of education is to facilitate learning. Edtech solutions should contribute positively to this goal. By demanding evidence, educators can select products or services that genuinely enhance student achievement and engagement. Adoption of new technology does not always equate to improved outcomes.

Key questions to ask:

1.?Can you provide data or case studies showcasing the impact of your product on student learning? Edtech providers should offer concrete evidence of how their solutions have improved learning outcomes for other customers. As an example, Cambridge’s online test of English competency, Linguaskill, can serve a number of different needs, but rather than simply making claims, we provide a range testimonials and case studies from customers around the world who are already successfully using the test.

2.?What research or studies have been conducted on your product’s effectiveness? Inquire about academic studies supporting the claims made by the provider. Impact studies, when done well, can provide transparent and comprehensive insights into the effectiveness of an edtech solution in a certain context. Decision makers can then use this information to assess whether the same solution would work in their own context. ?See this summary of our Evolve Digital impact study, in collaboration with the Japanese Ministry of Education, Culture, Sports and Science, as an example. As with all good academic studies, the full report has also been published and can be accessed on request.

3. What ongoing support and professional development services do you offer to help educators maximize the impact of your product? Support with onboarding and ongoing professional development are essential for successful edtech implementation. Sometimes this is provided by the edtech vendors themselves, or they may partner with training experts. It’s always worth asking if they have regional support from individuals or teams who have a good understanding of your local context.

4.?What measures do you have in place to protect student data and privacy? Ensure that the edtech provider prioritizes the security and privacy of sensitive student information. Cambridge is committed to protecting and respecting the privacy of customers, and digital learning environments like Cambridge One follow strict, documented guidelines when it comes to data and privacy. Beware of any edtech provider that does not have a documented data and privacy policy!

In conclusion, whether you’re seeking new ideas and inspiration at conferences like Bett, or searching online for solutions to a specific problem your school or university is looking to solve, your primary mission as an educator is to provide the best possible learning experiences for your students. This means making informed decisions about the edtech you choose to adopt. By asking edtech providers to “show us the evidence” you can ensure that your investments are well-placed and that your teachers and students truly benefit from technology-enabled education. Embrace the opportunities to connect with edtech experts and make a meaningful difference to the lives of your students through an evidence-based approach to teaching and learning.