What are the most effective tools for conducting mixed-methods evidence synthesis?

1 Search and screening tools

Searching and screening the literature for relevant studies is a time-consuming and tedious process in MMES, so researchers need tools to help manage and streamline the process. Covidence is a web-based platform that enables researchers to import references from multiple sources, screen titles and abstracts, assess full-text articles, and export data for analysis. It also supports collaboration, quality assessment, and data extraction for systematic reviews and meta-analyses. EPPI-Reviewer is another web-based software that helps researchers conduct all stages of a systematic review, including searching, screening, coding, synthesis, and reporting. It supports both quantitative and qualitative data, as well as mixed-methods and configurative reviews. Advanced features such as text mining, machine learning, and network meta-analysis are also available. Lastly, Rayyan is a web-based tool that facilitates article screening for systematic reviews. It allows researchers to apply inclusion and exclusion criteria to articles, label and categorize them, collaborate on deduplication tasks, and export data for analysis.

2 Data extraction and management tools

Extracting and managing data from studies is a key step in MMES. To do this effectively and accurately, while preserving the original data and avoiding data loss or distortion, researchers need suitable tools. NVivo, MAXQDA, and Dedoose are some of the most effective tools for the purpose. NVivo enables researchers to collect, organize, analyze, and visualize qualitative and mixed-methods data. It supports text, audio, video, images, and web pages as well as coding, annotating, querying, and linking data. MAXQDA allows researchers to work with qualitative and mixed-methods data in different formats such as text, audio, video, images, and PDFs. It also enables researchers to code, memo, compare, and visualize data as well as conduct various types of analysis. Dedoose is a web-based platform that helps researchers manage and analyze qualitative and mixed-methods data in multiple types such as text, audio, video, images, and spreadsheets. It allows researchers to code, filter, chart, graph data as well as perform cross-case and within-case analysis.

3 Data synthesis and reporting tools

The final step in MMES is to synthesize and report the findings from the quantitative and qualitative data. This involves integrating, comparing, and interpreting the data, as well as presenting the results in a clear and coherent way. To achieve this, researchers need tools that can help them synthesize and report the data in a rigorous and transparent manner, while addressing the potential limitations and biases of the MMES. GRADE-CERQual is one such tool, offering a framework to assess and report the confidence in qualitative evidence synthesis. It consists of four components: methodological limitations, coherence, adequacy, and relevance; plus guidance on presenting and explaining confidence ratings. PRISMA is another effective tool; it provides guidelines for reporting methods and results of systematic reviews and meta-analyses. Lastly, JBI SUMARI is a software that supports researchers conducting systematic reviews by providing a structured interface to guide them through the steps, from protocol development to data synthesis and reporting. It also offers tools for quality appraisal, data extraction, data analysis, and data synthesis.

4 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?