You have UX research data, but how do you know if it’s high quality?

Based off what I've seen, evaluating UX research data quality goes beyond just the data itself. Here are some key aspects for you: 1. Research methodology: Was the right method chosen for the research question? Were ethical guidelines followed? 2. Sample size and recruitment: Was the participant pool diverse and large enough to draw meaningful conclusions? 3. Data saturation: Did the research reach a point where no new insights emerged, indicating sufficient data collection? 4. Streangh of findings: Are the insights supported by evidence and can they be reasonably applied to the target audience?

We do not always have peers to back us up and it is risky to change research questions and methods during the research process as it can mess up the collected data. To avoid this, I conduct a pilot test to try out my research plan. If the result of the pilot test can answer the ultimate research question, then I proceed with the research process. After conducting the pilot test, I usually adjust my research plan, such as improving questions to gain a deeper understanding of the participants. Wish my small experience helps :)

If the data cannot answer the terminal research question, it cannot be considered high-quality data, as it causes a loss of time and money. For example, while developing a learning management system (LMS), I would expect to have data like what motivates learners to start, to keep on the learning path, what used to stop them and how they manage their learning now. If I only receive data on how people use similar LMS platforms, I would consider it competitor research. While competitor analysis is important, I believe understanding the learners’ core needs could improve the design. Who wouldn't enjoy solving problems that their competitors haven't tackled yet?