How do you keep track of usability metrics over time and measure progress?

1 Choose relevant metrics

The first step is to choose the right metrics for your project goals and research questions. Depending on what you want to measure, you can use different types of usability metrics, such as task-based metrics, user satisfaction metrics, or behavioral metrics. For example, if you want to measure how easy it is for users to complete a task, you can use task-based metrics such as completion rate, time on task, or error rate. If you want to measure how satisfied users are with your product or service, you can use user satisfaction metrics such as ratings, feedback, or Net Promoter Score (NPS). If you want to measure how users interact with your product or service, you can use behavioral metrics such as clicks, scrolls, or eye movements.

2 Collect data consistently

The second step is to collect data in a consistent and reliable way. You need to define your target users, sample size, data sources, and data collection methods before you start your usability testing or evaluation. You also need to ensure that your data collection tools and procedures are valid, accurate, and unbiased. For example, if you use surveys or interviews to collect user satisfaction metrics, you need to use clear and consistent questions, scales, and formats. If you use analytics or sensors to collect behavioral metrics, you need to use reliable and calibrated devices, software, and protocols.

3 Analyze data objectively

The third step is to analyze your data in an objective and rigorous way. You need to use appropriate statistical techniques and tools to summarize, compare, and interpret your data. You also need to check for any outliers, errors, or anomalies that might affect your results. For example, if you use task-based metrics to compare two versions of a design, you need to use tests such as t-tests or ANOVA to determine if the differences are statistically significant. If you use user satisfaction metrics to measure user loyalty, you need to use methods such as segmentation or regression to identify the factors that influence user satisfaction.

4 Report data clearly

The fourth step is to report your data in a clear and meaningful way. You need to use visual aids such as charts, graphs, or tables to present your data in a concise and comprehensible way. You also need to use narrative aids such as summaries, highlights, or recommendations to explain your data in a relevant and actionable way. For example, if you use behavioral metrics to track user engagement, you need to use charts such as heat maps, funnel charts, or cohort analysis to show how users interact with your product or service. You also need to use summaries such as key findings, insights, or opportunities to show how your data can inform your design decisions.

5 Track data over time

The fifth step is to track your data over time and measure your progress. You need to establish a baseline and benchmarks for your usability metrics and compare them with your current and future data. You also need to monitor and evaluate the impact of any changes or improvements that you make to your product or service. For example, if you use task-based metrics to measure user performance, you need to set a baseline and benchmarks for your completion rate, time on task, or error rate and compare them with your data after each iteration or release. You also need to monitor and evaluate how your changes or improvements affect your user performance.

6 Improve data continuously

The sixth and final step is to improve your data collection, analysis, and reporting processes continuously. You need to review and refine your usability metrics and methods regularly and ensure that they are aligned with your project goals and research questions. You also need to seek and incorporate feedback from your stakeholders and users and ensure that they are informed and involved in your usability engineering process. For example, if you use user satisfaction metrics to measure user experience, you need to review and refine your ratings, feedback, or NPS questions and scales and ensure that they are relevant and meaningful for your users. You also need to seek and incorporate feedback from your stakeholders and users and ensure that they are satisfied and loyal to your product or service.

7 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?