How do you evaluate the feedback from a cognitive walkthrough?

由人工智能和领英社区提供技术支持

A cognitive walkthrough is a usability evaluation method that simulates how a user would interact with a system or a product. It involves a team of evaluators who follow a predefined scenario and try to perform the tasks that the user would do. The evaluators assess how easy or difficult it is to achieve the goals, and identify any potential problems or errors. In this article, you will learn how to conduct a cognitive walkthrough in the context of usability engineering, and how to evaluate the feedback from the method.

此文章中的业界达人

由社区从 3 条内容中精选。了解更多

Nima Zafarpoor

QA & QC Expert* IRCA Certified Lead auditor*Project Management*Project Portfolio Management*QA Engineering*Quality…
Jp Lynch

UXer / Applied social scientist
Brian Jess Ragaza

??? Top 32 of Top 100 Filipinos in LinkedIn? 2024 | LinkedIn? Top UX Research & Graphic Design Voice | AI | DesignOps…

1 Define the Scope and the Goals

The first step in conducting a cognitive walkthrough is to define the scope and the goals of the evaluation. You need to decide what aspects of the system or the product you want to test, and what are the expected outcomes. You also need to define the target users, their characteristics, and their needs. This will help you to create realistic scenarios and tasks that reflect the user's perspective and context.

添加您的观点

Nima Zafarpoor

QA & QC Expert* IRCA Certified Lead auditor*Project Management*Project Portfolio Management*QA Engineering*Quality Auditing*Administrative Management Expet*QA Manager at Yaks* Trainer*
举报内容
Evaluate feedback from a cognitive walkthrough by identifying recurring usability issues ???♂?. Prioritize findings based on their impact on user tasks and experiences. Look for patterns in user misunderstandings or errors. Consider the alignment of feedback with design goals and objectives ??. Analyze feedback qualitatively and quantitatively to gauge the severity and frequency of issues. Use insights to refine the design iteratively and enhance usability. ????

已翻译

赞

2 Create Scenarios and Tasks

The next step is to create scenarios and tasks that the evaluators will follow during the cognitive walkthrough. A scenario is a description of a situation or a problem that the user wants to solve using the system or the product. A task is a series of actions that the user needs to perform to achieve the goal of the scenario. You should create multiple scenarios and tasks that cover different features and functions of the system or the product, and vary in complexity and difficulty.

添加您的观点

Jp Lynch

UXer / Applied social scientist
举报内容
Try to be as concrete and specific as possible here. When outlining or starting out it's fine to be vague or attitudinal, but that won't get your analysis far later on. So sweat the details. Use bullet points instead of long, grammatically correct paragraphs. Based on what you'll be evaluating for, create straightforward scales for your evaluators to use to help them do their work efficiently. And let them say they don't know how to interpret some data! It may just need someone else's eyes to make sense.

已翻译

赞

3 Select Evaluators and Roles

The third step is to select the evaluators and assign them roles for the cognitive walkthrough. You need at least one evaluator who will act as the user, and one evaluator who will act as the facilitator. The user will perform the tasks according to the scenarios, while the facilitator will guide the user and ask questions. You can also have other evaluators who will act as observers, note-takers, or experts. The evaluators should have some knowledge of the system or the product, but not be too familiar with it.

添加您的观点

4 Conduct the Cognitive Walkthrough

The fourth step is to conduct the cognitive walkthrough. The facilitator will present the scenario and the task to the user, and ask them to think aloud as they interact with the system or the product. Additionally, the facilitator will ask four questions for each action that the user performs in order to determine if they know what to do next, if they notice that the correct action is available, if they associate the correct action with the goal, and if they get feedback that their action was successful. The evaluators will record the user's actions, answers, comments, and any problems or errors that occur, noting any positive or negative aspects of the system or product.

添加您的观点

Brian Jess Ragaza

??? Top 32 of Top 100 Filipinos in LinkedIn? 2024 | LinkedIn? Top UX Research & Graphic Design Voice | AI | DesignOps and Product Design Lead @ Kaya AI | Creativepreneur ????
举报内容
Recently, I facilitated a cognitive walkthrough for a new app we were developing. I asked users to complete tasks while thinking out loud, like changing their profile settings. I observed if they understood what to do next and noticed available options. One user hesitated on a screen, which revealed a usability issue, and mentioned that the confirmation message after saving changes wasn’t clear. This feedback helped identify areas for improvement, such as making options more visible and providing clearer feedback, leading to a more intuitive design.

已翻译

赞

5 Evaluate the Feedback and Generate Recommendations

The final step is to evaluate the feedback and generate recommendations for improving the usability of the system or the product. The evaluators will review the notes and the recordings from the cognitive walkthrough, and identify any issues or patterns that emerged. They will also rate the ease or difficulty of each task, and the satisfaction or frustration of the user. Based on the findings, the evaluators will suggest possible solutions or changes that could enhance the user experience and the performance.

添加您的观点

Usability Engineering

+ 关注

给文章评分

我们借助人工智能创建了此文章。您认为这篇文章怎么样？

很棒不太好

举报此文章

查看全部

How do you evaluate the feedback from a cognitive walkthrough?

1

2

3

4

5

1 Define the Scope and the Goals

2 Create Scenarios and Tasks

3 Select Evaluators and Roles

4 Conduct the Cognitive Walkthrough

5 Evaluate the Feedback and Generate Recommendations

Usability Engineering

给文章评分

感谢您的反馈

更多Usability Engineering相关文章

更多相关阅读内容