Search the courses, subjects, tracks, games and features, or jump straight to a page.
Learn it your way
A short class with Sarah and her students. The other ways are under More.
Sign up free to listen. Transcripts are free to read.
Today, we will explore how to organize quantitative results from our usability tests. Why do you think it's important to collect and organize data in a structured way?
So we can see what works well and what doesn't?
Exactly! Organized data allows us to identify trends, such as tasks with low completion rates or high error counts. Can anyone think of how we might display this data?
Maybe in a table format? That way it’s easy to compare results.
Very good! Using tables helps us quickly grasp which areas need more focus. Let’s remember the acronym 'DIVE'—to Data, Identify, Visualize, and Evaluate—to help us remember this process.
So we dive into the data to find the important parts?
Exactly! Now, let's summarize this: Organizing data is essential for identifying trends and effective prioritization.
Now, let's talk about evaluating severity. When we find issues, how can we determine if they’re critical, major, or minor?
I think critical issues need to be fixed right away because they prevent users from completing tasks.
Correct! Critical issues should be prioritized first. Can anyone give me an example of a critical issue?
If a user can’t log in at all, that's critical!
Great example! Remember the phrase 'C-M-M'—Critical, Major, Minor—to categorize issues based on their severity. It helps us focus on what's most important to fix.
And we can fix minor issues later since they aren’t as urgent?
Exactly! Let's wrap up: We categorize issues as Critical, Major, or Minor to help us prioritize effectively.
Next, we need to determine the priorities of the issues we identified. How do you think we can prioritize them?
Maybe we can look at how often each problem occurred?
Yes! Plotting issues on a graph with Frequency on one axis and Impact on the other helps visualize the most pressing problems. Who remembers how this plotting helps us?
It helps us focus on the ones that are common and have a big impact!
Exactly! The goal is to tackle those 'high-frequency, high-impact' issues first. Remember the phrase 'Fix the Big Problems First.' Great job! Let's conclude by summarizing that prioritizing involves evaluating both frequency and impact.
Let’s dive into why it’s essential to perform a root cause investigation. Why not just fix the symptoms of a problem instead of looking deeper?
If we only fix the symptoms, the problem might come back, right?
You’ve got it! By digging deeper, we can identify the real issue behind user frustrations. Can anyone suggest ways to uncover these root causes?
We can ask users more questions about their experience!
Exactly! Asking engaging questions can reveal users’ mental models and expectations. Let's remember this concept with the acronym 'D.I.G.'—Dig Inquire Gather.
So, we need to dig deep to understand their thoughts?
Yes! And remember, understanding the root cause leads to more effective solutions.
Last, let’s talk about brainstorming solutions. Why is it important to base our improvements on user feedback?
Because it ensures that what we change actually helps the users!
Exactly! This is where we become data-driven designers. Can anyone suggest how we might brainstorm solutions?
We could use sticky notes to jot down ideas quickly!
Great idea! Remember the strategy 'S.O.L.V.E.'—Solutions Organized, Listed, Verified, and Executed—to help facilitate brainstorming sessions.
So, we’ll make sure our solutions are verified before we put them into practice?
Exactly! Let's summarize our session: Brainstorming should be rooted in user feedback to ensure targeted solutions.
Using tables to identify trends in user feedback.
Categorizing issues as Critical, Major, or Minor to prioritize fixes.
Plotting issues based on Frequency and Impact to focus on significant problems.
Understanding the underlying reasons for user issues to design effective solutions.
Proposing improvements grounded in actual user feedback.
To find out what's wrong, don’t go along, just dig real deep to find the cause we seek.
Picture a doctor diagnosing a hidden illness. They don’t treat the symptoms without investigating further; similarly, we must uncover root causes for design flaws.
Remember the acronym 'D.I.G.' for Dig Inquire Gather when performing root cause investigations.
'C-M-M' stands for Critical, Major, Minor for issue categorization.
Term
Quantitative Results
Click to flip
Term
Critical Issues
Click to flip
Term
Root Cause Investigation
Click to flip
Data that can be measured and expressed numerically, such as task success rates and time taken.
The degree of impact or disruption an issue causes to a user's ability to complete a task.
How often a particular issue occurs during testing sessions.
The effect or consequence of an issue on the overall user experience.
The underlying reason for a problem, which may contribute to the issue's recurrence.
Improvements or changes based on concrete data and user feedback rather than assumptions.
This section emphasizes the importance of analyzing user feedback to identify key issues and prioritize improvements effectively.
It discusses how to organize quantitative results, evaluate severity, and determine priorities based on user feedback in usability testing. The focus is on understanding tasks users struggled with, identifying underlying causes, and brainstorming actionable solutions.
In this section, we delve into the critical aspect of analyzing user feedback gathered from usability tests and prioritizing improvements accordingly. The first step involves organizing quantitative data—such as task success rates and user satisfaction scores—into clear tables to identify patterns and trends. Next, issues are categorized based on their severity, distinguishing between critical, major, and minor problems. After establishing the severity of issues, they are plotted based on frequency and impact to prioritize 'high-frequency, high-impact' problems for immediate attention. Furthermore, the section emphasizes conducting a root cause analysis to uncover why users faced certain issues, which leads to more effective problem-solving. Lastly, brainstorming sessions for data-driven solutions are encouraged to ensure that improvements directly address user concerns and enhance overall usability.