Usability Testing
After making final edits based on user and expert evaluations, we moved to the final phase—usability testing. I focused on task success rates for key tasks. My goal was confirming that designed features met user needs and were usable and understandable. I narrowed tasks to five key tasks that were part of the main prototype flow and tied back to our three design requirements, ensuring features are introduced clearly for easy toggling, customization and organization are effective and consumable, and overall cognitive strain is reduced.
We conducted the usability testing with 5 Slack users who were encouraged to communicate their thoughts and decision processes in real-time. This testing was both in-person and remote and moderated with our teams members noting observational qualitative data and administering an end of session survey.
Before conveying the results of this testing, I want to acknowledge that we worked with a small number of users. While the results to reflect the experiences of our five users, they do not necessarily encapsulate what results may have been with a larger test group. However, taken with a grain of salt, we can see the overall results from our testing, with the users completing the majority of the tasks with success and enjoying the experience of using our prototype.
Task Success Rate Testing:
Task 1: Turn on Quick Access

Task 2: Set Up Categories

Task 3: Set Up Simple Mode

Task 4: Turn Off Simple Mode

Task 5: Customize Simple Mode

Survey Stats:

The usability testing revealed strong task completion rates and positive user feedback. Key findings included a 88% success rate across all tasks, with participants completing 4-5 out of 5 tasks successfully. Notable challenges emerged in the Categories setup task, where 3 out of 5 users initially attempted drag-and-drop functionality before receiving assistance, suggesting the need for clearer visual affordances. However, once guided, all users successfully completed the task.
User feedback was particularly positive, with Simple Mode receiving a 4.33/5 rating for helpfulness in reducing visual chaos. TidyBot scored 4/5 for organization helpfulness, and users appreciated the ease of setup (4/5 rating). Critically, all participants expressed strong preference for the redesigned features over Slack's current interface, with one user stating they would "probably keep things on simple mode for the majority of the time" and found the overall design "well done and I might even prefer this to Slack's design"