Using evaluative UX Research to assess and inform design decisions
As one of Canada’s largest and most beloved media organizations, the CBC produces a huge variety of news, radio and television programming. Their website also includes a music subdomain which offers a wide variety of music-related content, including news, reviews and the ability to stream songs and radio shows.
In 2014, the CBC team hired Toronto-based, UX strategy & design research firm Usability Matters to assess the impact and usability of their most recent redesign. Updates included changes to global navigation, the introduction of new features, such as a music finder (aka “streambox”) and the ability to save and share playlists. To accomplish this assessment, the Usability Matters team recommended that we conduct a remote, moderated usability study. This would allow music lovers to give us valuable feedback and ensure that any changes the CBC team made were user-centred and data driven.
In my role as User Experience Designer, I planned and conducted (my first!) moderated usability study, reported insights and made interaction design recommendations. I was responsible for several deliverables, including:
Defining the Research Objectives
Drafting the Test Script
Facilitating Remote Testing Sessions
Reporting Findings & Recommendations
Test results indicated that participants were able to create playlists successfully, but there were some issues with certain navigation labels and icons. The study also revealed that the participants struggled with the new “streambox” on desktop devices (since it was a design pattern that borrowed from mobile design but was unfamiliar to desktop users). This showed the CBC team the power of mental models; users were not successfully associating a mobile pattern with a desktop experience and this was leading to confusion and way finding issues. This insight led to the CBC team rethinking the “streambox” as an approach to content discovery.
This project was one my first introductions to a formal UX research methodology and, among other things, it showed me the impact that user-centred research can have to inform decision-making. Since then, I’ve conducted or consulted on hundreds of usability tests.
This project also allowed me to discover how much I love helping teams generate rich insights by defining relevant research goals, determining an effective task sequence and crafting meaningful scripts. If you’d like to chat more about evaluative research and UX strategy – or if you’d like to see more detailed samples of my work on this project, please get in touch!
Go to the CBC
Check out the CBC Music website: