It’s propaganda, not a documentary
Remember the purpose of your highlights video. It’s to encourage the design team to make changes to the system. You’re not a news reporter, dispassionately presenting the strengths and weaknesses of the system: you have a point of view. Leave the balanced reporting for a written report where you have more time and space. If the design team are interested in the specific issues, they’ll go through your bug list. It’s like the first rule of psychotherapy: they need to accept there’s a problem before they can fix it.
Say something positive
You’re about to tell people that their baby is ugly. If the audience comprises people who designed this system, they may not like your attitude. So soften them up with clips showing one or two strengths of the system. Since you don’t have long, make this clip do double duty: try to pick a clip that also demonstrates the “thinking aloud” protocol, so people understand the process you used.
Focus on the top 5 issues
Chances are, you spotted dozens of usability problems. In another report, you’ll describe each of these problems, provide a severity rating and suggest a fix. But in a highlights video you need to summarise and prioritise. So review your problems and identify 5 themes that capture the most important problems. For example, say you spotted one usability problem to do with a confusing label on a form, a second to do with an abbreviation that baffled users and a third to do with organisational-centred navigational terms. You could summarise these as a single issue (“terminology”) and then select the best clips to demonstrate it.
Show 5 clips per theme
For each of your themes, select around 5 clips that demonstrate the problem. When choosing your clips, aim to convey some of the diversity of your participant pool. It’s tempting to focus on the one or two participants that were particularly articulate or fun to watch, but doing this leaves you open to the criticism that the problems you’ve found were due to stupid users. So aim for at least 2 participants per theme and make sure all your participants get heard in at least one of your 5 videos.
Show each problem in 5 minutes or less
You’ll have lots of clips of participants illustrating each theme, so be ruthless with your editing. People expect video clips to get to the point quickly: for example, the average YouTube video lasts 3 minutes. So you should aim for a maximum of 5 minutes to illustrate each theme. If you have 5 clips, that means an average of 60 seconds per clip.
Put your best clips first
When creating the storyboard for each theme, put the most compelling clip first. Then, if the audience buys in and agrees, stop the video and skip to the next one… or keep it rolling if there are doubters. This approach works well because one of the biggest problems in presenting usability test results is often getting through them all!
Help viewers concentrate
When you show a 1024 x 768 screen in all it’s glory it’s often hard for people to see what you’re getting at. People may not be able to see the participant’s mouse — or the participant’s mouse may not be where the action is. This means you should zoom in on specific areas of the screen, or use callouts in the video to explain what’s happening. This is where you need to go beyond usability testing software like Morae and Silverback and use more flexible tools for editing digital video like Camtasia Studio and Screenflow. Both these tools are cheap ways to make your videos look good and for you to feel proud of the results.
If you enjoyed this you'll love our 1-day workshop, A Practical Guide to Usability Testing. You'll learn the essentials of usability testing and get practical, hands-on experience moderating and logging usability tests.
About the author
Dr. David Travis (@userfocus on Twitter) holds a BSc and a PhD in Psychology and he is a Chartered Psychologist. He has worked in the fields of human factors, usability and user experience since 1989 and has published two books on usability. David helps both large firms and start ups connect with their customers and bring business ideas to market. If you like his articles, you'll love his online user experience training course.
Foundation Certificate in UX
Gain hands-on practice in all the key areas of UX while you prepare for the BCS Foundation Certificate in User Experience. More details
Every month, we share an in-depth article on user experience with over 10,000 newsletter readers. Want in? Sign up now and download a free guide to usability test moderation.
If you liked this, try
Before you can implement a usability initiative in your organisation, you'll need to convince your manager it's worthwhile. The obvious approach is to use a cost-benefit argument, but experience shows that this approach often fails because many managers find the data unconvincing. An alternative approach is to tailor your argument based on your manager's MBTI personality type. Selling usability to your manager.
User Experience Articles
Our most popular articles
Our most commented articles
Our most recent articles
Search for articles by keyword
- 7 articles tagged accessibility
- 4 articles tagged axure
- 5 articles tagged benefits
- 13 articles tagged careers
- 8 articles tagged case study
- 1 article tagged css
- 8 articles tagged discount usability
- 2 articles tagged ecommerce
- 13 articles tagged ethnography
- 14 articles tagged expert review
- 1 article tagged fitts law
- 4 articles tagged focus groups
- 1 article tagged forms
- 6 articles tagged guidelines
- 10 articles tagged heuristic evaluation
- 7 articles tagged ia
- 14 articles tagged iso 9241
- 9 articles tagged iterative design
- 3 articles tagged layout
- 2 articles tagged legal
- 11 articles tagged metrics
- 3 articles tagged mobile
- 7 articles tagged moderating
- 3 articles tagged morae
- 2 articles tagged navigation
- 9 articles tagged personas
- 15 articles tagged prototyping
- 7 articles tagged questionnaires
- 1 article tagged quotations
- 4 articles tagged roi
- 16 articles tagged selling usability
- 12 articles tagged standards
- 41 articles tagged strategy
- 2 articles tagged style guide
- 4 articles tagged survey design
- 5 articles tagged task scenarios
- 2 articles tagged templates
- 21 articles tagged tools
- 52 articles tagged usability testing
- 3 articles tagged user manual