Expert Usability Review vs Usability Testing
One particular question we're often asked is truly which method is actually best: usability testing or expert usability reviews? Well, if they were sports cars, expert usability reviews might be a Porsche (very decent car and better than no car at almost all), but usability testing would become in a different league, namely Formula 1.
So, what'ersus the difference?
- The expert usability review is truly when a usability specialist inspects a website to identify potential usability problems
- Usability testing involves obtaining people through the audience to evaluate your site whilst performing tasks
They will're quite similar in many ways in that both:
- Discover and prioritise usability problems
- Evaluate designs in the context of tasks
Perform that they find the same problems?
The answer depends on just how precisely you measure this particular, on balance no, not reliably. Generally speaking, expert usability reviews tend to come across high level breaches of design rules and consistency. Usability testing is truly better at finding issues related to special domain knowledge and task flows.
Had you been to carry out a good expert usability review before conducting usability testing, and compare both sets of findings, you can observe exactly how the issues you found in comparison to the their real experiences. Did you locate every single one the problems? Which options did you overlook? Which options that you just thought might end up being issues switched out not to end up being? It will give you a good feel for just how expert usability reviews keep upward toward usability testing.
Often, expert reviews will:
- Ignore usability issues that arise during usability testing
- Locate some issues that usability testing didn'big t
- Report false alarms (i.e. not real issues)
Which'utes the problem. It doesn't matter how good a helpful expert you are if you just depend while on an expert usability review you'll locate different kinds of issues and overlook some potentially serious options.
Consider the case of a health website aimed specifically at brand-new mums. The expert usability review found plenty of great issues, but might have overlooked the main killer one which triggered participants to pass comments like "That'utes just so insensitive!" and "I wouldn'capital t use this web site anymore". And almost all because of a seemingly benign bit of banner advertising for a local gym placed next to an content about breasts eating. A reviewer would have difficulty predicting the indignant reaction of fresh mothers who felt the site had been rubbing their nose in it. In the end there would be little possibility of them going anywhere near a gymnasium with a newborn.
Just how much overlap is there between expert usability reviews & usability testing?
Normally, there is actually some overlap in the symptoms seen in both expert usability reviews and usability testing. Research executed by Fu, Salvendy and Turley in 2002 estimated this kind of to end up being all-around 41%. Not because high as you might expect. Interestingly, expert usability reviews tend to find much more issues in comparison to usability testing. But it'utes good quality over volume.
Expert usability reviews are good...
Expert usability reviews tend to be common than usability testing mainly because they're less expensive and quicker to perform. Typically, it'll only possess a handful of days and nights to inspect a site and write a report and because you don'n need to find labs nor recruit surfers, costs are significantly cheaper. Due to this, they will're often preferred to usability testing, specifically when time and budget are squeezed.
There are anyhow some pitfalls. For a start, a lot depends on the reviewer'ersus level of experience. No two usability experts will find exactly the same issues so the method is furthermore open up to practitioner variation. The biggest problem even so is actually that they will occasionally skip the real symptoms that cause consumers to fail tasks. This particular might be specially correct once the customers provides a particular skill set. For instance, a very accountant may always be better placed to diagnose selected kinds of issues related to online accountancy tasks than a non-accountant reviewer.
...But usability testing is da Daddy!
Usability testing takes far more time to plan and organise and is actually much more expensive also - recruiting and incentivising people coming from a viewers can be costly. But it'utes definitely worth the effort! The outcome give a truer picture with the real problems people encounter because they will're derived through real people in the first place.
It'utes inconceivable exactly how sites go live without checking to determine that they're actually usable. It's like building an automobile but not test driving it. "Indeed, we've built this unique great website. Umm, well no, we've not examined to find out if people can play with it yet. But don'testosterone worry because every single one the links function and the pages download quickly."
Another benefit of usability testing is actually that there'ersus a smaller amount conjecture and feedback comes straight coming from the horse'utes mouth. Movies of user sessions in particular, can provide a powerful persuasion device for reluctant stakeholders. It'utes hard to argue with recordings of people in tears of frustration.
Use real people and accept no substitute!
Both expert usability reviews and usability testing have their time and place. In practice, people often use expert usability reviews early again to straighten upward their design in arrangements for usability testing. (Indeed that is critical for accessibility testing, since it'utes a waste of time to recruit and test consumers who can'testosterone even get into your site in the first place.)
Whilst an expert usability review is better than nothing, it'ersus still vital to serve your website in front of customers because early since probable too, rather than leaving it also late. Key elements such as site structure and navigation should always be assessed with customers at the very first opportunity. Otherwise you risk having your internet site totally overhauled at a late stage.
Ultimately, the key would be to appreciate that expert usability reviews and usability testing are different beasts. The most effective approach is to try and integrate both techniques. Remember though, you must test your site with real consumers - accept no substitute! http://www.brightspark.uk.com/index.php/member/12012/