Moderated vs Unmoderated Usability Testing

There are 2 directions in which most usability testing methods can be split: Moderated and Unmoderated.

In this guide, we are going to cover their differences and help you choose the right method for your research.

Moderated usability testing definition

Moderated usability testing is any type of usability study that requires active participation of a qualified  moderator on top of a pre-written test script to induct the user into the testing, give them the information they need and instruct them on how to proceed with the testing.

In order to obtain insights, the moderator guides participants through the test and records their interactions with the object of testing (product/service, prototype, wireframes, screenshots…).

Advantages of moderated usability testing

  • More engaged participants 

The whole testing looks a lot like a 1 to 1 interview and there is a real connection between a moderator and the tester. Feeling like a casual conversation, it builds more trust and motivates the tester to complete the tasks.

  • Reactive collection of additional information

As the moderator follows every user’s interaction with the website, the moderator can ask custom followup questions that can help to explain the user’s actions. The moderator can ask what made the users click the certain element, what did they expect to happen, etc.

  • Body language

Moderated usability tests also give you the ability to follow the respondent’s body language in real time, pick up on when they feel confused or unsure and probe them more on why this happens.

When do you need moderated usability testing?

Because a moderator supplies moderated usability tests with a great degree of flexibility and facilitates even studies that are more complex within the frame of personal interaction, moderated testing lends itself particularly well for qualitative testing Moderated testing is usually conducted at the early stages of the design process, when you need formative data.

For example, with low fidelity prototypes, when you know that you’ll need to follow them up with questions. They are also very useful when testing complex interfaces, the ones that might need some further explanation. 

Unmoderated usability testing definition

Unmoderated usability testing is a type of usability testing in which participants are not supervised by a moderator. The test is prepared in advance, and participants are responsible for completing it on their own. All you have to do with unmoderated usability study is produce the test and recruit the participants to take it.

Another advantage of this technique is that the number of people who can participate in the study is unlimited, meaning it allows you to support claims with statistical significance. As a result, unmoderated testing allows you to collect considerably more data in a much shorter amount of time and at a cheaper cost. 

Unmoderated usability testing can be easily conducted with the help of an online usability testing tool like UXtweak.

Try Unmoderated testing with UXtweak

The only UX research tool you need to visualize your customers’ frustration and better understand their issues

Register for free
Try Unmoderated testing with UXtweak

Advantages of unmoderated usability testing

  • Mobility

There is no need for a moderator, so the testers can feel free to complete the  study anywhere, at any time. With a moderator, two or more testers only available in the same conflicting time slot would be a problem. Here, they can do the study simultaneously.

  • Less expensive 

Unmoderated tests require less resources and are easier to set up. Although they do call for more thorough preparation, to make sure you probe the respondent for all the information you need, the prices are significantly smaller. Aside from the cost of the incentive, the cost of conducting the study is fixed, regardless of how many testers you want to invite. It’s also much faster than the moderated testing.

  • Less bias

There is no “observer factor” which makes it more comfortable for some users to complete the test. It also allows them to be more honest.

  • More data

You can conduct unmoderated tests on a much larger group of respondents, which gives you access to more data.

Moderated vs Unmoderated

Choose moderated usability testing when you primarily need qualitative insights (“what happens, how and why?”) and when you have time and resources to spare. As moderated studies are more demanding during the data collection phase than the unmoderated ones and require a lot more effort, they are usually conducted at the early stages of the design process. For example, with the low fidelity prototypes, when you know you’ll need to follow them up with questions. 

It is also very useful when testing complex interfaces, the ones that might need some further explanation.

Unmoderated usability testing will be useful at any stage of the design and development process, when you already have a prototype or a live website. It allows you to gather insights quickly and, due to its lower price, you can conduct several rounds of testing. It’s also the perfect choice if you need reliable quantitative data – answer to numeric questions such as “how many?” and “to what degree?”.





Last update 1 . 4 . 2022