How do I use the Overview tab in Tree Testing results?

In this help, we’ll explain the information found in the Overview tab:

• Summary
• Time Taken
• Top Locations
• Success and Directness
• Tasks result overview

Summary 

• The donut chart tells you how many respondents participated and how many actually completed the study
• The numbers of respondents who completed and abandoned the study are also displayed below
• Created on is the date when the study draft was first made
• Launched on is when data started being collected
• Last respondent is the date when somebody participated in the study most recently

Time Taken 

• A breakdown of how long it takes people to complete your study
• The candlestick chart displays the time range in which respondents completed your study
• The bar illustrates the upper and lower quartiles with the line inside marking the median value
• T-shaped ‘wicks’ in the candle chart mark the highest and lowest times that it took to complete the study

Top Locations 

• The top three countries that your respondents came from
• Location is determined based on the respondent’s IP address and as such can be inaccurate (such as when the respondent is using and out-of-country VPN or other means to obfuscate their presence online)

Success and Directness 

• Success is the percentage of answers that were correct, calculated for all answers from all respondents. It shows how well the respondents handled the tasks overall.
• Directness is the percentage of answers that were direct (without backtracking), calculated for all answers from all respondents. It shows how sure the respondents were with their answers.

Tasks result overview 

This bar chart breaks down the answers to each task by whether they were Direct/Indirect and a Success/Failure/Skip.

• Direct success – the respondent went directly for the correct answer
• Indirect success – the respondent took a different path and backtracked before going for the correct answer
• Direct failure – the respondent went directly for a wrong answer
• Indirect failure – the respondent took a different path and backtracked before going for a wrong answer
• Direct skip – the respondents skipped the task immediately, without clicking anywhere in the prototype first
• Indirect skip – the respondent explored the prototype before choosing to skip the task

The skips will only appear in the results if you allowed respondents to skip tasks in the task setup.

Summary, time and location

The Overview contains the big picture of the Prototype Testing study. Use the summary to keep track on the current state of the study, Time Taken to see how long it takes respondents to complete, Locations for where they came from.

Success, directness and task overview

Charts showing the success and directness metrics calculated for the whole study. Bar charts portray the success and directness rates for each task.