How do I use the Respondents tab in Prototype Testing results to manage respondents?

In this help, we’ll explain how to use the Respondents tab to:

• Use the respondent list
• View details about individual respondents
• Filter respondents
• Apply mass actions to selected respondents

Use the respondent list 

The list of respondents is the main feature of the Respondents tab. These are all the people who participated in your study. Each respondent’s entry contains:

• The respondent’s number and icon. The icons are randomly generated and serve only for easier identification of respondents
• Respondent selection via a checkbox. Selected respondents are highlighted and can have several operations done on top of them
• Play first task – click the  button to replay the respondent’s first task. Last session means the visitor’s most recent session that matches the filter above
• Time taken – how long it took the respondent to complete the whole study
• Questions answered – the number of questions expressed by a percentage
• Tasks completed/skipped/successful – the number of tasks, expressed by a percentage
• Include in analysis – determines whether the respondent should be counted in the calculations found under the Analysis tab. Respondents who abandon the study are excluded by default.
• After you’ve adjusted which respondents should be included in the analysis, click Recalculate analysis above the list of respondents to apply the changes to the analysis (everything under the Analysis tab)
• By default, the respondents are ordered by the time when they participated in the study. You can change this order by selecting a different sorting metric in the Sort by dropdown list above the respondent list. Click the arrow buttons to change between ascending (arrow up) and descending (arrow down) order

Filter respondents 

• Filter the respondents to only display the ones who meet a certain criteria
• You can filter the respondents based on the time it took them to complete the study
• If your questionnaires contained multiple-option questions, you can also filter the respondents based on their answers
• Enter your filter and then press Apply filter to filter the respondents
• If any selected respondents become invisible due to a filter, they will also be de-selected

Respondent list

The respondent list provides you with basic information about respondents. Decide whether you want to include a respondent or not using your own criteria.

View details about individual respondents 

To view more information about the respondent, click More details beneath the respondent’s entry. There are four tabs in the detailed respondent modal view with the following contents:

Respondent’s Details 

• ID – the number of the respondent
• Started – when the respondent opened the study
• Time taken
• Questions answered
• Tasks completed / skipped / successful
• Instructions seen – count of how many times the respondent re-opened the study instructions after seeing them initially (seeing instructions for the first time doesn’t count)
• Number of comments – how many comments the respondent left behind
• IP address
• Device
• Operating system
• Browser
• Screen resolution
• Location (city, region, country)

Detailed respondent overview

This view shows all known information about the particular respondent. It can be used for detailed filtering or meticulous analysis of individual respondents.

Respondent’s Questionnaire 

Select the questionnaire you want to see answers for:

• Screening question
• Pre-study questions
• Post-study questions
• Questions after tasks

After selecting Questions after the task, select the task the questionnaire you’re interested in is related to. Either use the task selection dropdown list, or use the arrow buttons on the right and left sides of the task selection dropdown list to move between tasks one at a time.

The question results show the respondent’s answers for each question, as well as the question text and the list of available options (in case of multiple-option questions). If you include Skip Logic in your questionnaire it is important to differentiate between:

• Question skipped – the participant didn’t see this question because of the Skip Logic rules
• Question seen, did not answer – the participant saw this question and decided to skip it

Respondent’s Task Results 

• This tab shows the respondent’s data for each task
• The result – Direct success / Indirect success / Direct failure / Indirect failure / Direct skip / Indirect skip
• Task text
• Time taken – The time from when the respondent sees the task until they submit their answer. If you selected Prompt respondents to start each task with a button, this time is calculated from the press of the button
• The answer – Which design in the prototype the respondent marked as the solution to the task
• Correct answers – The correct solutions to the task (to facilitate analysis)
• Precise path with visualization – Inspect the participant’s path step-by-step, exactly as they navigated between the designs by clicking hotspots in your prototype. Click on the path to reveal the detailed view and review the made clicks and their order on each design separately.

Path detail

Move in the footsteps of the participant from a design to design and analyze their click patterns in detail.

• Stream – Click the play icon to see session replay of the respondent’s execution of the task

Detailed overview of task results of a specific respondent

View how the respondent fared in your tasks. Use the play button to open task player on a specific task.

Respondent’s Comments 

The comments left by the respondents during the study. Each comment contains text and the information about the step of the study during which it was submitted.

Apply mass actions to selected respondents 

• You can either select respondents individually, or en masse by using the Select all and Deselect all buttons
• Deselect respondents by a chosen criteria by using the filters
• Pick an action that you want to do with the selected respondents and click Go to execute it
• Mark as included/excluded – marks all selected respondents as either included or excluded in the analysis
• Delete – permanently deletes all of the respondent’s data related to the study
• Export as CSV – exports details about the selected respondents (the same details as seen in the Respondent’s Details tab) as a CSV spreadsheet

The order of columns in the respondent export:

• Order
• Identifier
• Started
• IP
• Device
• Operating system
• Browser
• Location
• Time taken
• Answered questions (percentage)
• Completed tasks (percentage)
• Skipped tasks (percentage)
• Successful tasks (percentage)