How do I use the Respondents tab in Mobile Testing results to manage respondents?

Table of contents

In this help, we’ll explain how to use the Respondents tab to:

Use the respondent list
View details about individual respondents
Filter respondents
Apply mass actions to selected respondents

Use the respondent list

The list of respondents is the main feature of the Respondents tab. These are all the people who participated in your study. Each respondent’s entry contains:

The respondent’s number and icon. The icons are randomly generated and serve only for easier identification of respondents
Respondent selection via a checkbox. Selected respondents are highlighted and can have several operations done on top of them
Play video – click the button to replay the respondent’s recording
Started at – the date and time when the respondent opened the link to the study
Status – has the respondent completed the study all the way or abandoned it partway through?
Time taken – how long it took the respondent to complete the whole study
Questions answered – the number of questions expressed by a percentage
Tasks completed/skipped/successful – the number of tasks, expressed by a percentage
Include in analysis – determines whether the respondent should be counted in the calculations found under the Analysis tab. Respondents who abandon the study are excluded by default.
After you’ve adjusted which respondents should be included in the analysis, click Recalculate analysis above the list of respondents to apply the changes to the analysis (everything under the Analysis tab)
By default, the respondents are ordered by Started at. You can change their order by selecting a different sorting metric in the Sort by dropdown list above the respondent list. Click the arrow buttons to change between ascending (arrow up) and descending (arrow down) order

View details about individual respondents

To view more information about the respondent, click More details beneath the respondent’s entry. There are four tabs in the detailed respondent modal view with the following contents:

Respondent’s Details

ID – the number of the respondent
Started – when the respondent opened the study
Status
Time taken
Questions answered
Tasks completed / skipped / successful
Instructions seen – count of how many times the respondent re-opened the study instructions after seeing them initially (seeing instructions for the first time doesn’t count)
Number of comments – how many comments the respondent left behind
IP address
Device
Operating system
Browser
Screen resolution
Location (city, region, country)

Respondent’s Questionnaire

Select the questionnaire you want to see answers for:

Screening question
Pre-study questions
Post-study questions
Questions after tasks

After selecting Questions after the task, select the task the questionnaire you’re interested in is related to. Either use the task selection dropdown list, or use the arrow buttons on the right and left sides of the task selection dropdown list to move between tasks one at a time.

The question results show the respondent’s answers for each question, as well as the question text and the list of available options (in case of multiple-option questions). If you include Skip Logic in your questionnaire it is important to differentiate between:

Question skipped – the participant didn’t see this question because of the Skip Logic rules
Question seen, did not answer – the participant saw this question and decided to skip it

Respondent’s Task Results

This tab shows the respondent’s data for each task
The result – Completed / Skipped
Time taken – The time from when the respondent sees the task until they submit their answer. If you selected Prompt respondents to start each task with a button, this time is calculated from the press of the button
Task text
Destination – What URL the respondent chose as the right location
Stream – Click the play icon to see the screen recording of the respondent’s execution of the task. If you’ve enabled think-aloud, you’ll also hear audio.

Respondent’s Comments

The comments left by the respondents during the study. Each comment contains text and the information about the step of the study during which it was submitted.

Filter respondents

Filter the respondents to only display the ones who meet a certain criteria
You can filter the respondents based on the time it took them to complete the study
If your questionnaires contained multiple-option questions, you can also filter the respondents based on their answers
Enter your filter and then press Apply filter to filter the respondents
If any selected respondents become invisible due to a filter, they will also be de-selected

Apply mass actions to selected respondents

You can either select respondents individually, or en masse by using the Select all and Deselect all buttons
Deselect respondents by a chosen criteria by using the filters
Pick an action that you want to do with the selected respondents and click Go to execute it
Mark as included/excluded – marks all selected respondents as either included or excluded in the analysis
Delete – permanently deletes all of the respondent’s data related to the study
Export as CSV – exports details about the selected respondents (the same details as seen in the Respondent’s Details tab) as a CSV spreadsheet

The order of columns in the respondent export:

Order
Identifier
Started
IP
Device
Operating system
Browser
Location
Time taken
Answered questions (percentage)
Completed tasks (percentage)
Skipped tasks (percentage)
Closed tasks (percentage)
Successful tasks (percentage)

Respondent list

The respondent list provides you with basic information about respondents. Decide whether you want to include a respondent or not using your own criteria.

Detailed respondent overview

This view shows all known information about the particular respondent. It can be used for detailed filtering or meticulous analysis of individual respondents.

Apply mass actions to selected respondents

You can either select respondents individually, or en masse by using the Select all and Deselect all buttons
Deselect respondents by a chosen criteria by using the filters
Pick an action that you want to do with the selected respondents and click Go to execute it
Mark as included/excluded – marks all selected respondents as either included or excluded in the analysis
Delete – permanently deletes all of the respondent’s data related to the study
Export as CSV – exports details about the selected respondents (the same details as seen in the Respondent’s Details tab) as a CSV spreadsheet

The order of columns in the respondent export:

Order
Identifier
Started
IP
Device
Operating system
Browser
Location
Time taken
Answered questions (percentage)
Completed tasks (percentage)
Skipped tasks (percentage)
Successful tasks (percentage)

Overview Tab Testing Player