How do I use the Questionnaire tab in Mobile App Testing?

This section covers how to use the Questionnaire tab to:

• Customize study questionnaires
• Set up a Screening question for respondents
• Create Pre-study and Post-study questionnaires
• Create multiple-choice questions
• Adjust the order of your questions
• Insert questions from the question bank

Manage personal data in questionnaires 

• You can toggle whether your questions collect personal data (any information relating to an identifiable natural person, such as name, email, ID number). When you enable this option, respondents will be informed about this in your custom Privacy Information and Consent message.
• You can also choose specific questions that collect personal data to inform respondents in advance about these questions, also within your custom Privacy Information and Consent message.
• The Privacy Information and Consent message needs to be enabled to show this information to respondents.

Customize study questionnaires 

• In the options to the right of the Questionnaire tab, you can choose which questionnaires (Screening question, Pre-study, Post-study) you want included in the study.
• You can select whatever combination of questionnaires you need.
• Select Randomize pre-study/post-study question order to present questions in a random order for each respondent.
• You can only launch the study after the included questionnaires are properly set up with at least one question.

Set up a Screening question for respondents 

• The Screening question is shown to the respondents before the study begins. Respondents cannot proceed until they answer this question (if enabled).
• The Screening question can only be a multiple-choice question.
• The purpose of the screening question is to allow only respondents who meet certain conditions.

Create Pre-study and Post-study questionnaires 

• The Pre-study questionnaire is a survey given before Mobile App Testing.
• The Post-study questionnaire is a survey given after Mobile App Testing.
• Aside from their placement in the study, both questionnaires function the same way.

Above the questions, there is an option to import and export questions using a .CSV file. Use this option to easily reuse questionnaires between studies or to bring in questionnaires created outside the study setup environment.

Use UTF-8 encoded CSV files to ensure that the import works correctly. The simplest way to save your file with UTF-8 encoding is to edit it in Google Sheets (click the link for more instructions). To save a UTF-8 encoded file in Excel, go to File → Save As, select CSV UTF-8, and click Save.

CSV file format example

Create multiple-choice questions 

• After you pick any of the multiple-choice answer types (dropdown, radio button, checkboxes), you can define more options by clicking + Add answer option.
• With dropdowns and radio buttons, respondents can select only one option. With checkboxes, they can select multiple options at once.
• Options have to be between 1 and 250 characters long.
• Select Options random order to randomize the order in which these options are displayed for each respondent.
• Click the Trash bin button to remove options.
• The Allow other answer option can be enabled for dropdowns, radio buttons, or checkboxes. This allows respondents to input their own answers.
• If you enable Require to justify answer, respondents must provide a text explanation for their selection.
• Select Random order of answer options to randomize the order in which these options are displayed for each respondent.

Grid questions 

• Grid questions are best suited for asking participants about pairs taken from two sets. For example, the rows can represent time slots, and the columns can represent days.
• If you choose a Checkbox grid, participants can select as many options as they want, regardless of row or column positions.
• For the Radio button grid, participants can choose one option per row.

Likert scale questions 

• In Likert scale questions, respondents receive a statement and are asked to rate how much they agree. For example: “Please select how much you agree with the following statement: The information on example.com is organized in an intuitive way.”
• The highest score indicates total agreement, while the lowest score indicates total disagreement.
• There are 5-point and 7-point Likert scales. The 5-point scale is slightly easier to interpret, while the 7-point scale is slightly more accurate and gives respondents more choices to express themselves.
• You can adjust the labels of the lowest and highest scores to describe the meaning of the scale.
• If you enable Require to justify answer, respondents must explain the score they gave.

Net Promoter Score 

• Net Promoter Score questions measure user experience and are simple to understand. Net Promoter Score questions look like this: “How likely are you to recommend example.com to your friends or colleagues?”
• The respondent answers on a scale from 0 to 10. The higher the score, the more likely the respondent is to recommend the item in question. Respondents are split into:
  • Promoters – Score 9-10 – Users who are happy with using your website/service/etc. and spread the word to others.
  • Passives – Score 7-8 – Users who are content but have some reservations. Address their concerns to reduce the likelihood of them switching to a competitor.
  • Detractors – Score 6 and lower – Unhappy users who may spread negative word of mouth. Pay close attention to what they have to say.
• The final Net Promoter Score ranges from -100 (if all respondents are detractors) to 100 (if all respondents are promoters).
• You can adjust the labels of the lowest and highest scores to modify the scale’s meaning.

Adjust the order of your questions 

• Unless question order is randomized, questions will be displayed in the same order as in the study setup.
• You can change the order of questions by simply dragging and dropping. Just grab a question with your cursor and pull it up or down to move it higher or lower on the list.
• Alternatively, under the ellipsis button, you can move questions up and down by pressing the Move up or Move down button.
• You can enable the ‘Allow to go back’ option. This allows participants to return to previous questions and edit their answers. If this option is disabled, participants cannot return to previous questions after clicking Next.

Insert questions from the question bank 

The question bank is a collection of reusable questions that you can add to your study to quickly build thorough questionnaires. The available question types are tailored to the study type—in this case, Mobile App Testing. Explore the questionnaires where the question bank is available (Pre-study, Post-study, After-task) to see recommendations on what types of questions to ask and when.

In the questionnaire where you’d like to use the bank, click Explore question bank. This will open the question bank window.

• Use the top panel to view questions by category or search by a specific term. The question categories shown are relevant to the tool and the questionnaire type.
• Filter available questions by choosing among tags and question types.
• Click on questions that you’d like to add to select them. The right panel displays all selected questions. If you change your mind, click Deselect question to remove a question from selection. Once you’re done choosing, click Add questions.
• Some questions provide multiple suggestions for adjusting certain words in the question. Before adding them, Some questions provide multiple suggestions for adjusting certain words in the question. Once the questions have been added, you’ll be able to customize them completely to your liking.

Standardized questionnaires are specialized validated sets of questions. When adding questions from a standardized questionnaire, including the entire set is optional but recommended. Doing so allows you to evaluate the results of the questionnaire as a whole.

Available standardized questionnaires are:

• System Usability Scale (SUS)

Skip Logic 

If you add Skip Logic to a UXtweak questionnaire, you can precisely determine what comes next after each question. This ensures the questionnaire is always tailored to each participant. Enabling Skip Logic will also enforce the One Question Per Page setting to prevent participants from seeing unintended questions. Skip Logic cannot be combined with Random Order of Questions, as its purpose is to precisely control which questions participants see and when.

The possible next steps you can choose from include:

• Next question – If you select this option, the participant will be taken to the next question in the study’s predefined order.
• Study end – Selecting this option will end the study for the participant after this question. This option is not available for the pre-study questionnaires.
• Study task(s) – This option is available exclusively for the Pre-Study Questionnaire. It ends the Pre-Study Questionnaire and takes the participant directly to the main study tasks (e.g., a card sorting exercise or tasks on your website).
• Specific question – You can choose any other question in the questionnaire to skip to. However, it’s important to avoid creating a cycle in your study. Studies that include a questionnaire with a cycle cannot be launched. Aside from cycles, ensure that every question in your questionnaire is reachable from at least one other question.

You can choose any other question in the questionnaire to skip to. However, it’s important to avoid creating a cycle in your study. Studies that include a questionnaire with a cycle cannot be launched.

Aside from cycles, ensure that every question in your questionnaire is reachable from at least one other question

You can choose any of the above-listed options and bind it to either a question answer or skipping a question. You can set up multiple outcomes for questions with selectable options:

• Radio buttons – You can set a different outcome for each provided option, including the ‘Other’ option.
• Likert scales – Using breakpoints, you can create intervals on your scale and assign a different outcome to each interval. For example, with a 5-point Likert scale, values 1 and 2 can lead to one outcome, value 3 to another question, and values 4 and 5 to yet another question.