How do I use the Questionnaire tab in RePlay Tasks?

RePlay Tasks allows you to add surveys into your study. In this help, we'll discuss how to use the Questionnaire tab to:

  • Customize study questionnaires
  • Set up a Screening question for respondents
  • Create Pre-study and Post-study questionnaires
  • Create multiple option questions
  • Adjust the order of your questions

Customize study questionnaires 

  • In the options to the right of the Questionnaire tab, you can pick which questionnaires (screening question, pre-study, post-study) you want included in the study
  • You can select whatever combination of questionnaires you need
  • Select Randomize pre-study/post-study question order to ask questions in random order from each respondent
  • You can only launch the study after the included questionnaires are properly set up with at least one question

Set up a Screening question for respondents 

  • The Screening question is shown to the respondents before the study begins. Respondents cannot continue before they answer this question (if you turned it on).
  • The Screening question can only be a multiple option question
  • The purpose of the Screening question is to accept only those respondents who meet certain conditions
Step 1
Write your question. You can provide additional information in the description when neccessary.
Step 2
Select whether you want the screening question shown as a dropdown or a radio button selection.
Step 3
Click + Add answer option and create as many answer options as you want.
Step 4
Use the Reject checkboxes to select which options should lead to the rejection of the respondents who pick them.
Step 5
Below the screening question, you can customize the message seen by respondents who have been rejected.
Step 6
You can also set the redirect URL to those, who have been rejected (e.g. to link them to your different study that is open to anyone).

Create Pre-study and Post-study questionnaires 

  • The Pre-study questionnaire is a survey given before the tasks
  • The Post-study questionnaire is a survey given after the tasks
  • Aside from their placement within the study, the two questionnaires work the same
Step 1
If needed, customize the message shown before the survey (e.g. if you have special instructions for answering the questions). The default message should be sufficient in most cases.
Step 2
Write your question. You can provide additional information in the description if it's neccessary.
Step 3
Select the type of answer. The answer can be either full text (single or multi-line), multiple option (checkbox, radio button, dropdown) or scoring (5-point and 7-point Likert scale, Net Promoter Score).
Step 4
Select Answer required if you want the question to be mandatory. Otherwise, respondents will be able to skip the question.
Step 5
Click Add question to add more questions and repeat steps 2-5 again for each one.

Above the questions, there is an option to import and export questions inside a .CSV file. Use this option to easily reuse questionnaires between studies or to bring in questionnaires created outside the study setup environment.

Use UTF-8 encoded CSV files to ensure that the import works correctly. The simplest way to save your imported file with UTF-8 encoding is to edit it through Google Sheets (click the link for more instructions). To get a UTF-8 encoded file when saving your file in Excel, go to File -> Save As and select CSV UTF-8 before you click Save.

Create multiple option questions 

  • After you pick any of the multiple option answer types (dropdown select, radio button, checkbox select), you can define more options by pressing + Add answer option
  • With dropdown select and radio button, respondents can only pick one option. With checkbox select, they can pick multiple options at once.
  • Options have to be between 1 and 250 characters long
  • Choose Options random order to randomize the order in which these options are displayed for each respondent
  • Press the Trash bin button to remove options
  • If you enable Require to justify answer, respondents will be asked for a text explanation of the selection they made.

Likert scale questions 

  • In Likert scale questions, respondents are given a statement and are asked to give a score that says how much they agree. For example: "Please select how much you agree with the following statement: The information on example.com is organized in an intuitive way."
  • The higher the score, the more the respondent agrees with the statement. Highest score means total agreement, lowest score means total disagreement.
  • There is a 5-point and 7-point Likert scale. The 5-point scale is slightly easier to interpret, while the 7-point scale is slightly more accurate and gives respondents more choices to express themselves.
  • You can adjust the labels of the lowest and highest scores to describe the meaning of the scale.
  • If you enable Require to justify answer, respondents will be asked for an explanation of the score they gave.

Net Promoter Score 

  • Net Promoter Score questions are used to measure user experience so it's simple and easy to understand. Net Promoter Score questions look like this: "How likely are you to recommend example.com to your friends or colleagues?"
  • The respondent answers on a scale from 0 to 10. The higher the score, the more likely the respondents is to recommend the object at question. Respondents are split into:
    • Promoters - Score 9-10 - Users who are happy with using your website/service/etc. and spread the word to others.
    • Passives - Score 7-8 - Users who are content but have their reserves. Fix what ails them to decrease the chance of their defecting to competition.
    • Detractors - Score 6 and lower - Unhappy users who may spread negative word of mouth. Pay close attention to what they have to say.
  • The final Net Promoter Score you'll get as a result is a number between -100 (if all respondents are detractors) and 100 (if all respondents are promoters).
  • You can adjust the labels of the lowest and highest scores to change meaning of the scale.

Adjust the order of your questions 

  • Unless the order of questions is randomized, the questions will be displayed in the same order as they're seen in study setup.
  • You can change the order of questions by simple drag and drop. Just grab a question with your cursor and pull it up or down to move it higher or lower on the list.
  • Alternatively, under the ellipsis button, you can move quesions up and down by press of a button Move up / Move down.