How do I interpret the Crowd Feedback in Website Testing?

In this help, we'll discuss how to use the Crowd Feedback analysis to:

  • Read Crowd Feedback results
  • Discover popular ideas from the Crowd Cloud
  • Delve into ideas in Crowd details
  • Manage ideas

Read Crowd Feedback results 

  • If you collected crowd feedback after individual tasks, use the task selection dropdown list in the top section of the screen to switch to the task you want to analyze.
  • Alternatively, use the arrow buttons to the left and right of the dropdown list to move to the previous/next task.
  • If you collected crowd feedback at the end of the study, there are single Crowd Feedback results for the whole study.

Ideas in Crowd Feedback belong into one of three categories. Each category has its own distinct color:

  • Like - What the respondents liked
  • Dislike - What the respondents disliked
  • Improvement - What suggestions the respondents had for improvement

The Crowd Cloud is a handy diagram of Crowd Feedback results, which portrays which ideas were the most popular. Looking at the cloud is a quick way to learn about audience opinions and popular suggestions.

The ideas that were the most prevalent among the crowd are the largest and found in the center of the cloud. The ideas that were voted for by less respondents are smaller and on the edge of the cloud.

Analyze ideas in Crowd details 

In Crowd details, you will find all ideas as generated by Crowd Feedback in full detail. If you collected feedback after individual tasks, you will find an idea list for each task.

  • Ideas are ordered by the number of people who voted for them.
  • Each idea contains the text of the idea itself, its author and number of votes.
  • For each idea, you will see and any comments that voters may have left behind. If you used the 5-point or 7-point Likert scale for voting, you will also see the score that the author of a comment gave to the idea.
  • Click an idea's number of votes to see the full list of respondents who voted for it
  • Click the checkboxes on the left of the idea list to filter ideas by their category - Likes, Dislikes and Improvements

Manage ideas 

You can do modifications to ideas submitted by respondents by clicking Manage ideas on top of Crowd details.

In order to keep the spirit of user-submitted ideas and preserve their original meaning, we recommend keeping any changes to a minimum (e.g. removing troll ideas, fixing grammar). All changes that you make will be reflected to how these ideas are presented to other respondents.

In Manage ideas, use the dropdown to filter ideas by their category - Likes, Dislikes and Improvements

To change the text of an idea (e.g. to fix typos), click the pencil icon next to the idea.

To remove an idea (e.g. to stop a troll idea from being seen by other respondents), click the trash bin icon next to the idea.