Building surveys

Randomizing order

Randomize options, statements, rows or columns to reduce order bias.

Randomization changes the order of answer options or statements. It is configured on the question; there is no general “shuffle the whole survey” control. To send respondents to different versions, use Split respondents between paths.

QuestionSetting
Multiple Choice, Checkboxes, DropdownRandomize Order is visible, but does not currently shuffle the respondent view
LikertRandomize Order for statements
RankingRandomize Initial Order
MatrixRandomize Row Order and Randomize Column Order

Choice question limitation

Multiple Choice, Checkboxes and Dropdown currently keep their configured option order, even when Randomize Order is enabled. Do not rely on this setting to balance option order for those types.

Select the question and open Content to find its setting. Preview several fresh runs to inspect the presentation. Do not rely on every run producing a visibly different order.

Keep meaningful sequences intact

Randomization is useful for unordered alternatives. Keep chronological lists and ordered scale labels in order when that order helps people answer.

Branches and pipes refer to the underlying options, so changing their displayed order does not require rewriting a condition. Still test questions that combine randomization with conditional logic.

Choose what you are trying to vary

GoalUse
Present ranking items in different initial ordersRanking's Randomize Initial Order
Change the order of Likert statementsLikert's Randomize Order
Vary Matrix presentationIts separate row and column randomization settings
Show one of several survey versionsA Split rule in Conditional Logic

These choices answer different design questions. Randomizing a ranking's initial order changes where items begin; the respondent's final order is still their answer. A Split determines which route they receive and does not shuffle all of that route's questions.

Example: workshop topics

For a Ranking question containing Research methods, Data analysis and Presenting results, enable Randomize Initial Order when no initial ordering is intended. In Preview, place a known topic first, continue, and check a later top-ranked-item pipe. It should reflect the final ranking the respondent submitted, not the position the topic started in.

Verify the settings you depend on

Run several fresh previews and inspect the relevant items, statements, rows or columns. A repeated order can occur by chance; one repeated pair of runs does not establish a failure. Conversely, a setting being visible does not prove it is applied: the choice-question limitation above matters when planning your survey.

Test alongside branching and piping, and record which kind of randomization your survey uses. For weighted assignments and the difference between Balanced and Random, see Split respondents between paths.

  1. Choose Split as the rule action.
  2. Choose the randomization mode; Balanced is shown here.
  3. Set destination weights and check their displayed percentages.
  4. Add another path or use Split evenly for equal weights.
Local documentation example.