{"id":5910,"date":"2012-10-25T14:11:11","date_gmt":"2012-10-25T14:11:11","guid":{"rendered":"https:\/\/www.snapsurveys.com\/support-snap11\/?page_id=5910"},"modified":"2022-07-04T13:30:37","modified_gmt":"2022-07-04T12:30:37","slug":"randomizing-order-question-pages","status":"publish","type":"page","link":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/","title":{"rendered":"Randomizing the order of question pages"},"content":{"rendered":"<p>When you present a respondent with a survey, their answers are influenced by the order in which questions are presented. This is known as an order-effect. Because of this, you may wish to randomize the order of the questions, so that this effect is as small as possible.<\/p>\n<p>In Snap you can randomize the order of possible responses in a multi-choice question, rows in a grid question, or question pages. This worksheet explains how to randomize the order in which question pages are presented to the respondent using the <strong>Randomize<\/strong> (or <strong>Randomise<\/strong>) tool. For simplicity, it will be referred to as <strong>Randomize <\/strong>throughout this worksheet. Screenshots may show <strong>Randomise<\/strong>.<\/p>\n<p><a name=\"o26636\"><\/a><\/p>\n<h3>Background<\/h3>\n<p>In a list of options, people are more likely to choose the first option (primacy effect) or the last option (recency effect) rather than the middle options.<\/p>\n<p>In a list of questions, people will be more tired when they answer the later questions, and tend to put less effort into answering them. If you have blocks of similar questions, respondents will sometimes just answer all the blocks in the same way that they answered the first block.<\/p>\n<p>In a multi-choice question, you can randomize the order in which the possible answers appear (this is not a good idea if you are asking people to select an answer on a scale from Very poor to Very good, but can be helpful if you are asking people to select their favourite item). This is described in the topic <a href=\"https:\/\/www.snapsurveys.com\/help\/#22427\" target=\"_blank\" rel=\"noopener\">Setting code rotation on a question<\/a>.<\/p>\n<p>You can randomize the order of grid questions within Snap. This is described in the topic <a href=\"https:\/\/www.snapsurveys.com\/help\/#22392\" target=\"_blank\" rel=\"noopener\">Question rotation<\/a>. You cannot randomize the order of codes within a grid question.<\/p>\n<p>You can also randomize the order of pages of questions (so that the questions on the pages stay in the same order) by using the <strong>Randomize <\/strong>tool. (It is known as <strong>Randomise <\/strong>in the UK and Europe.)<\/p>\n<p>If your survey uses routing or text substitution, you cannot simply randomize pages, as the questions with routing and text substitution need to know the answers to previous questions. When randomizing pages in these surveys, you must take care to keep the order of these questions, otherwise the routing and text substitution will not work correctly.<\/p>\n<p><a name=\"o26637\"><\/a><\/p>\n<h3>Summary of steps<\/h3>\n<p>This worksheet assumes that you are creating a Snap WebHost survey. The steps will be the same if you are conducting an interview using one of the Offline outputs, such as kiosk, tablet, or PDA. If you have published a Web:HTML survey, the steps are different. You can find out more about Web:HTML surveys in the section <a href=\"https:\/\/www.snapsurveys.com\/help\/#26663\" target=\"_blank\" rel=\"noopener\">Applying Randomize to a Web:HTML survey<\/a>.<\/p>\n<p>If you are applying <strong>Randomize<\/strong> to a questionnaire with routing or text substitution, you will receive a message. Click <strong>[OK]<\/strong> to carry on.<\/p>\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12462\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/rand_rout_mess.png\" alt=\"TK: randomize sample vista warning mess\" width=\"392\" height=\"170\"><\/p>\n<\/div>\n<div>\n<p><a name=\"o26639\"><\/a><\/p>\n<h3>Step 1: Creating your survey<\/h3>\n<p>This worksheet assumes that you have created a survey that asks peoples views&#8217; on supermarkets. There are six supermarkets in the survey, and each has its own identical set of questions on a single page. After the questions on the supermarkets are a few demographic questions (You can get a trivial example of this type of survey if you click and download it to your computer from <a href=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/snRandomise.mdf\">here<\/a>). This worksheet describes how to randomly order the supermarket pages, while keeping the introduction page at the beginning and the demographic questions at the end.<\/p>\n<ol>\n<li>Create your survey, considering what order to have the questions in.<\/li>\n<li>Break it up into pages containing sets of questions that need to be presented in a specific order.<\/li>\n<li>Add any randomizing to question codes (using the variable properties <strong>Ordering <\/strong>option) or question grids.<\/li>\n<li>Publish your survey. Take note of the place where it is stored (the <strong>Path<\/strong>) and the <strong>Access Name <\/strong>(the name of the published file) as you will need to browse for it later.\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12459\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/output_webhost.png\" alt=\"QP: output for webhost\" width=\"413\" height=\"303\"><\/p>\n<\/div>\n<\/li>\n<\/ol>\n<\/div>\n<div>\n<p><a name=\"o26642\"><\/a><\/p>\n<h3>Step 2: Randomizing your question pages<\/h3>\n<ol>\n<li>Open the <strong>Randomize<\/strong> program. You would normally do this by Selecting <strong>[Start]<\/strong> on the Microsoft toolbar, then type <strong>Randomize<\/strong> (this will be <strong>Randomise<\/strong> if you are in the UK) in the \u2018Search programs and files\u2019 box.\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-21528\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/Windows-search.gif\" alt=\"Windows Search\" width=\"410\" height=\"244\" srcset=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/Windows-search.gif 410w, https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/Windows-search-150x89.gif 150w\" sizes=\"auto, (max-width: 410px) 100vw, 410px\" \/><\/p>\n<\/div>\n<\/li>\n<li>An empty <strong>Randomize <\/strong>window opens. Click the <strong>[Browse]&nbsp;<\/strong>button and search for the published survey. If you are using the sample survey provided, you will be given a warning about text substitution. Click [OK] to carry on. The text substitution is on the fixed first page so it will not be affected by randomization of subsequent pages.\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12463\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/rand_surv_hl.png\" alt=\"TK: Randomise showing browse button and selected file\" width=\"381\" height=\"289\"><\/p>\n<\/div>\n<\/li>\n<li>Click<strong> [Add]<\/strong> to define a group of pages to randomise. The <strong>Add Group&nbsp;<\/strong>window opens.In this worksheet, the first and last pages of the 8-page survey must stay in place, and the middle six pages will be presented in random order.<\/li>\n<li>Set the first page in the group to <strong>2<\/strong>, and the last page to<strong> 7<\/strong>. This leaves page 1 and page 8 in their correct places.\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12461\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/rand_gp_sel.png\" alt=\"TK: Randomise showing browse button and selected file\" width=\"318\" height=\"169\"><\/p>\n<\/div>\n<p>(This worksheet is using a Snap WebHost example. If you are publishing to HTML, these instructions will not work. In Web:HTML surveys a list of pages in the survey will appear in the <strong>Group List<\/strong> pane after the survey has been selected.)<\/li>\n<li>Set the rotation format to <strong>Random<\/strong>. This means that the six pages are displayed in random order.&nbsp;<strong>Forward <\/strong>displays the pages in the order in the questionnaire, but choosing the first page at random, and looping round when you get to the last page until all pages are shown.&nbsp;<strong>Reverse <\/strong>displays the pages in the reverse order from that in the questionnaire, starting at a random page.&nbsp;<strong>Inverse <\/strong>randomly starts at either the first page going forward or the last page going backward (for Kiosk, PDA and tablet surveys, they will display alternately in forward and reverse order).<\/li>\n<li>Click<strong> [OK] <\/strong>to save your new group. It will appear in the <strong>Randomize <\/strong>pane.\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-12460\" src=\"https:\/\/www.snapsurveys.com\/support-snap11\/wp-content\/uploads\/2012\/10\/rand_gp_def.png\" alt=\"TK: Randomise showing browse button and selected file\" width=\"381\" height=\"289\"><\/p>\n<\/div>\n<\/li>\n<li>Click <strong>[Process] <\/strong>to make those pages appear in random order in the survey.&nbsp;<em>If you change the survey within Snap and republish you will need to apply the <strong>Randomize <\/strong>settings again.<\/em><\/li>\n<\/ol>\n<\/div>\n<p><a name=\"o26638\"><\/a><\/p>\n<h3>Conclusion<\/h3>\n<p>This worksheet has shown you how to randomize the order that pages are presented to the viewer for a simple Snap WebHost survey. This information also applies to offline surveys. For information about rotating pages in Web:HTML surveys see the section: <a href=\"https:\/\/www.snapsurveys.com\/help\/#26663\" target=\"_blank\" rel=\"noopener\">Applying Randomise to a Web:HTML survey<\/a>.<\/p>\n<p>The behaviour for some options in the <strong>Randomize <\/strong>tool varies according to the output that you are building. For example, in a web:HTML or Snap WebHost survey, respondents may complete surveys at the same time and it is impossible to give alternate respondents the questions in forward and reverse order. However, if respondents are completing surveys on a kiosk or a PDA, you do know the order of the respondents, and you can alternate the order for each respondent.<\/p>\n<p>You can find out more about rotating question codes in the topic <a href=\"https:\/\/www.snapsurveys.com\/help\/#22427\" target=\"_blank\" rel=\"noopener\">Setting code rotation on a question<\/a>.<\/p>\n<p>Randomizing the order of grid questions within Snap is described in the topic: <a href=\"https:\/\/www.snapsurveys.com\/help\/#22392\" target=\"_blank\" rel=\"noopener\">Question rotation<\/a>.<\/p>\n<p>If you would like to find out more about the effects of question order in surveys, there is much research available, for example, Bishop and Smith&#8217;s 1997 paper: <a title=\"\" href=\"https:\/\/www.amstat.org\/sections\/srms\/proceedings\/papers\/1997_179.pdf\" target=\"_blank\" rel=\"noopener\">Response order effects in public opinion surveys; The plausibility of rival hypotheses<\/a>.<\/p>\n<p>There is help available for the Randomize tool if you click the<strong> [Help]<\/strong> button on the tool windows.<\/p>\n<p>If there is a topic you would like a worksheet on, email to <a title=\"\" href=\"mailto:snapideas@snapsurveys.com\" target=\"_self\" rel=\"noopener\">snapideas@snapsurveys.com<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p><a class=\"ninja_pages_read_more\"  href=\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/\"><\/a><\/p>\n","protected":false},"author":10,"featured_media":0,"parent":43,"menu_order":6,"comment_status":"open","ping_status":"closed","template":"page-templates\/child-page.php","meta":{"_acf_changed":false,"footnotes":""},"class_list":{"0":"post-5910","1":"page","2":"type-page","3":"status-publish","5":"search_category-support-hub"},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Randomizing the order of question pages - Snap Surveys<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Randomizing the order of question pages - Snap Surveys\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/\" \/>\n<meta property=\"og:site_name\" content=\"Snap Surveys\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SnapSurveys\" \/>\n<meta property=\"article:modified_time\" content=\"2022-07-04T12:30:37+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@snapsurveys\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/\",\"url\":\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/\",\"name\":\"Randomizing the order of question pages - Snap Surveys\",\"isPartOf\":{\"@id\":\"https:\/\/www.snapsurveys.com\/support-snap11\/#website\"},\"datePublished\":\"2012-10-25T14:11:11+00:00\",\"dateModified\":\"2022-07-04T12:30:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.snapsurveys.com\/support-snap11\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Worksheets\",\"item\":\"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Randomizing the order of question pages\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.snapsurveys.com\/support-snap11\/#website\",\"url\":\"https:\/\/www.snapsurveys.com\/support-snap11\/\",\"name\":\"Snap Surveys\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.snapsurveys.com\/support-snap11\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Randomizing the order of question pages - Snap Surveys","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_GB","og_type":"article","og_title":"Randomizing the order of question pages - Snap Surveys","og_url":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/","og_site_name":"Snap Surveys","article_publisher":"https:\/\/www.facebook.com\/SnapSurveys","article_modified_time":"2022-07-04T12:30:37+00:00","twitter_card":"summary_large_image","twitter_site":"@snapsurveys","twitter_misc":{"Estimated reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/","url":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/","name":"Randomizing the order of question pages - Snap Surveys","isPartOf":{"@id":"https:\/\/www.snapsurveys.com\/support-snap11\/#website"},"datePublished":"2012-10-25T14:11:11+00:00","dateModified":"2022-07-04T12:30:37+00:00","breadcrumb":{"@id":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/randomizing-order-question-pages\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.snapsurveys.com\/support-snap11\/"},{"@type":"ListItem","position":2,"name":"Worksheets","item":"https:\/\/www.snapsurveys.com\/support-snap11\/worksheets\/"},{"@type":"ListItem","position":3,"name":"Randomizing the order of question pages"}]},{"@type":"WebSite","@id":"https:\/\/www.snapsurveys.com\/support-snap11\/#website","url":"https:\/\/www.snapsurveys.com\/support-snap11\/","name":"Snap Surveys","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.snapsurveys.com\/support-snap11\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"}]}},"_links":{"self":[{"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/pages\/5910","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/comments?post=5910"}],"version-history":[{"count":10,"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/pages\/5910\/revisions"}],"predecessor-version":[{"id":31504,"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/pages\/5910\/revisions\/31504"}],"up":[{"embeddable":true,"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/pages\/43"}],"wp:attachment":[{"href":"https:\/\/www.snapsurveys.com\/support-snap11\/wp-json\/wp\/v2\/media?parent=5910"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}