{"id":63438,"date":"2021-05-04T15:57:44","date_gmt":"2021-05-04T13:57:44","guid":{"rendered":"https:\/\/visionarymarketing.com\/?post_type=glossary&#038;p=63438"},"modified":"2023-05-26T07:58:14","modified_gmt":"2023-05-26T05:58:14","slug":"survey-biases","status":"publish","type":"glossary","link":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/","title":{"rendered":"Survey biases"},"content":{"rendered":"<p><em><span style=\"color: #333399;\">Let\u2019s look in detail at survey biases in <a href=\"https:\/\/visionarymarketing.com\/en\/glossary\/market-studies-in-b2b\/\">market research<\/a>. <\/span><\/em><em><span style=\"color: #333399;\">Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.<\/span><\/em><em><span style=\"color: #333399;\"> While B2C research is straightforward when addressing people on known topics, B2B research is more complex. The real difficulty is to measure perceptions on terms that are not always well understood.\u00a0<\/span><\/em><\/p>\n<h1>Survey Biases in Market Research<\/h1>\n<figure id=\"attachment_55475\" aria-describedby=\"caption-attachment-55475\" style=\"width: 750px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"wp-image-55475 size-full\" src=\"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2020\/05\/49812866157_a8326ec1d8_k-e1606479699274.jpg\" alt=\"B2B market research: questioning biases\" width=\"750\" height=\"499\" \/><figcaption id=\"caption-attachment-55475\" class=\"wp-caption-text\">B2B market research: questioning biases<\/figcaption><\/figure>\n<p>Since online surveys (or CAWI for Computer-Aided Web Interviewing) have democratised access to marketing research, almost anyone can go into the field and design their own survey. <!--more--><\/p>\n<p>When designing a survey, however, it is important to avoid a number of errors known as \u2018survey bias\u2019, which have existed since long before the Internet.<\/p>\n<h2>Main Survey Biases<\/h2>\n<p>One of the <strong>main<\/strong> survey biases, if not the main one, is to ask profile questions (age, gender, location\u2026) at the beginning of the survey when they are really meant to be asked at the end. These questions can in fact dissuade respondents from answering as they can be considered to be too intrusive when posed at the beginning of the survey. The <strong>second<\/strong> bias is to administer a survey without having first run it through a small group of respondents.<\/p>\n<p>It is then necessary to avoid double-barreled questions, that is, questions in which two questions are asked. For example, \u2018Do you think Martinique is a nice and cheap destination?\u2019 A person may think that Martinique is a nice destination but not cheap, or vice versa\u2026<\/p>\n<p>&nbsp;<\/p>\n<h4><strong><em>Another Bias<\/em><\/strong><\/h4>\n<p><strong>Another bias <\/strong>is often found in questions that already include the answer or at least the opinion of the person who wrote the question (or someone else): \u2018Would you buy this fridge despite its design flaws?\u2019 Hard to answer objectively\u2026<\/p>\n<p>One should also be careful of <strong>halo<\/strong> effects: \u2018Do you also think, like the President of the Republic, that taxes are too low?\u2019 Referring to a known person undermines the neutrality of the question.<\/p>\n<p>Designers of surveys should avoid the use of <strong>jargon<\/strong>: \u2018Would you use this DBMS in your professional life?&#8221; Terms that are too generic are recommended to be banned. For example \u2018Would you use dematerialisation to process this task?\u2019 It is necessary to specify what is meant by dematerialisation: software, a specific procedure\u2026<\/p>\n<p>When using a list of responses, the list should be as exhaustive as possible or include an \u2018other: please specify\u2019 or an \u2018I don\u2019t know\u2019 choice. Example:<\/p>\n<p><em>What is your favourite dessert?<\/em><\/p>\n<ul>\n<li><em>Strawberry Trifle<\/em><\/li>\n<li><i>Apple pie\u00a0<\/i><\/li>\n<li><em>Chocolate \u00e9clair<\/em><\/li>\n<\/ul>\n<p>The person who prefers Paris-Brest will be frustrated not to see their favourite dessert mentioned and not to be able to choose the answer \u2018Others\u2019.<\/p>\n<p>When talking about distances or times, it is important to be as precise as possible in quantifying them. <em>Example: Less than 5\u00a0km \/ Between 5\u00a0km and 10\u00a0km \/ Between 10\u00a0km and 50\u00a0km \/ More than 50\u00a0km<\/em>.<\/p>\n<p><em>Instead of: A short distance \/ A medium distance \/ A long distance \/ A very long distance<\/em>.<\/p>\n<h4><em><strong>Tips<\/strong><\/em><\/h4>\n<p>Also, be careful not to put too many<strong> open-ended questions<\/strong> in a survey.<\/p>\n<p>Closed questions are favoured due to being the easiest to process and quantify.<\/p>\n<p>Open questions, on the other hand, require a more qualitative treatment. Although they are indeed necessary, they are not as frequent.<\/p>\n<p>In addition, it is important to assume that some respondents might not know how to answer a question. Therefore, it is essential to create an \u2018I don\u2019t know\u2019 or \u2018Prefer not to answer\u2019 option for those people. Otherwise, you may end up with multiple responses chosen by default.<\/p>\n<p>Double negatives should be avoided as they mislead the respondent. Example: Do you think that cars and aeroplanes would not be safe as means of transport?<\/p>\n<h3>Limitations of Studies Due to Survey Bias<\/h3>\n<p>Online surveys allow for a big group of people to be surveyed on a given topic at a low cost. However, as with all self-administered surveys, there are some downsides which must be taken into account:<\/p>\n<ul>\n<li>Interviewees may misunderstand some questions<\/li>\n<li>Responses to open-ended questions may be poorly expressed. This may pose processing problems later.<\/li>\n<li>The same person may respond multiple times if unsupervised.<\/li>\n<li>If the pollster has to rent a panel to reach its target, respondents may not be motivated by the questionnaire. If there is payment for their response, respond too quickly.<\/li>\n<li>Some categories of people or age groups are difficult to reach via the Internet.<\/li>\n<\/ul>\n<h3>Trends and Innovations<\/h3>\n<p>To make a questionnaire <strong>attractive<\/strong>, in addition to the biases described in this definition, one should avoid creating a questionnaire that is too long.<\/p>\n<p>How many questions should you offer to your future respondents? It\u2019s hard to answer precisely, but if a respondent spends more than five minutes on your questionnaire, that\u2019s already very good!<\/p>\n<p>If you really need to ask a lot of questions, it is better to split the survey in two and organises two separate campaigns.<\/p>\n<p>Of course, the more relevant your survey is to your target group (i.e. the more the respondents feel concerned by the questions asked), the more valuable answers you will collect.<\/p>\n<p>Finally, be completely transparent with your respondents about the objectives of your questionnaire. For example, you should tell them very explicitly that you are carrying out a market study on estate agents. That you are interviewing them as experts in the sector. Reassure that their answers will remain confidential. Send them a summary of the study once you have written your report. Your transparency will reassure and motivate them. You will create a real relationship of trust with them.<\/p>\n<h3>Tools and Methods<\/h3>\n<p>Surveys can be semi-structured or structured. They can be administered either face-to-face, by telephone, by post or online (CAWI: Computer Aided Web Interviewing).<\/p>\n<p>Directional questionnaires usually consist of about 20 questions on a specific topic. The questions are either closed or open-ended, ranging from the most general to the most specific.<\/p>\n<blockquote class=\"quote-light\">\n<h3>Links and resources on survey bias<\/h3>\n<ul>\n<li><a href=\"https:\/\/blog.yoope.en\/minimize-response-bias-in-your-questionnaires-and-surveys\/\"><span data-contrast=\"none\">Minimize response bias in your questionnaires and surveys<\/span><\/a><\/li>\n<li><a href=\"https:\/\/delighted.com\/blog\/avoid-7-types-sampling-response-survey-bias#:~:text=In%20our%20context%20of%20customer,only%20be%20getting%20one%20type\"><span data-contrast=\"none\">Avoiding the 7 types of sampling and response bias to avoid in customer survey<\/span><\/a><\/li>\n<li><\/li>\n<\/ul>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>Questioning biases in B2B market research are more complex than in B2C. We have found 22 of them<\/p>\n","protected":false},"author":106,"featured_media":68656,"parent":0,"template":"","glossary-cat":[],"class_list":["post-63438","glossary","type-glossary","status-publish","has-post-thumbnail","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Survey biases Definition byMarketing and Innovation<\/title>\n<meta name=\"description\" content=\"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Survey biases Definition byMarketing and Innovation\" \/>\n<meta property=\"og:description\" content=\"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/\" \/>\n<meta property=\"og:site_name\" content=\"Marketing and Innovation\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vismktg\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-26T05:58:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2022\/05\/49812866157-a8326ec1d8-k-e1651750594828.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"699\" \/>\n\t<meta property=\"og:image:height\" content=\"498\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@ygourven\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/\",\"url\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/\",\"name\":\"Survey biases Definition byMarketing and Innovation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/visionarymarketing.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/49812866157-a8326ec1d8-k-e1651750594828.jpeg\",\"datePublished\":\"2021-05-04T13:57:44+00:00\",\"dateModified\":\"2023-05-26T05:58:14+00:00\",\"description\":\"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/#primaryimage\",\"url\":\"https:\\\/\\\/visionarymarketing.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/49812866157-a8326ec1d8-k-e1651750594828.jpeg\",\"contentUrl\":\"https:\\\/\\\/visionarymarketing.com\\\/wp-content\\\/uploads\\\/2022\\\/05\\\/49812866157-a8326ec1d8-k-e1651750594828.jpeg\",\"width\":699,\"height\":498},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/survey-biases\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Glossary Terms\",\"item\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/glossary\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Survey biases\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/\",\"name\":\"Marketing and Innovation\",\"description\":\"Independent News Website, Since 1996\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/visionarymarketing.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Survey biases Definition byMarketing and Innovation","description":"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/","og_locale":"en_US","og_type":"article","og_title":"Survey biases Definition byMarketing and Innovation","og_description":"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.","og_url":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/","og_site_name":"Marketing and Innovation","article_publisher":"https:\/\/www.facebook.com\/vismktg","article_modified_time":"2023-05-26T05:58:14+00:00","og_image":[{"width":699,"height":498,"url":"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2022\/05\/49812866157-a8326ec1d8-k-e1651750594828.jpeg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_site":"@ygourven","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/","url":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/","name":"Survey biases Definition byMarketing and Innovation","isPartOf":{"@id":"https:\/\/visionarymarketing.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/#primaryimage"},"image":{"@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/#primaryimage"},"thumbnailUrl":"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2022\/05\/49812866157-a8326ec1d8-k-e1651750594828.jpeg","datePublished":"2021-05-04T13:57:44+00:00","dateModified":"2023-05-26T05:58:14+00:00","description":"Survey biases are systematic errors introduced into sampling or testing by selecting or encouraging one outcome or answer over others.","breadcrumb":{"@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/#primaryimage","url":"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2022\/05\/49812866157-a8326ec1d8-k-e1651750594828.jpeg","contentUrl":"https:\/\/visionarymarketing.com\/wp-content\/uploads\/2022\/05\/49812866157-a8326ec1d8-k-e1651750594828.jpeg","width":699,"height":498},{"@type":"BreadcrumbList","@id":"https:\/\/visionarymarketing.com\/en\/glossary\/survey-biases\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/visionarymarketing.com\/en\/"},{"@type":"ListItem","position":2,"name":"Glossary Terms","item":"https:\/\/visionarymarketing.com\/en\/glossary\/"},{"@type":"ListItem","position":3,"name":"Survey biases"}]},{"@type":"WebSite","@id":"https:\/\/visionarymarketing.com\/en\/#website","url":"https:\/\/visionarymarketing.com\/en\/","name":"Marketing and Innovation","description":"Independent News Website, Since 1996","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/visionarymarketing.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"related_terms":"survey biases,","external_url":"","internal_reference_id":"","_links":{"self":[{"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/glossary\/63438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/types\/glossary"}],"author":[{"embeddable":true,"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/users\/106"}],"version-history":[{"count":0,"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/glossary\/63438\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/media\/68656"}],"wp:attachment":[{"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/media?parent=63438"}],"wp:term":[{"taxonomy":"glossary-cat","embeddable":true,"href":"https:\/\/visionarymarketing.com\/en\/wp-json\/wp\/v2\/glossary-cat?post=63438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}