Creating surveys that respondents enjoy is more than just a “nice-to-have,” there is a genuine business case for committing to quality survey design and respondent experience. Poorly designed surveys have shown to increase respondent dropoff rate as well as produce weaker insights due to rushed unattentive answering from participants. Respondents want to be heard, it has been proven that they enjoy giving their feedback, but in order to get the most out of your respondents you need to ensure that you’re avoiding these 5 pitfalls of survey design and user experience.
Problem: Using email to reach your respondents is the equivalent of bringing a knife to a gunfight in terms of preparation. As a researcher, you are putting all of your eggs in one basket by using email in isolation to reach a given population. This becomes even more severe when you are speaking to 13-30 year olds who have surpassed the capabilities of traditional email in favour of the smartphone.
Solution: The medium in which we reach, engage and invite people to participate in online research has to change. That is not to say email is still a powerful tool for older generations, it just means as researchers we need to have multiple tools at our disposal to maximise engagement. It is not just our role to design the survey, it is our role to find and excite new people to participate in research. For example, at Bounce we leverage push notifications to increase engagement of our panellists. As a result we boast an incredible 86% engagement rate throughout our entire user base.
Problem: Perhaps the most frustrating and damaging experience for respondents is the repetitive and monotonous answering of the same set of questions every time you are invited to complete a survey. As quality starts to dip after spending anytime longer than 4-7 minutes in a given survey, spending this time answering screening questions not relevant to the data being collected is a cardinal sin of research that simply must change.
Solution: For a first-time participant, it is fundamental that you gather the traditional profiling data so that the respondent is receiving surveys where their opinion is valued. However, this profiling data should be built on with each survey they fill out, not repeated upon every survey to leave them frustrated and bored. This can be achieved by pre-targeting what panelists fit the screening criteria for each survey, and only inviting those who fit the criteria to participate. This means their valuable time is spent answering the questions that matter most, rather than reaffirming their gender, age and profession.
Problem: Online surveys are in desperate need of a re-birth. The penny has dropped with industry leaders. No person is willing to spend longer than 10 Minutes in a survey, which means that quality will dip into anything longer than 7 Minutes in our experience. However, it is not just length, it is the over-complication of questions, the poor design and the disconnection from where these results are actually going in a mundane experience for all.
Solution: Without impacting the value of the research, there are a few simple adjustments you can make to improve the respondent experience. There needs to be a drive for clarity on questions, with simplicity at the forefront of the researcher’s mind. After that, add a progress bar, be honest about the length of the survey, and think about how you can make the questions more conversational. Finally, in order to show respondent’s that you care about their opinion, try and close the ‘feedback loop’ by thanking people for their response, warning those who give a bad response, deliver public insight reports from time to time or present the results on social media to show they are being heard.
The Problem: There is a fundamental flaw in how researchers incentivise their respondent pool. It is the idea that if we make it as difficult as possible to receive a reward, or redeem an incentive earned by doing surveys, that they will save money and therefore ‘win’. In reality, by offering unachievable gift cards of €20, small discount codes or an entry into competitions, what you are actually doing is disincentivizing consumers from ever participating in your survey again. Suddenly, the ‘goal’ of the incentive to engage has delivered the complete alternative.
The Solution: The simple ideology that if you invest in your panel, you will earn it back in multiples we have proven with Bounce Insights. We focused on instant gratification, rewards tailored to what respondents told us they wanted, and an ability to purchase and redeem rewards on their phone in a frictionless way. This resulted in a panel with a survey completion rate of 67%, meaning we have saved fortunes on panel management thanks to this philosophy of prioritising the people answering the surveys.
The Problem: “One way to solve a mystery is by asking the right questions until answers start to emerge.” – Brian Stelter. Asking the right questions is probably the most important aspect of consumer research. Too often, researchers commit to a set of unanswered questions and rigorously seek out answers by any means necessary. The trouble here, is that as humans, we often inherently bias our own interpretations of questions especially those in which we have pre-existing knowledge.
The Solution: The key to asking good quality questions is by putting yourself in the shoes of a 7 year old. How simplified, jargon less and comprehensible would your question be if asked to a 7 year old child? Bring this level of empathy to your question design and you will instantly benefit from clearer respondent understanding as well as more thoughtful insights from participants involved.
The ‘research first, respondent second’ attitude has delivered a catastrophic collapse in online survey engagement and reach. It’s time for a fresh approach to research, combining trusted research methodologies with a new understanding and appreciation of the 21st century consumer. By merging the old with the new, we can begin to empower an industry currently settling for mediocrity.
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-advertisement | 1 year | Records user consent for cookies in the advertisement category |
cookielawinfo-checkbox-analytics | 11 months | Records user consent for cookies in the analytics category |
cookielawinfo-checkbox-functional | 11 months | Records user consent for cookies in the functional category |
cookielawinfo-checkbox-necessary | 11 months | Records user consent for cookies in the necessary category |
cookielawinfo-checkbox-others | 11 months | Records user consent for cookies in the other/unclassified category |
cookielawinfo-checkbox-performance | 11 months | Records user consent for cookies in the performance category |
CookieLawInfoConsent | 1 year | Records the default button state of the corresponding category & the status of CCPA. It works only in coordination with the primary cookie. |
elementor | never | This cookie is used by the website's WordPress theme. It allows the website owner to implement or change the website's content in real-time. |
viewed_cookie_policy | 11 months | The cookie is set by the CookieYes plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |
_GRECAPTCHA | 5 months 27 days | Provides spam protection and distinguishes between humans and bots. |
__hssrc | session | This cookie is set by Hubspot whenever it changes the session cookie. The __hssrc cookie set to 1 indicates that the user has restarted the browser, and if the cookie does not exist, it is assumed to be a new session. |
Cookie | Duration | Description |
---|---|---|
bcookie | 2 years | LinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser ID. |
lang | session | This cookie is used to store the language preferences of a user to serve up content in that stored language the next time user visit the website. |
lidc | 1 day | LinkedIn sets the lidc cookie to facilitate data center selection. |
__cf_bm | 30 minutes | This cookie, set by Cloudflare, is used to support Cloudflare Bot Management. |
__hssc | 30 minutes | HubSpot sets this cookie to keep track of sessions and to determine if HubSpot should increment the session number and timestamps in the __hstc cookie. |
Cookie | Duration | Description |
---|---|---|
AnalyticsSyncHistory | 1 month | Used to store information about the time a sync with the lms_analytics cookie took place for users |
hubspotutk | 1 year 24 days | This cookie is used by HubSpot to keep track of the visitors to the website. This cookie is passed to Hubspot on form submission and used when deduplicating contacts. |
_ga | 2 years | Calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors. |
_gat_gtag_UA_138017392_1 | 1 minute | Google uses this cookie to distinguish users. |
_gat_UA-138017392-1 | 1 minute | A variation of the _gat cookie set by Google Analytics and Google Tag Manager to allow website owners to track visitor behaviour and measure site performance. The pattern element in the name contains the unique identity number of the account or website it relates to. |
_ga_RFDCRNP6J3 | 2 years | This cookie is installed by Google Analytics. |
_gcl_au | 3 months | Provided by Google Tag Manager to experiment advertisement efficiency of websites using their services. |
_gid | 1 day | Installed by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously. |
__gads | 1 year 24 days | The __gads cookie, set by Google, is stored under DoubleClick domain and tracks the number of times users see an advert, measures the success of the campaign and calculates its revenue. This cookie can only be read from the domain they are set on and will not track any data while browsing through other sites. |
__hstc | 1 year 24 days | This is the main cookie set by Hubspot, for tracking visitors. It contains the domain, initial timestamp (first visit), last timestamp (last visit), current timestamp (this visit), and session number (increments for each subsequent session). |
Cookie | Duration | Description |
---|---|---|
bscookie | 2 years | This cookie is a browser ID cookie set by Linked share Buttons and ad tags. |
fr | 3 months | Facebook sets this cookie to show relevant advertisements to users by tracking user behaviour across the web, on sites that have Facebook pixel or Facebook social plugin. |
GoogleAdServingTest | session | This cookie is used to determine what ads have been shown to the website visitor. |
IDE | 1 year 24 days | Google DoubleClick IDE cookies are used to store information about how the user uses the website to present them with relevant ads and according to the user profile. |
test_cookie | 15 minutes | Used to check if the user's browser supports cookies. |
UserMatchHistory | 1 month | To provide ad delivery or retargeting |
_fbp | 3 months | This cookie is set by Facebook to display advertisements when either on Facebook or on a digital platform powered by Facebook advertising, after visiting the website. |
Cookie | Duration | Description |
---|---|---|
intercom-id-gz33jl8i | 8 months 26 days 1 hour | No description |
intercom-session-gz33jl8i | 7 days | No description |
li_gc | 2 years | Used to store consent of guests regarding the use of cookies for non-essential purposes |
__gpi | 1 year 24 days | No description |