There’s nothing more deterring in research than finding out the data you’ve gathered is inaccurate or not what you expected. High quality data not only needs to be accurate and trustworthy, but also relevant i.e. data can be reliable but still not mean anything to a business. Improving data quality increases the reliability of insights, reduces the cost of re-fielding and saves on potential time lost in an industry already plagued by slow, expensive research processes. Luckily for market researchers, when it comes to survey data, there are many simple tactics we can incorporate into the process to avoid poor data quality. Below are five tips that researchers can incorporate to improve panel/response quality.
As a researcher, it is imperative that you take every online survey that you launch. This isn’t just limited to you, have your team take them as well and even, someone not associated with the study or even market research test it as well. You’ll be amazed at what you find and what you miss when you only script the survey! This is essential for ensuring there is appropriate language used, a greater chance of ensuring objectivity and avoiding trivial mistakes in survey design. The ‘online survey playbook’ needs to be rewritten, and researchers need to be proactive in their survey testing process rather than relying on a reactive strategy where preventable mistakes accelerate the loss of time, money and quality. It’s always better to take the time to test the survey yourself than realise the mistake when it’s too late.
Use technology to assist you in your research. Programming companies have done a great job at implementing techniques to help with the data quality process. They can identify/flag speeders, avoid straight lining, stop duplicate respondents and summarize data quality questions. Become familiar with them and leverage them to their full potential. However, as technology integrates itself more and more into the day-to-day tasks of market research, it’s easy for researchers to feel they are no longer needed in certain areas — this can be fatal to data quality. While technology parameters can help filter through some of the muck, humans are still necessary in order to set the level of quality in data. Similar to many other industries embracing change, technology is there to empower industry experts, not replace them.
Know where your sample is coming from and demand transparency. Most sample providers are transparent and will answer any query, but you have to ask the question to get the answer. Here are some good questions that you can ask:
These are just a few questions you should understand about respondents to your survey. As mentioned in previous blogs, it is the responsibility of the researcher to demand the greatest level of quality possible from panel providers. More importantly, it is essential that researchers communicate to clients on the need to pay for proven quality to incentivise transparency and investment across panel suppliers.
It amazes me how researchers, who by their very nature are hardwired to capture insight on how to improve, neglect ‘taking their own advice’. The simple process of asking each respondent for feedback on survey quality, design, length and satisfaction is a sure fire way to boost engagement. Start to incorporate trial runs into your go-to-field strategy in order to obtain a survey satisfaction score that you can benchmark against past and future surveys This can be used to relay back to the client to show them how you’re improving, or to use in-house as a quality screening tool.
Don’t remove yourself from the quality assurance role. Regardless of where you are in the market research process, make sure you understand the quality steps throughout the entire process and ensure there are no gaps. With engagement, transparency and quality at an all-time low in the market research industry, the onus is on researchers to review, reflect and improve across every facet of their business. In no other industry is mediocrity settled for, legacy relationships relied on and outdated processes implemented to such a large extent. As innovators, it is our goal to demand improved quality and investment to drive the industry forward – this can be as simple as incorporating these five tips with rigorous enforcement across your market research company.
Having the right panelists is one of the most crucial aspects of online surveys, right next to the survey design itself, because the quality of your market research study depends on your source of information. You will need to do your part in learning more about panel providers to get the perfect fit. One good way to study them is by checking their ESOMAR28, which is a document that profiles panel providers through 28 questions. Read more about them so you can learn how they manage their panels and ensure the quality of their data.
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-advertisement | 1 year | Records user consent for cookies in the advertisement category |
cookielawinfo-checkbox-analytics | 11 months | Records user consent for cookies in the analytics category |
cookielawinfo-checkbox-functional | 11 months | Records user consent for cookies in the functional category |
cookielawinfo-checkbox-necessary | 11 months | Records user consent for cookies in the necessary category |
cookielawinfo-checkbox-others | 11 months | Records user consent for cookies in the other/unclassified category |
cookielawinfo-checkbox-performance | 11 months | Records user consent for cookies in the performance category |
CookieLawInfoConsent | 1 year | Records the default button state of the corresponding category & the status of CCPA. It works only in coordination with the primary cookie. |
elementor | never | This cookie is used by the website's WordPress theme. It allows the website owner to implement or change the website's content in real-time. |
viewed_cookie_policy | 11 months | The cookie is set by the CookieYes plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |
_GRECAPTCHA | 5 months 27 days | Provides spam protection and distinguishes between humans and bots. |
__hssrc | session | This cookie is set by Hubspot whenever it changes the session cookie. The __hssrc cookie set to 1 indicates that the user has restarted the browser, and if the cookie does not exist, it is assumed to be a new session. |
Cookie | Duration | Description |
---|---|---|
bcookie | 2 years | LinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser ID. |
lang | session | This cookie is used to store the language preferences of a user to serve up content in that stored language the next time user visit the website. |
lidc | 1 day | LinkedIn sets the lidc cookie to facilitate data center selection. |
__cf_bm | 30 minutes | This cookie, set by Cloudflare, is used to support Cloudflare Bot Management. |
__hssc | 30 minutes | HubSpot sets this cookie to keep track of sessions and to determine if HubSpot should increment the session number and timestamps in the __hstc cookie. |
Cookie | Duration | Description |
---|---|---|
AnalyticsSyncHistory | 1 month | Used to store information about the time a sync with the lms_analytics cookie took place for users |
hubspotutk | 1 year 24 days | This cookie is used by HubSpot to keep track of the visitors to the website. This cookie is passed to Hubspot on form submission and used when deduplicating contacts. |
_ga | 2 years | Calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors. |
_gat_gtag_UA_138017392_1 | 1 minute | Google uses this cookie to distinguish users. |
_gat_UA-138017392-1 | 1 minute | A variation of the _gat cookie set by Google Analytics and Google Tag Manager to allow website owners to track visitor behaviour and measure site performance. The pattern element in the name contains the unique identity number of the account or website it relates to. |
_ga_RFDCRNP6J3 | 2 years | This cookie is installed by Google Analytics. |
_gcl_au | 3 months | Provided by Google Tag Manager to experiment advertisement efficiency of websites using their services. |
_gid | 1 day | Installed by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously. |
__gads | 1 year 24 days | The __gads cookie, set by Google, is stored under DoubleClick domain and tracks the number of times users see an advert, measures the success of the campaign and calculates its revenue. This cookie can only be read from the domain they are set on and will not track any data while browsing through other sites. |
__hstc | 1 year 24 days | This is the main cookie set by Hubspot, for tracking visitors. It contains the domain, initial timestamp (first visit), last timestamp (last visit), current timestamp (this visit), and session number (increments for each subsequent session). |
Cookie | Duration | Description |
---|---|---|
bscookie | 2 years | This cookie is a browser ID cookie set by Linked share Buttons and ad tags. |
fr | 3 months | Facebook sets this cookie to show relevant advertisements to users by tracking user behaviour across the web, on sites that have Facebook pixel or Facebook social plugin. |
GoogleAdServingTest | session | This cookie is used to determine what ads have been shown to the website visitor. |
IDE | 1 year 24 days | Google DoubleClick IDE cookies are used to store information about how the user uses the website to present them with relevant ads and according to the user profile. |
test_cookie | 15 minutes | Used to check if the user's browser supports cookies. |
UserMatchHistory | 1 month | To provide ad delivery or retargeting |
_fbp | 3 months | This cookie is set by Facebook to display advertisements when either on Facebook or on a digital platform powered by Facebook advertising, after visiting the website. |
Cookie | Duration | Description |
---|---|---|
intercom-id-gz33jl8i | 8 months 26 days 1 hour | No description |
intercom-session-gz33jl8i | 7 days | No description |
li_gc | 2 years | Used to store consent of guests regarding the use of cookies for non-essential purposes |
__gpi | 1 year 24 days | No description |