As mentioned in our recent article, behavioural data collection and interpretation at scale will continue to transform market research around the world. The combination of authentic survey responses with passively collected data on consumer behavior allows researchers to gain a deeper understanding of the ‘what’, ‘how’ and ‘why’ behind human decision making.
However, as market researchers have been slow to adopt this new technology relative to peripheral industries, the leveraging of behavioural data collection is in its infancy. If market research is to mirror the transformation of these other industries, the next few years is set to bring about colossal change for brands and researchers alike.
Researchers often feel threatened by non-primary data sources. However, it’s important to recognise that observed behavior is designed to complement, not compete with reported data. Passive data, in its simplest form, is defined as data that we don’t ask for but use other methods to collect. Traditionally research has relied almost solely on primary data collection methods which, although insightful, don’t always get to actual consumer behaviors.
The companies at the forefront of transforming research are doing industry-disrupting work like mining large unstructured data sets, moderating large-scale focus groups via chat bots or even interpreting emotional reactions in surveys. As researchers, the objective is to figure out how to embrace technology solutions and new methods that not only provide greater results for clients, but allow you to focus on higher-value activities.
Passive data is the future of market research. As the industry continues to evolve, embracing this new method of data collection will not only improve your understanding of the customer, it will be essential to staying competitive and driving growth. The goal will be to blend as many reliable data sources as possible in a scalable way, to deliver actionable insights on consumer groups around the world. What is the device that is best suited to capturing these data sources quickly, reliably and ethically? You guessed it, it’s mobile…
The deeper problem. however, is that the industry still heavily relies on surveys. In fact, ESOMAR estimates that 80% of global research budgets are spent on surveys. Despite improvements from moving online, and the most recent shift towards mobile, the reality is that surveys have not changed in dozens of years, and they are deeply flawed as we discussed in our last article.
The next wave of market researchers will find ways to blend and combine survey and behavioural data sets to unearth deeper insights, but this still remains a tiny proportion of the industry. This leaves many researchers ignoring the key benefits listed below that are realised by blending behavioural and survey data::
Removing Bias: Real-world behavioural data is that it does not rely on human memory or the inevitable bias. Instead, this data essentially allows a market researcher to observe how, when, and what panel participants do, providing significantly richer, more complete, and more accurate data.
Greater Access to Data: As it is far easier to share passive data than answer questions, it is possible to build massively larger panels of behavioural data. Instead of being limited by studies that have thousands or tens of thousands of respondents, a market researcher can work with data from literally millions of people. This allows for greater insights, deeper cutting of the data, and more granularity.
Real-Time Insights: Behavioural data can be collected in real-time, and thanks to advances in cloud computing, can also be processed programmatically. This allows researchers to analyse data in hours, rather than the weeks, if not months it would have taken to collect, process, and analyse surveys. In a fast changing world, the speed of insights can be the difference between growth and decline, and with behavioral panels researchers can have it nearly instantly.
The market research industry is ripe for disruption, and the data available to consumer insights professionals is about to expand from purely survey driven, to data sets that combine behavioral and observed data. This is a terrific opportunity that will enable companies to generate richer, deeper, and more actionable insights than were ever possible before.
Researchers often feel threatened by non-primary data sources. However, it’s important to recognize observed behavior is designed to complement, not compete with reported data.
passive data is best (and most simply!) defined as data we don’t ask for but use other methods to collect. Traditionally research has relied almost solely on primary data collection methods which, although insightful, don’t always get to actual consumer behaviors.
The companies really at the forefront of AI in research are doing some pretty impressive industry disrupting work like mining large unstructured data sets, or moderating large-scale focus groups via chat bots or even interpreting emotional reactions in surveys. I see a lot of runway for AI to really revolutionize traditional research methods. As researchers, our job is to figure out how to embrace technology solutions and new methods that not only provide more actionable results for our clients but that also allow us to focus on high-value activities, like insights generation!
Obstacles: Whenever you’re working with disparate data sources it can be challenging to understand how to combine them in meaningful ways. This isn’t so much a data processing skill as it is a data architecture skill- something that researchers haven’t been traditionally trained to tackle.
Passive data is the future of market research. As the industry continues to evolve, embracing this new method of data collection will not only improve our understanding of the customer, it will be essential to staying competitive and driving growth.
Behavioural science offers a realistic understanding of human behaviour through an empirical process with the potential to change consumer journeys and user-experiences.
Market research is about influencing human behaviour. And behavioural science – which, by the way, is what everyone is doing – is the study of how humans behave, and why they do what they do.
The most progressive consumer insights professionals will find ways to blend and combine survey and behavioural data sets to find the growth levers that will propel their business forward
Market research professionals heavily rely on surveys. In fact, ESOMAR estimates that 80% of global research budgets are spent on surveys. While surveys have benefited from a dramatic move towards online, and now a slow crawl towards mobile, the reality is that surveys have not changed in dozens of years. Market Research data is still fundamentally about asking consumers questions and hoping they remember and provide good answers
We live in a world where almost every interaction we have can create a little digital data crumb. Not only is this true in online web browsing, but even our offline activity can be recorded thanks to the massive proliferation of smartphones and the large number of sensors packed into each of these.
The first benefit of real-world behavioural data is that it does not rely on human memory or the inevitable bias. Instead, this data essentially allows a market researcher to observe how, when, and what panel participants do, providing significantly richer, more complete, and more accurate data.
A second major benefit is that because it is much easier for panelists to install an app and share data than it is to painstakingly answer 80 questions, it is possible to build massively larger panels of behavioural data. Instead of being limited by studies that have thousands or tens of thousands of respondents, a market researcher can work with data from literally millions of people. This allows for greater insights, deeper cutting of the data, and more granularity.
Finally, behavioural data can be collected in real-time, and thanks to advances in cloud computing, can also be processed programmatically. This allows researchers to analyze data in hours, rather than the weeks, if not months it would have taken to collect, process, and analyze surveys. In a fast changing world, the speed of insights can be the difference between growth and decline, and with behavioral panels researchers can have it nearly instantly.
The future of market research has never been brighter and the data available to consumer insights professionals is about to expand from purely survey driven, to data sets that combine behavioral and observed data. This is a terrific opportunity that will enable companies to generate richer, deeper, and more actionable insights than were ever possible before
Unlike the above methods, passive metering is a technique used to collect objective information about stable facts, not sentiments. Market researchers can now see what consumers are doing on their phones, tablets, and desktops with installable tracking software. With permission from consumers, clickstream data can be passively collected about the websites visited, keywords searched, and apps used across all devices.
Passively metering consumers, in conjunction with other forms of market research, can help us capture a holistic view of who our targets are, what their opinions are, and what their behaviors are like
It not only helps us identify both the opinions and behaviors of our consumers, but gives us the opportunity to interpret why there’s discrepancy between the two
Four things: trust, security, sense of importance, and incentives.
Trust and security go hand in hand when developing a reliably responsive panel. When collecting behavioral data, some of the information can contain very sensitive and personal information. It’s critical that the strictest privacy controls to suppress personally identifiable information (PII) are developed to ensure the privacy and security of panelists. On top of that, you have to ensure the panelists are well aware that their personally identifiable information will always be secure and never sold to outside sources. When the panelists understand and believe their information is secure, they entrust you with their data… As long as they get something in return.
People genuinely like feeling important and knowing others want to hear from them. Being a panelist can potentially fulfill the need of wanting to contribute to something in this world. To perpetuate the sense of importance, and to also improve the quality of a panel, recruit panelists by invitation only. Receiving an invite to something exclusive and holding a coveted spot on a highly regarded panel is great for self esteem.
Then of course, there’s the tangible rewards. It’s fairly simple to collect information about people as long as they are rightfully reimbursed with giveaways, cash, or points to redeem gifts of their own choice. Why the panelists will continually come back and provide data comes down to psychology. It’s a combination of instant gratification and positive reinforcement. Every time a panelist provides information or agrees to be tracked, they automatically receive a reward for doing so. Panelists then learn that when they complete an action, they will receive something positive in return. Win-win.
Essentially, panelists will willingly agree to provide private information to a company that they trust and feel rewarded by. If you seek out a panel company that can manage to do just that, then acquiring behavioral data the right way should never be a risk.
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-advertisement | 1 year | Records user consent for cookies in the advertisement category |
cookielawinfo-checkbox-analytics | 11 months | Records user consent for cookies in the analytics category |
cookielawinfo-checkbox-functional | 11 months | Records user consent for cookies in the functional category |
cookielawinfo-checkbox-necessary | 11 months | Records user consent for cookies in the necessary category |
cookielawinfo-checkbox-others | 11 months | Records user consent for cookies in the other/unclassified category |
cookielawinfo-checkbox-performance | 11 months | Records user consent for cookies in the performance category |
CookieLawInfoConsent | 1 year | Records the default button state of the corresponding category & the status of CCPA. It works only in coordination with the primary cookie. |
elementor | never | This cookie is used by the website's WordPress theme. It allows the website owner to implement or change the website's content in real-time. |
viewed_cookie_policy | 11 months | The cookie is set by the CookieYes plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |
_GRECAPTCHA | 5 months 27 days | Provides spam protection and distinguishes between humans and bots. |
__hssrc | session | This cookie is set by Hubspot whenever it changes the session cookie. The __hssrc cookie set to 1 indicates that the user has restarted the browser, and if the cookie does not exist, it is assumed to be a new session. |
Cookie | Duration | Description |
---|---|---|
bcookie | 2 years | LinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser ID. |
lang | session | This cookie is used to store the language preferences of a user to serve up content in that stored language the next time user visit the website. |
lidc | 1 day | LinkedIn sets the lidc cookie to facilitate data center selection. |
__cf_bm | 30 minutes | This cookie, set by Cloudflare, is used to support Cloudflare Bot Management. |
__hssc | 30 minutes | HubSpot sets this cookie to keep track of sessions and to determine if HubSpot should increment the session number and timestamps in the __hstc cookie. |
Cookie | Duration | Description |
---|---|---|
AnalyticsSyncHistory | 1 month | Used to store information about the time a sync with the lms_analytics cookie took place for users |
hubspotutk | 1 year 24 days | This cookie is used by HubSpot to keep track of the visitors to the website. This cookie is passed to Hubspot on form submission and used when deduplicating contacts. |
_ga | 2 years | Calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors. |
_gat_gtag_UA_138017392_1 | 1 minute | Google uses this cookie to distinguish users. |
_gat_UA-138017392-1 | 1 minute | A variation of the _gat cookie set by Google Analytics and Google Tag Manager to allow website owners to track visitor behaviour and measure site performance. The pattern element in the name contains the unique identity number of the account or website it relates to. |
_ga_RFDCRNP6J3 | 2 years | This cookie is installed by Google Analytics. |
_gcl_au | 3 months | Provided by Google Tag Manager to experiment advertisement efficiency of websites using their services. |
_gid | 1 day | Installed by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously. |
__gads | 1 year 24 days | The __gads cookie, set by Google, is stored under DoubleClick domain and tracks the number of times users see an advert, measures the success of the campaign and calculates its revenue. This cookie can only be read from the domain they are set on and will not track any data while browsing through other sites. |
__hstc | 1 year 24 days | This is the main cookie set by Hubspot, for tracking visitors. It contains the domain, initial timestamp (first visit), last timestamp (last visit), current timestamp (this visit), and session number (increments for each subsequent session). |
Cookie | Duration | Description |
---|---|---|
bscookie | 2 years | This cookie is a browser ID cookie set by Linked share Buttons and ad tags. |
fr | 3 months | Facebook sets this cookie to show relevant advertisements to users by tracking user behaviour across the web, on sites that have Facebook pixel or Facebook social plugin. |
GoogleAdServingTest | session | This cookie is used to determine what ads have been shown to the website visitor. |
IDE | 1 year 24 days | Google DoubleClick IDE cookies are used to store information about how the user uses the website to present them with relevant ads and according to the user profile. |
test_cookie | 15 minutes | Used to check if the user's browser supports cookies. |
UserMatchHistory | 1 month | To provide ad delivery or retargeting |
_fbp | 3 months | This cookie is set by Facebook to display advertisements when either on Facebook or on a digital platform powered by Facebook advertising, after visiting the website. |
Cookie | Duration | Description |
---|---|---|
intercom-id-gz33jl8i | 8 months 26 days 1 hour | No description |
intercom-session-gz33jl8i | 7 days | No description |
li_gc | 2 years | Used to store consent of guests regarding the use of cookies for non-essential purposes |
__gpi | 1 year 24 days | No description |