sampling

Face Verification as Real-Time Solution for Survey Quality

Mihkel JäätmaCEO, Realeyes

Scott JonesVP of Product, Realeyes

Nick SuttonChief Strategy Officer, Kantar Profiles

Thirty percent of surveys are fake, based on an analysis of over half a million surveys. Quality issues have been prevalent for a long time now, and there is a need to address this. Survey panel quality has gotten worse because the marketplace does not value quality, fraudsters move faster than researchers and quality issues are not addressed adequately. Previous tools to deal with fraud are insufficient specifically for programmatic sample that is almost 70% of all surveys now. Quality issues are not visible enough, and there is need to create a transparency dashboard that is publicly available. Solution: face verification, which can be a game changer in survey quality. It is real time, cross-supply and simpler than CAPTCHA. The tool is established on properly obtained training data, that is tackling algorithmic bias head on and works everywhere on any device. There are different types of “bad actors”: the disengaged panelist, the dishonest panelist, the fraudulent panelist—the single biggest bad actor is from out of country. Following this there are bots, ghost completes and inconsistent answers (dishonest). There is not one single solution but rather a basket of solutions to make sure the quality is maintained. Key takeaways:
  • Widespread quality issues and deteriorating survey panel quality is a significant problem.
  • Existing tools for detecting and preventing survey fraud are insufficient, particularly for programmatic sample surveys.
  • To combat these quality and integrity issues, face verification is suggested. It stands out for being real-time, applicable across different survey supplies and more user-friendly than traditional CAPTCHA methods.

Download Presentation

Member Only Access

Inclusion by Design in Pharma Research and Marketing

This ARF Pharma Council event followed up on the Council’s podcast episode on “Inclusive Futures of Humancare,” focusing on the importance of inclusiveness in pharma research and marketing with respect to both demographic characteristics and health conditions.  Four speakers delivered brief presentations, followed by a discussion moderated by Pharma Council Co-Chair Marjorie Reedy of Merck.

Assuring Research Integrity in Data-Driven TV

Xandr’s Peter Doe reinforced the omnipresence of bias in TV measurement as he outlined four key areas of bias in assessing DirecTV’s (DTV) set-top box (STB) data for its national data-driven linear TV advertising. Noting DTV’s relatively low sampling size (7M STB homes) has a high level of bias when measuring for national TV viewing, Peter provided a top-line overview of Xandr’s viewership data methodology relevant to advertisers and marketers working with big datasets.

In Defense of Polling

David Dutwin, SVP of Strategic Initiatives at NORC, and a past president of AAPOR and survey research expert, in an interview with ARF CEO & President Scott McDonald, Ph.D., encouraged the advertising and marketing industry to maintain their faith in survey research. Surveys for marketing and advertising do not have to contend with two problems with election forecasting based on polls:

  1. Unlike market research surveys, pre-election polls are, “measuring a population that doesn’t [yet] exist,” – the population that will vote in an election.
  2. Given that lack of trust in major media is stronger at one end of the political spectrum than the other, non-response to surveys may well be correlated with political opinions but not with the subjects of most media and advertising surveys. Non-response therefore may well be less damaging for market research surveys.

Inclusion by Design in Pharma Research and Marketing

This ARF Pharma Council event followed up on the Council’s podcast episode on “Inclusive Futures of Humancare,” focusing on the importance of inclusiveness in pharma research and marketing with respect to both demographic characteristics and health conditions.  Four speakers delivered brief presentations, followed by a discussion moderated by Pharma Council Co-Chair Marjorie Reedy of Merck.

FORECASTING 2022: How Can Scenario Planning Improve Agility in Adjusting to Change?

On July 12, 2022, forecasting, and product experts shared frameworks and strategies for participants to consider as they plan amid disruptions in the industry. Presenters discussed techniques marketers could use to drive consumer action and advocacy — as well as econometric models for search trends, insights on holistic analytics programs, reflections on gold standard probability methods — and new forecasting techniques in the wake of the pandemic and more.

Nielsen One Comes to Market

Scott McDonald opened the session by discussing how the Census uses sample to correct for issues like undercounts in big data. Pete Doe (Nielsen) responded by commenting on persons who ask: do you have a Big Data solution or a panel solution? He doesn’t see it that way but rather you take all the signals you have and put them together in the best way for the problem at hand.

Making Sense of Multi-Currency Initiatives

Jon Watts (CIMM) led a conversation with the CEOs of an organization that is helping to manage the JIC (OpenAP) and one that participates in it (the VAB), the EVP of an organization that does not belong to the JIC but has met with it and the CEO of the MRC. The participants clarified their relationships with each other, discussed Nielsen and expressed their hope for the future of television measurement.

Inclusion by Design in Pharma Research and Marketing

  • Pharma Council

This ARF Pharma Council event followed up on the Council’s podcast episode on “Inclusive Futures of Humancare,” focusing on the importance of inclusiveness in pharma research and marketing with respect to both demographic characteristics and health conditions.  Four speakers delivered brief presentations, followed by a discussion moderated by Pharma Council Co-Chair Marjorie Reedy of Merck.

Member Only Access