viewability

Measuring Attention and Outcomes for Audio Advertising

Mike FollettCEO, Lumen

Joanne LeongGlobal Head of Planning, Dentsu

Lumen and Dentsu measured attention in audio. Audio is obviously a key component, but the main challenge is how to create attention metrics for audio that can be comparable to visual? Can eye tracking be applied to audio, and if so how? Previous research shows that ads have to be noticed to drive results. Not necessarily looked at. There is a need for some form of attention to make ads work. Seventy percent of viewable ads are not viewed and as such do not sell. Research also shows that longer ads drive better outcomes in terms of prompted recall and choice uplift. Visual eye movements are a part of this but only the first part of the process that may lift to memory and action. At Lumen they measure 1) how many ads are viewable for the user; 2) whether they are viewable (=MRC); 3) % viewed; 4) view time in seconds; 5) APM in seconds; 6) cost per attentive impression. Eye tracking works by taking videos of eyes while on screen—simple behavioral metric. After this they ask questions and understand the relationship between eye movements and other measures. Audio works differently. We lack information about the percent of people who listened and average listening time, but we can infer from visual attention. This is, thus, an audio-visual equivalence. How much visual attention would generate same recall from audio? According to the presenters, inferential model seems to work quite well. They infer likely levels of audio attention from several factors: exposure time, brand recall, choice uplift, forced vs. voluntary. Methodology: They measured people listening to radio, podcasts and streaming audio services. There were three forms of audio advertisements, thousands of people from whom to collect audio and recall data and infer how much visual attention would have been needed to do the same. Finding: Attention metrics are equivalent for audio. This data is built into Dentsu’s planning tools when their trading teams are contemplating which media to buy. The research shows that audio generates attention at a lower cost. In a digital world, it is about measuring live campaigns, and planners and clients are used to getting impression-level data about viewability or audibility. Audio industry has the ability to supply this data. Individual data on podcasts and streaming could help demonstrate the true power of audio campaigns. Challenge to industry: now that the potential power has been demonstrated we need to get impression level data to be able to measure live campaigns. Key takeaways:
  • Radio is an extremely cost-effective way of reaching people and driving outcomes.
  • We have benchmarks, we want measurement, we need impression-level data.
  • Combine attention data with outcomes data to tell a compelling story.
 

Download Presentation

Member Only Access

MRC’s Outcomes and Data Quality Standard

The MRC’s Ron Pinelli outlined the scope of the Outcomes and Data Quality Standard, recently completed in September 2022. Part of MRC’s mission is setting standards for high quality media and advertising measurement, and Ron walked through the phased approach and iterative process that included the ANA, the 4A’s and other industry authorities.

Beyond Measurement: How Coca-Cola Uses Attention Metrics to Increase Efficiency & ROAS

This presentation discussed cooperation between Coca-Cola and Adelaide. Adelaide created a metric AU—a single metric for brands to ensure their media gets the most attention. They conducted a campaign with Diet Coke to understand how attention metrics could be incorporated into a campaign measurement system to improve efficiency and to understand what could drive success. Coca-Cola has an end-to-end framework for measuring their campaigns. The E2E metrics has key components that measure human impact: head metric—all different measures if an experience was noticed and recalled; heart—resonance and relevance; hand—purchase/shopping; mouth—consumption. AU is part of the “head” component. An earlier trial in Europe took two campaigns—one with Aquarius and one with Coke. Half of media was optimized based on attention and the other on exposure. Clear convincing results showed that there is higher ad recall, recognition and impact based on attention as opposed to viewability.

If an Ad Plays When the TV is Off, Did Anyone See It?

Mike Fisher of GroupM shared findings from an eye-opening study conducted with iSpot.tv, investigating continuous play scenarios. It revealed a viewability issue with external, third-party, streaming devices such as Roku, Amazon Fire TV and gaming consoles Xbox and PlayStation. Such devices make the verification of ad delivery via TV apps more difficult. While such a device may signal that an ad was delivered, the TV screen itself may be off. Since external devices and the TVs they are attached to do not talk to each other, and so the message is lost. Fisher urged this as an industry-wide issue that multiple parties: manufacturers, publishers, agencies and advertisers, need to come together to fix.

The Quality Media Framework

Michael Siewert (Colgate-Palmolive) and Souptik Datta (GroupM) presented how their companies worked together to combine measurement data for building custom solutions around bidding in the programmatic space. Colgate wanted to create their own quality definition for their inventory and be able to benchmark at a scalable cost benefit. Building a framework around their definition of quality and creating their own “qCPM” metric allowed them to understand the details of performance at a baseline and optimize with machine learning across 80+ markets and varying formats.

Making Sense of Multi-Currency Initiatives

Jon Watts (CIMM) led a conversation with the CEOs of an organization that is helping to manage the JIC (OpenAP) and one that participates in it (the VAB), the EVP of an organization that does not belong to the JIC but has met with it and the CEO of the MRC. The participants clarified their relationships with each other, discussed Nielsen and expressed their hope for the future of television measurement.

Beyond Measurement: How Coca-Cola Uses Attention Metrics to Increase Efficiency & ROAS

Marc GuldimannFounder & CEO, Adelaide

Greg PharoSr. Global Director, Holistic Communications & Marketing Effectiveness, The Coca-Cola Company

This presentation discussed cooperation between Coca-Cola and Adelaide. Adelaide created a metric AU—a single metric for brands to ensure their media gets the most attention. They conducted a campaign with Diet Coke to understand how attention metrics could be incorporated into a campaign measurement system to improve efficiency and to understand what could drive success. Coca-Cola has an end-to-end framework for measuring their campaigns. The E2E metrics has key components that measure human impact: head metric—all different measures if an experience was noticed and recalled; heart—resonance and relevance; hand—purchase/shopping; mouth—consumption. AU is part of the “head” component. An earlier trial in Europe took two campaigns—one with Aquarius and one with Coke. Half of media was optimized based on attention and the other on exposure. Clear convincing results showed that there is higher ad recall, recognition and impact based on attention as opposed to viewability. The Diet Coke campaign focused on the following questions: Can attention metrics offer insights into media? What level of attention is needed to increase brand lift? How can we gain real time insights? Can we leverage attention metrics to reduce ad waste? Methodology—3 stages: 1. A/B test: The campaign was split into two groups, AU-optimized and BAU optimized to VCR and CTR. Findings show consistent results when optimizing attention. Half to viewability and half to attention. 2. Max AU analysis: This considers the single highest AU impression for a respondent to control for frequency. It uses actual response data to gauge lift. This suggests the level of attention at which single impressions are impactful. Findings show exposure to media above 35 AU resulted in higher ad recall, purchase intent and favorability among consumers. 3. AU flight control: This considers the relationship between the frequency of exposures and Lucid survey results at different levels of media quality. Suggests the AU above which media is cumulatively impactful. They conducted regression analysis to find the minimum AU to use to drive consistent outcomes. The correlation at given frequency between ad exposures and purchase intent increases above 20 AU. For the Diet Coke campaign, optimal AU increased above 20 AU and is strongest above 29 AU, peaking at 38 AU. There is an opportunity to drive incremental lift: 1. Exposure to high AU media drives brand lift indicating AU is a proxy for Coca-Cola’s KPIs. 2. Identifying the minimum level of AU required for a KPI uncovers significant efficiencies. 3. Attention metrics provide a real-time window into brand performance. Next steps: How to measure AU everywhere; To explore leveraging high AU PMPs to provide targeting opportunities.

Key Takeaways

  • Exposure to high AU (Adelaide’s Attention Metric) drives brand lift indicating AU is a proxy for Cola’s KPIs.
  • Identifying the minimum level of AU required for a KPI uncovers significant efficiencies.
  • Attention metrics provide a real-time window into brand performance.

Download Presentation

Member Only Access

If an Ad Plays When the TV is Off, Did Anyone See It?

Mike Fisher Executive Director, Investment Innovation, GroupM

Mike Fisher of GroupM shared findings from an eye-opening study conducted with iSpot.tv, investigating continuous play scenarios. It revealed a viewability issue with external, third-party, streaming devices such as Roku, Amazon Fire TV and gaming consoles Xbox and PlayStation. Such devices make the verification of ad delivery via TV apps more difficult. While such a device may signal that an ad was delivered, the TV screen itself may be off. Since external devices and the TVs they are attached to do not talk to each other, and so the message is lost. Fisher urged this as an industry-wide issue that multiple parties: manufacturers, publishers, agencies and advertisers, need to come together to fix. iSpot curated data from three sources from the first half of 2021 (Jan. 1 – June 30). GroupM supplied trade desk impression logs from programmatic buying, including each IP address an impression was delivered to, the device ID and the unique ad identifier, the time stamp and the app that was used. The second source was iSpot pixel impression logs which included the timestamped feed of OTT impressions and the delivery device UA to validate impressions (TV mapping). These were compared and matched against iSpot’s ACR data (licensed from VIZIO/Inscape) which showed whether the TV was on or off at the time an impression was delivered.

Key Takeaways

  • The results showed that 15-20% of the time, when an ad is playing on such an external device, the TV is off. Every publisher and device combination were affected.
  • This doesn’t happen with most Smart TVs, although there is one that goes into a low power mode (Fisher wouldn’t say which).
  • The initial study did not look at input switching, such as when someone switches to a gaming console or cable box. But that is part of phase two, along with how time of day affects this phenomenon (i.e., people falling asleep in front of the TV) and expanded data sets to look at linear TV consumption.
  • GroupM is now testing what combinations of devices and cables make the problem better or worse and why. Older HDMI cables and having a sound bar can interrupt the power on/off signal, they found. Pucks and sticks, and other devices hidden behind TVs, also have a higher occurrence of continuous play.
  • Prompts that ask, “Are you still watching?” help avoid this. Some platforms wait four hours to ask, which is too long, but with short-form episodic viewing, asking too often can annoy viewers.

Download Presentation

Member Only Access

The Quality Media Framework

Souptik Datta, Ph.D.Sr. Director, Data & Analytics Services, GroupM

Michael SiewertProgrammatic Director, Colgate-Palmolive Co.

Michael Siewert (Colgate-Palmolive) and Souptik Datta (GroupM) presented how their companies worked together to combine measurement data for building custom solutions around bidding in the programmatic space. Colgate wanted to create their own quality definition for their inventory and be able to benchmark at a scalable cost benefit. Building a framework around their definition of quality and creating their own “qCPM” metric allowed them to understand the details of performance at a baseline and optimize with machine learning across 80+ markets and varying formats.

Key Takeaways: Mapping their quality journey involved

  • Defining the quality metric for Colgate led Souptik (GroupM) to create a menu of foundational elements (verification, clarity) and Colgate’s CPMs, KPIs, goals and values that constituted quality for them, which then informed a custom formula. Their qCPM metric is formulated from cost, quality and business effectiveness KPIs.
  • Reporting and benchmarking: Using multiple DSPs, clean rooms and viewability partners to build a global reporting scalable cloud-based system, Colgate’s interactive dashboard was able to measure benchmarks and put dollar values to opportunity sizes (underperforming and extra mile) for the first time.
  • Automating custom bidding to optimize for quality: Because it’s not possible to optimize manually, Colgate used its own AI algorithm to spot inefficiencies, seeing a nearly 20% lift in small-scale tests. They also implemented their own custom bidding tests to monitor and analyze to see how much improvement they could make.

Download Presentation

Member Only Access

AUDIENCExSCIENCE 2023

The ARF hosted its annual flagship conference, AUDIENCExSCIENCE 2023, on April 25-26, 2023. The industry’s biggest names and brightest minds came together to share new insights on the impact of changing consumer behavior on brands, insights into TV consumption, campaign measurement and effectiveness, whether all impressions are equal, join-up solutions across multiple media, the validity, reliability and predictive power of Attention measures, targeting diverse audiences, privacy’s effect on advertising and the impact of advertising in new formats. Keynotes were presented by Tim Hwang, author of Subprime Attention Crisis, Robert L. Santos of the U.S. Census Bureau, Brian Wieser of Madison and Wall, LLC and Andrea Zapata of Warner Bros. Discovery.

Member Only Access