TV

A Two-Pronged Approach

Kyle HoltzmanBusiness Lead Restaurant Vertical, Google

Bennett M. KaufmanCross-Media Measurement Lead, Google/YouTube

Michelle SmileyAnalytical Lead Restaurant Vertical, Google



In this session, speakers Bennett M. Kaufman, Kyle Holtzman and Michelle Smiley of Google explored a two-pronged approach to cross-media measurement and planning that considered the full-funnel impact across traditional TV and streaming video (YouTube), to make sense of all the "disparate forms of data and measurement." The approach considered a geo-based experiment and audience incrementality to demonstrate and solve the following challenges: to retain current loyal customers, to age down the brand and to appeal to new consumers (Generation Z). The speakers presented a study done by Google in partnership with Burger King to test a new experimentation strategy to understand and measure the relationship between Linear TV and YouTube. The speakers touted the benefits of this method as repeatable and customizable across a variety of media channels, in addition to being timely, omni-channel and privacy safe.

Key Takeaways

  • The geo-based experiment addressed the understanding of changing behavior in the physical stores for Burger King, through increased sales related to media spend. This technique gave the ability to measure the uplift between control and treatment to understand media impact. The geo-experiment focused on three KPIs: store sales, store transactions and deal take rate (promotion featured in the ad).
    • Results from the geo-experiment indicated:
    • Store sales generated by linear TV were flat but store sales increased in views from YouTube.
    • Store transactions generated by linear TV decreased while YouTube views increased store transactions.
    • In terms of the deal take rate (deal shown in the ad) the take rate was higher generated by linear TV, though it still generated positive returns from YouTube.
  • Audience incrementality testing was conducted by Comscore (3rd party incrementality validation). Through this process, they wanted to understand if they were reaching a new target audience and if their message was reaching anyone that may not have heard their message on linear TV alone.
    • Audience incrementality testing resulted in the following:
    • Accounting for the target audience of adults 18-49 was critical in the short and long term.
    • YouTube reached 78 million adults ages 18-49. In addition, 34 million of the viewers were YouTube-only, unique viewers.
    • There were 43,365,489 cross-platform unique viewers.
    • 20,680,526 were unique linear TV-only viewers with 64 million total linear TV viewers.

Download Presentation

Member Only Access

Unlocking Reach in Premium Content

Mike LevinProduct Management, NBCU

Emily KwokSenior Director, Ad Experience Measurement, NBCU



NBCU’s Mike Levin and Emily Kwok tested brand safety in premium video content from a viewer perspective in their research using NBCU’s proprietary AI tech for automating brand safety and suitability decision making. The study’s three objectives asked whether increasingly violent episodes influence viewers’ experiences, if they then assign blame to marketers for knowingly advertising in explicit or violent content, and if there are specific instances where adjacency affects viewer sentiment towards an ad. Measuring unconscious response to nine episodes across two seasons tagged with three levels of risk, facial coding and eye gaze technology, complemented by traditional surveys, captured the impact on a nationally representative sample of 1,800 respondents. Finding that violent episodes maintained stable levels of attention, the study also determined that traces of negative emotion were scarcer in the more violent episodes.

Key Takeaways

  • From the mildest episodes to the most violent, viewer attention remained stable. Attention to high risk episodes measured in at 51.5%, with attention to low-risk episodes at 51.4%.
  • Viewers don’t attribute blame to advertisers. “There’s more reward than risk,” according to Emily. Viewers tend to enjoy brands that are sponsoring the content they love, controversial or not—8 in 10 agree that they don’t distrust brands that advertise in graphic TV shows.
  • Several rare cases where gratuitous violence immediately preceding an ad break did carry negative sentiment into the first seconds of the ad.

Download Presentation

Member Only Access

Standardizing and Scaling Cross-Platform Measurement

Lindsey Woodland, Ph.D.Group VP of Data Science, 605

Jes SantoroEVP, Advanced TV & Video, Cadent



Lindsey Woodland (605) and Jes Santoro (Cadent) presented a case study of a big box retailer to demonstrate their standardized, scalable process for cross-platform measurement and reporting. The retailer’s 2020 holiday campaign benefitted from the identification, scaling and targeting of a selected custom-curated audience. Activation within premium inventory involved broadcast, cable and CTV ads served to targeted households. Including CTV in the media plan added many medium and light linear viewers. Measurement and analysis of the campaign indicated that the retailer achieved their campaign objectives, which included acquiring new customers and competitive shoppers, while defending their base of loyal customers. The campaign’s incremental ROAS was $5. Additionally, peak performance for total visits and unique visitors occurred at four exposures. The highest volume of unique visitors occurred within a week after first campaign exposure.

Key Takeaways

  • It is essential for advertisers to measure the reach and effectiveness across multiple avenues of ad exposure rather than consider exposures in platform silos. The importance of this approach will increase as media consumption continues to evolve and cross-platform consumption grows.
  • Understanding which targets can not only be reached but also activated by various platforms results in more effective campaign planning.
  • Based on this knowledge clients can shift dollars between channels to better optimize their campaigns in real time and prior results can be used to inform future work.
  • Marketers can sub-target their campaigns by creating multiple targets, based not only on media consumption, but also media responsiveness to improve each targets’ projected ad effectiveness.
  • An effective causal multi-touch attribution (MTA) approach should provide stable, reliable results that have been researched and tested across hundreds of real campaigns and simulated data to ensure that the approach is yielding accurate results.

Download Presentation

Member Only Access

Unlocking the Value of Alternative Linear TV Currencies with Universal Forecasting

Spencer LambertDirector, Product & Partnership Success, datafuelX

Matt WeinmanSenior Director of Product Management, Advanced Advertising Product, TelevisaUnivision



Matt Weinman (TelevisaUnivision) and Spencer Lambert (datafuelX) shared the methodology and results from testing TelevisaUnivision’s initiative that, with datafuelX’s technology, enabled their advertising partners to choose their preferred currency in forecasting both long- and short-term audiences for their programming. Implementation involved adjusting the business flow for multi-measurement sources but with each source ingested, validated and normalized to the tech standard separately. Forecasting incorporated a programming schedule imputation process which was then fed into a mixed model estimation (MME), and then optimized with linear granular data. Their model revealed gaps that they addressed with a variety of tactics including a ratings adjustment approach that updated network viewership trends, a proportional weight method for advanced audiences, recency weighting to avoid stale rate cards and relying less on forecasting viewers rather than scheduled content. The MME drove strong predictive forecasts and increased the use of long-tail inventory.

Key Takeaways

  • Forecasting should always be done based on content.
  • In reviewing the accuracy of predicting exact programming, the forecast to actuals had a 71% program match. In predicting programming type, there was 94% accuracy.
  • Results for the long-term audience forecasts had 42% MAPE (mean absolute percentage error) improvements overall using big data sources.

Download Presentation

Member Only Access

In-Home Psychophysiological Television Measurement

Pedro AlemidaCEO, MindProber

Lauren ZweiflerSVP Insights & Research, Client Strategy & Insights Org, NBCU



How to measure attention? This presentation introduced MindProber—a tool that includes biometrics, physiology, conscious/dial AND survey methods to assess attention. MindProber measurement is passive—second by second emotional engagement is measured through electrodermal activity (EDA), aka galvanic skin response (GSR) and also active—measures cognitive response via an optional feature to indicate like/dislike content through app. N= 1,500 and growing to 3,000 by end of year. Pedro Almeida (MindProber) emphasized three indicators of the value of metrics: 1. Validity—measures what it is supposed to measure. GSR is linearly related to perceived arousal in video formats. Measures emotional intensity (example of soccer game and spikes during key moments such as goals). 2. Reliability—metrics are stable across samples with 98.3% accuracy in ranking high vs. low impact ads. 3. Predictive power—metrics predict events of interest. Carry-over—if you’re more involved with the content you will respond more to ads. Premium content leads to higher advertising impact. Engagement with contents will carry over to engagement with ads. Emotional impact is indicator of likelihood of remembering the brand. Generating macro insights through a robust taxonomy—analyzed 150+ sessions, watched 250+ hours of programming, monitored 20,000+ individual hours, 10,000+ individual participations, 22,700+ events tagged and 8,500+ ads. Ninety-eight percent of commercial activity is as engaging as the content. Findings show 1. validity exists. 2. Reliability—98.3% accuracy in ranking high vs. low impact ads. 3. Predictive validity: A) Higher emotional impact for content = higher emotional impact for advertising. Carry-over—premium content leads to higher advertising impact; B) Higher emotional impact score = higher brand recall. Emotional impact is an indicator of likelihood of remembering the brand. Lauren Zweifler (NBCU) showed that MindProber successfully identified the most crucial moments on both scripted and unscripted shows (Iconic holiday TV moments for the first and Top Chef and America’s Next Top Model for the latter) WITH validity, reliability and predictability. What’s next?
  • How can we best predict lower funnel outcomes?
  • What elements of creative really matter?
  • How do we optimize for CTV?

Key Takeaways

  • New tool that captures emotional engagement through skin response.
  • Three fundamental metrics are validity, reliability and predictability.
  • Generated macro insights through a robust taxonomy. Power of premium video content yield strong emotional engagement (EE).

Download Presentation

Member Only Access

Going Steady: How Long Will (My Cross-Media Campaign) Last?

Brian PughChief Information Officer, Comscore

Tania YukiCMO & EVP, Digital, Comscore



In this session, Tania Yuki and Brian Pugh of Comscore explored the impact of frequency and latency in cross-platform advertising effectiveness. In her opening, Tania demonstrated consumer trends and touchpoints to better understand cross-media, in terms of reach and optimizing platforms for specific outcomes. In her discussion, Tania acknowledged the challenges of measurement due to the constant introduction of new innovations and the adoption of new behaviors to track. She also recognized the considerable increase in connected devices per household since the pandemic. Tania pointed out complexities in the current media ecosystem from the increase in which media has merged despite being separate platforms (e.g., linear TV, social media, online video, etc.). In addition to all the changing behavior in media consumption, the speaker noted the emergence of Generation Z is beginning to change the rules for establishing brand love and loyalty. In his discussion, Brian examined findings from the measurement of 400 cross-platform campaigns to understand trends in terms of platform mixes. Brian noted the continued growth of social media and CTV along with the decline in linear TV, though he acknowledged linear still remained "king." Furthermore, he found that multi-screen campaigns performed better than single-platform campaigns.

Key Takeaways

  • The number of connected devices per household has increased from 9 to 12 since the pandemic, creating a more complex path in which to reach consumers.
  • Despite being separate platforms (e.g., linear TV, social media, online video, etc.) media is “inextricably commingled together,” leading to "context switching and about getting the right content to the right consumer."
  • In terms of long-form video, "Linear television is still the juggernaut in the room at 205 billion [viewing] hours." Total video across linear, CTV and digital grew 5% year-over-year in the U.S. CTV viewing increased by 14% of the total hours watched.
  • Short-form video continues to rise in popularity through Instagram Reels, TikTok and YouTube Shorts. This trend in short-form video consumption is growing in double-digit percentages and redefining video consumption across mobile and connected TV screens.
  • The emergence of Generation Z is changing the marketer approach to brand love and establishing loyalty and building long-term value as their consumer behavior is in contrast to previous cohorts. This is specific to their lack of brand loyalty.
    • In terms of media consumption, Generation Z are heavy movie watchers (37%), preferring dramas (29%) and cooking shows (23%). Additionally, they expressed interest in local news and documentaries.
  • Social media is still growing (11%) but there are fewer linear TV households (-9%) as people are consuming media elsewhere and CTV has increased substantially (32%).
    • Though there was a clear decline in linear TV viewership, linear TV remains supreme regarding total viewership for one channel.
  • In terms of incremental reach over the length of a campaign, linear TV reached a lot of viewers in the early part of a campaign, but over time the study indicated "reaching incremental people on CTV and digital more often." This finding acknowledged the advantages of a cross-screen campaign in terms of optimizing reach.
  • Adding screens in a campaign improved brand lift but the variability of results also increased. Additionally, results for ad recall and other variables followed a similar pattern. It was noted that the optimal platform mix depended on the target audience.

Download Presentation

Member Only Access

Charting the Course for Third Party, Cross-Media Audience Measurement

Tina DanielsManaging Director, Agency & Brand Measurement Analytics, Google

Nicole GileadiGlobal Product Lead, Google

In this session, Tina Daniels and Nicole Gileadi examined Google's principles for charting the course for third-party cross-media audience measurement. Tina acknowledged more third-party measurement companies were expressing interest in working more closely with Google, given their stature as the world's largest video provider. In her discussion, she acknowledged that this interest generated the need for Google to create a set of principles to offer to both measurement companies and key clients to guide the process. After reviewing these principles Tina and Nicole held an open discussion regarding these principles. Topics of the discussion included premium and high-quality content, long-form versus short-form video and the measurement of this content. In addition, Nicole touched on the importance of content and the context surrounding an ad. Other areas included the idea of exposure metrics (e.g., Where is my audience? Did I reach them?) in addition to providing signals to conduct an impact analysis.

The following are the five principles Google shared with the industry, to act as guidance for third-party measurement companies interested in working with Google:

  1. Google expects measurement companies to be comprehensive, meaning a holistic view of audiences across all platforms.
  2. Measurement should be fair and comparable.
  3. Privacy-centricity is extremely important. Only privacy-centric solutions can meet consumer expectations and be durable for marketers in the long term.
  4. Independent & Trustworthy, meaning both objective and transparent, ideally with third-party endorsement like the MRC.
  5. Measurement solutions must be actionable for advertisers.

Key Takeaways

  • The struggle that the advertising and marketing industry is currently having is that "there is no universal definition of content quality that is easily measurable in cross-media systems."
  • "Content quality is being used as this proxy for content impact." For example, "What is the impact of the content on my brand equity, my campaign objective, by marketing or business objectives?" All of these factors are specific to the marketer, the brand and the campaign.
  • When it comes to exposure metrics, advertisers and marketers should be consistently counting impressions across all channels, "because you need to count things to value them."

Member Only Access

Beyond Reach, the Importance of Measuring Ad Resonance

Tom WeissChief Data Scientist, MarketCast

Megan Daniels SVP of Product, MarketCast

Tom Weiss and Megan Daniels of MarketCast introduced a new metric in their break-out session: brand effect resonance. This product evolved from one called Brand Effect which uses a combination of survey (15,000 consumers per day) and behavioral data across linear, social, digital (popular websites) and streaming. First developed by IAG, then owned by Nielsen and then Phoenix, Brand Effect stands as the main engine of the brand-effect resonance rating system, which was created to overcome gaps in reach measurement. They believe it can now isolate and show exactly how content and platform quality impacts advertising performance. Resonance here is defined as how well people remember the ad, how well they understood the creative and the message and how well they can link it back to the brand. Ad resonance measurement is said to be able to isolate the impact of content and platform on ad recall.

Key Takeaways

  • Reach measurement has drawbacks: even though it acknowledges audience size, it does not measure ad impact. Reach measurement treats all impressions as equal regardless of the content, and while platform and the quality of the content matter, their impact cannot currently be proven.
  • Ten percent of respondents to a recent MarketCast survey found that in a digital environment, ads associated with premium content (professionally produced vs. user-generated content (UGC)) had more credible messaging.
  • Sixty-two percent who watched a premium clip remembered the ad and the brand correctly versus 49% of those who viewed a UGC clip. In addition, 56% of premium clip viewers thought the ad spoke directly to them, versus 43% who said an ad in a UGC clip spoke to them.
  • The resonance score is built from CTV/streaming ACR data, opportunity to see (OTS) surveys for linear TV, tags on digital ads (known exposure) and on social—OTS through memory triggers and surveys.
  • Using the always on approach, they survey people about ads they have seen on TV, CTV or social within a 24-hour window. The big pool of participants is used to normalize all other factors, so to see what network or platform would best suit a client’s ad.
  • Ad resonance rating is meant to become an interoperable metric that complements traditional reach and frequency measures and other currency metrics.

Download Presentation

Member Only Access

$3 Trillion Sales Study Show TV Has Highest Quality Impressions

Lloyd DarbonneSenior Director Research, Insights, & Strategy, FOX Corp.

Bill HarveyExecutive Chairman, Bill Harvey Consulting, Inc.

Audrey SteeleEVP Sales Research & Strategy, FOX Corp.

Audrey Steele (FOX) introduced this presentation by highlighting the objectivity of the years-long study focused on the relative value of different platforms and impression quality, with the brands involved amassing close to $3 trillion in sales. While many in the industry are focusing on maximum reach, this study looked at sales as the most important measure of impressions, quality and value between media platforms. Bill Harvey (BHC) detailed the study’s methodology of implementing a standard multiple regression analysis with ROI optimization using SMI’s real ad spend numbers and Circana’s and S&P Global’s sales spend across the top ten brands in each of QSR, CPG and Auto verticals over nine years of data. Lloyd Darbonne (FOX) covered how the thousands of iterations of their ROI optimizer selected the media mix that predicted the highest share for each company studied. Concentrating on entertainment (inclusive of TV sports & news, TV cable entertainment, TV Big 4 entertainment and premium digital video TV), the optimizer then measured the optimal allocation for maximum ROI in each vertical. Results across verticals documented higher ROIs with significant reallocations and rebalancing of ad spends in TV and premium contexts.

Key Takeaways

  • Brands that increased their spend in non-premium digital lost sales and market share, much of it due to misallocation of advertising spend. There are opportunities for 20-40% ROI increases by reallocating non-premium digital dollars to TV.
  • TV has 2.6x the sales effect of non-premium digital. There is a 14.6% incremental sales lift added by advertising, on top of the baseline 85% sales without advertising. TV generated 69% of the added 14% across the combined three verticals, with non-premium digital at 27%. In all three verticals studied, broadcast entertainment still has a good amount of headroom—increasing share of ad spend will increase sales effects.
  • Buyer focus on CPM and rush to oversaturated lower-priced media and non-premium digital inventory has served to suppress the sales effects of overall campaigns.
  • Focusing on ROAS instead of reach, and using standard multiple regression analysis gives advertisers an advantage over slower-moving competitors.
  • For impressions quality, context still matters.

Download Presentation

Member Only Access