effectiveness & ROI

Measuring Campaign Incrementality Using Both First Party And Third-Party Identifiers

Hong Zou of Adobe talked about how they measure campaign incrementality and ROI using both first-party and third-party identifiers. Their method was born in 2020, out of the need to refocus from lower funnel marketing campaign performance to upper funnel performance. Adobe matches one group of people exposed to the campaign with a look-alike group who were not exposed. Since all other attributes are the same, any differences can be attributed to the campaign itself.

Navigating Through Uncertainty with Next-Gen Marketing Mix

Greg Dolan (Keen Decision Systems) and Mark Bennet (Johnsonville Milwaukee) examined how to navigate in uncertain and volatile times in the current marketplace using next-generation marketing mix solutions. In the opening, Greg explored the progression of marketing from the late 90s, through what he dubbed “The Roaring 20s.” He noted that we went from a minimally complex, slower-paced “top-down” approach in the 1990s to a very fast-paced, complex environment with a shift to Retail Media and a unified approach where we apply next-generation predictive analytics in the 2020s. Greg discussed the intricacies of their approach of combining historical data with predictive/prescriptive plans to address drastic changes in the current environment, leveraging ML. He provided a case study that demonstrated the successful application of the next-generation marketing mix. In addition, Mark gave a client perspective on how they are handling market uncertainty.

Harnessing the Full Potential of Marketing Mix Models: How Attention, Creative and Audience Personalization can Drive ROI

Sameer Kothari (PepsiCo) and Todd Kirk (Middlegame Marketing Sciences) examined the application of a transformed rendition of marketing mix modeling created through the development of a proprietary system called the “ROI Engine.” Sameer indicated the desire to harness the “true potential of marketing mix models even beyond measuring past campaigns and using it for strategic planning looking forward.” Sameer discussed this system as having a more “predictive ROI outcome-based approach” by “leveraging an ecosystem of leading indicators for before and during a campaign flight.”

Audi Switzerland Integrates Attention Metrics & AI into Programmatic Bidding to Drive Business Outcomes

Zach Kubin of Adelaide began the session by explaining how reach has become increasingly fragmented. Digital, viewability and ACR tell an incomplete story, which makes it difficult to assess the quality of the media brands are buying. Adelaide combines all the available metrics into their own algorithm, which they call the Attention Metric (AU). Filip Pujic of Audi gave details from the car company’s use case, where it integrated AU using Adelaide’s algorithm into programmatic bidding, driving positive business outcomes. Audi will conduct a follow-up study to validate the results they have received.

Panel Discussion

In this session, Elea McDonnell Feit (Drexel University) led a panel discussion with the day’s speakers on innovations in experiments in marketing and referred to these experiments as a “mature part of the measurement system.” In this discussion panel members brought up ideas and examples of how to effectively employ randomized controlled trials (RCT) and the benefits of using experiments for attribution. They examined the lack of patterns stemming from advertising incrementality and credited this to the changing nature of the consumer journey and unique factors in strategy, the business life cycle and the product being sold. The panel also explored processes to ensure the deployment of a successful and effective experiment. In addition, geo-based tests were also considered. Other topics discussed were the cost-effectiveness of running experiments and the value of failed experiments.

Measurement with Large-Scale Experiments: Lessons Learned

In this session, Ross Link (Marketing Attribution) and Jeff Doud (Ocean Spray Cranberries) examined a large-scale experiment conducted with Ocean Spray. They applied randomized controlled trials (RCT) to approximately 10 million households (30 – 40 million people) in which ads were consumed by their participants via a variety of devices. Jeff explained that the experiment was done to measure the impact of when certain ads were suppressed for some of their participants. Additionally, they examined an MTA (multi-touch attribution) logit model that was subsequently applied, which yielded KPIs such as ROI. Information from this MTA-RCT experiment supplied refreshed results monthly. Daily ROI results from the campaign were collected from the MTA-applied modeling. Outcomes from this experiment revolved around retargeting and recent and lagged buyers. In addition, the study also explored creative treatments and platform effectiveness.

How to Cut Waste and Fuel Growth with Incrementality-Based Attribution

With Trevor Testwuide (Measured) providing context and Ian Yung (Tonal) guiding the case studies from Pinterest and Google, the two presenters tested whether ads/channels were working and how far marketers can scale them. Trevor compared last-touch attribution to incremental ROAS, showing the significant discrepancies between platform-reported and media-driven incremental conversions. The incrementality experiment methodologies used in the case studies were cohort based first-party audience split testing and geo-matched market incrementality testing, which Trevor noted were must-haves in determining where to cut waste and where to scale. Results from the case studies measuring holdout cohorts showed overinvestment in Pinterest based on organic conversions, and a 13% increase in ROAS on Google Shopping from under-reporting of incrementality.

MRC’s Outcomes and Data Quality Standard

The MRC’s Ron Pinelli outlined the scope of the Outcomes and Data Quality Standard, recently completed in September 2022. Part of MRC’s mission is setting standards for high quality media and advertising measurement, and Ron walked through the phased approach and iterative process that included the ANA, the 4A’s and other industry authorities.

Panel Discussion: Perspectives on the Rise of Retail Media

This panel discussion, moderated by Circana’s Michael Ellgass, discussed the current state and emerging opportunities in retail media, including measurement as well as organizational issues. The following are edited highlights from their conversation.

Beyond Measurement: How Coca-Cola Uses Attention Metrics to Increase Efficiency & ROAS

This presentation discussed cooperation between Coca-Cola and Adelaide. Adelaide created a metric AU—a single metric for brands to ensure their media gets the most attention. They conducted a campaign with Diet Coke to understand how attention metrics could be incorporated into a campaign measurement system to improve efficiency and to understand what could drive success. Coca-Cola has an end-to-end framework for measuring their campaigns. The E2E metrics has key components that measure human impact: head metric—all different measures if an experience was noticed and recalled; heart—resonance and relevance; hand—purchase/shopping; mouth—consumption. AU is part of the “head” component. An earlier trial in Europe took two campaigns—one with Aquarius and one with Coke. Half of media was optimized based on attention and the other on exposure. Clear convincing results showed that there is higher ad recall, recognition and impact based on attention as opposed to viewability.