Panel Discussion
Michael Cohen (Plus Company) moderated this panel with the day’s speakers on subjects ranging from overcoming the challenge of non-representative samples, data validation, change management to the impact of AI
data analytics
Mastering the Promise of ML for Measuring Incremental Sales
In this session, Leslie Wood of NCSolutions and Patrick McGraw of Colgate-Palmolive walked the audience through the process their machine learning (ML) program takes to discover the baseline sales for exposed households. The ML platform consists of a double robust causal framework that they began training in 2014, a super learner to do modeling, a database of results and a decision-tree – where no levers are thrown, as everything is preset. She also defined a counterfactual or the results, which in this case is incremental sales.
Modeling Short and Long-Term Effects in the Consumer Purchase Journey
Peter Cain of Marketscience covered shortcomings of marketing mix modeling (MMM). It is hampered by the endogeneity problem (selection bias) in things like online media. MMM is also only a short-term approach. The standard long-term method accompanying MMM is also flawed and ignores the time-series properties of the data.
Panel Discussion
In this session, Elea McDonnell Feit (Drexel University) led a panel discussion with the day’s speakers on innovations in experiments in marketing and referred to these experiments as a “mature part of the measurement system.” In this discussion panel members brought up ideas and examples of how to effectively employ randomized controlled trials (RCT) and the benefits of using experiments for attribution. They examined the lack of patterns stemming from advertising incrementality and credited this to the changing nature of the consumer journey and unique factors in strategy, the business life cycle and the product being sold. The panel also explored processes to ensure the deployment of a successful and effective experiment. In addition, geo-based tests were also considered. Other topics discussed were the cost-effectiveness of running experiments and the value of failed experiments.
Analytics, Attribution, and Experiments – Building a Solid Measurement Framework in a Privacy-centra Era
Sudeshna Sen (Dentsu International) and Aarti Bhaskaran (Snapchat) examined the unique role experiments play in marketing performance and decision-making. The increased importance of experiments was discussed, particularly in light of App Tracking Transparency (ATT), which created a challenging shift in the way Dentsu and other marketing firms collect user data. The discussion around the growing importance of experimentation in marketing included ways to incorporate experimentation into a client’s marketing goals and best practices for testing and experimentation. Performance collaborations with platforms were examined as a method to produce solid testing results based on client needs and business goals. In addition, the importance of aligning relevant business goals and KPIs were acknowledged as a key component in identifying the appropriate testing and measurements, to create more meaningful outcomes. Next steps include progressing from “anecdotal incidents of performance to a proof of concept.”
Measurement with Large-Scale Experiments: Lessons Learned
In this session, Ross Link (Marketing Attribution) and Jeff Doud (Ocean Spray Cranberries) examined a large-scale experiment conducted with Ocean Spray. They applied randomized controlled trials (RCT) to approximately 10 million households (30 – 40 million people) in which ads were consumed by their participants via a variety of devices. Jeff explained that the experiment was done to measure the impact of when certain ads were suppressed for some of their participants. Additionally, they examined an MTA (multi-touch attribution) logit model that was subsequently applied, which yielded KPIs such as ROI. Information from this MTA-RCT experiment supplied refreshed results monthly. Daily ROI results from the campaign were collected from the MTA-applied modeling. Outcomes from this experiment revolved around retargeting and recent and lagged buyers. In addition, the study also explored creative treatments and platform effectiveness.
Ten Things to Know about Viewing
Yes, there is upheaval in the media industry. The press paints a dire picture of viewing, yet Radha Subramanyam (CBS), focuses on growth. Total viewing is up 2% year over year, broadcast share of total viewing up 2%. CBS viewing also is up 2% year over year—across entertainment, news and sports, 8-10 shows averaging over 10 million viewers nightly. When it comes to reach and “unique,” it’s an even bigger number in streaming, particularly entertainment. There’s great momentum in sports and women in sports.
- Past Event Highlights
- Article
A Layman’s Guide to Cross Media Reach & Frequency Measurement Using Virtual IDs
On May 17, the ARF Analytics Council explored the groundbreaking concept of Virtual IDs (VIDs) and their potential to revolutionize cross-media measurement. The essential mechanics of VIDs were explained in a non-technical manner to help professionals across media and advertising understand it better. Panelists shared how VIDs could overcome barriers in calculating cross-media and device reach and frequency.
Member Only Access
Courageous Career Moments: Overcome Fears and Bet on Yourself
On April 26, 2023, members of the Women in Analytics Community and attendees from various industries joined the ARF for an inspirational Women in Analytics breakfast about Courageous Career Moments: Overcome fears and Bet on yourself.
Member Only Access
- Past Event Highlights
- Article
AUDIENCExSCIENCE 2023
The ARF hosted its annual flagship conference, AUDIENCExSCIENCE 2023, on April 25-26, 2023. The industry’s biggest names and brightest minds came together to share new insights on the impact of changing consumer behavior on brands, insights into TV consumption, campaign measurement and effectiveness, whether all impressions are equal, join-up solutions across multiple media, the validity, reliability and predictive power of Attention measures, targeting diverse audiences, privacy’s effect on advertising and the impact of advertising in new formats. Keynotes were presented by Tim Hwang, author of Subprime Attention Crisis, Robert L. Santos of the U.S. Census Bureau, Brian Wieser of Madison and Wall, LLC and Andrea Zapata of Warner Bros. Discovery.
Member Only Access