Research & Data Quality

Why Synthetic Respondents Flatten Consumer Sentiment

  • ARF; MSI; CIMM
  • Psychology of GenAI

A new ARF Psych of GenAI experiment reveals that large language models apply a rigid, rule-driven logic when evaluating privacy scenarios—even when humans typically shift their reasoning based on framing, emotion and social context. Unlike consumers, who blend intuition, feeling and social perspective into their judgments, GPT-4o relied on a single internal rule across all testing conditions: data use is acceptable only with explicit consent. This consistency offers value for certain analytic tasks but exposes limits for advertising research that depends on emotional nuance and context-sensitive consumer insight.

Member Only Access

Steering AI Bias: How Persona Prompts Unlock Nuance in Gen AI Responses

  • ARF
  • Psychology of GenAI

Large language models mirror human cognitive biases—but can those biases be guided? New ARF and MSI research reveals that while loss aversion remains deeply ingrained in AI responses, introducing persona information, such as demographics or personality traits, can increase variability and make outputs more nuanced. For advertisers and researchers, this opens the door to design strategic prompts that spark richer and more nuanced, human-like responses.

Member Only Access

Navigating Identity Loss: Measurement and Targeting in a Privacy-First Era

  • ARF
  • ARF Analytics Council

How is the loss of digital identifiers reshaping advertising research? This guide, by the ARF Analytics Council, offers advertising researchers a deep dive into the privacy-first landscape, covering regulatory impacts, measurement challenges and practical identity solutions—from synthetic IDs to advanced modeling—to enable successful targeting and attribution in a fragmented ecosystem.

Member Only Access

Testing AI’s Strategic IQ: Can Generative Models Think Like Top Executives?

  • ARF ORIGINAL RESEARCH
  • ARF

The ARF tested whether generative AI can adopt executive personas and provide credible, role-specific strategies. This experiment highlights how AI performs when “thinking like” organizational leaders, its limitations in institutional logic and feasibility, and how human-in-the-loop feedback can refine outputs and create nuanced and worthwhile results.

Member Only Access

When Language Becomes Targeting: How Gender Cues Shape AI Recommendations

  • ARF

As generative AI tools increasingly influence product discovery and decision-making, subtle cues in user language can shape what consumers are shown—and how options are framed. This research examines how implicit and explicit gender signals affect AI-generated product recommendations, revealing systematic differences in categories, brand repetition, descriptive language and price information. The findings raise important questions for advertisers and researchers about bias, brand visibility and the growing cultural role of AI in shaping consumer norms.

Member Only Access

When AI Takes the Survey: Evaluating LLMs as a New Tool for Consumer Insight

  • ARF
  • MSI

The study in this MSI working paper evaluates whether large language models (LLMs) can serve as a reliable source of consumer preference data—potentially transforming how market research is conducted. Using conjoint-style survey questions, the researchers compared LLM-generated choices with human responses to estimate willingness-to-pay (WTP) for a variety of product attributes. They find that LLMs often approximate human preferences surprisingly well, especially when fine-tuned with prior survey data, though important limitations remain. For marketers, the research highlights both the promise and the boundaries of using AI-generated insights to accelerate testing, concept screening and early-stage innovation work

Member Only Access

Analytics & Forecasting 2025

  • ARF
  • ARF

On September 29-30, the ARF and MSI co-produced the inaugural ANALYTICS & FORECASTING conference, exploring the evolving role of modeling in market research and forecasting, with a particular focus on the opportunities and limitations of synthetic data. Attendees engaged in critical discussions about the opportunities and limitations of modeling in market research applications and heard practical strategies and solutions from leading researchers and practitioners.

Member Only Access