Research & Data Quality

ARF Attention Measurement Validation Initiative: Phase 2 Report

  • ARF ORIGINAL RESEARCH

Explore the latest findings from the ARF Attention Measurement Validation Initiative. The phase two report is a comprehensive examination of various attention measurement methods used in creative testing. It concludes with reflections on the challenges of attention measurement, as well as some suggestions for advertisers on how to choose and evaluate attention measurement providers.

Member Only Access

Future-Proofing the Analytics and Insights Function

  • By Chenyu Wang
  • ANALYTICS COUNCIL

On February 6, Analytics Council Organizational Working Group members Shelley Yang (Director, Insights Activation at Ipsos Creative Excellence) and John Baro (Manager, Market Research & Insights at Spectrum Reach) shared a summary of their learnings from a set of 21 in-depth interviews (IDIs) conducted with ARF members to understand what insights and analytics departments should do to future-proof themselves. Then, a panel of senior researchers -- Helen Katz (EVP, Research at Publicis Media), Michelle Gibb (Vice President, Global Insights & Analytics at Mondelez International), and Jed Meyer (SVP, Media Solutions Leader of Kantar) -- and an industry observer, Simon Chadwick (Managing Partner at Cambiar LLC) joined Shelley to share their perspectives on the topic.  Their conversation was moderated by Steven Millman, Global Head of Research & Data Science at Dynata.  The presentations and panel touched on AI, outsourcing, skill sets, and mindsets.

Member Only Access

Minimizing Risk and Inspiring Innovation When Using GenAI and LLMs

Generative AI (GenAI) and Large Language Models (LLMs) have reached a point in their development where they have become tools so powerful, they will quickly become too important to ignore. Proper use can drive greater efficiency, productivity, better automation and even become new revenue drivers, according to this concise, how-to guide written by Steven Millman, ARF board member and Global Head of Research & Data Science at Dynata. It describes best practices and potential pitfalls in data privacy and security, protecting IP, oversight and more.

Member Only Access

Cross-Platform Measurement Options from an Agency Perspective

Audience measurement is changing at an unprecedented rate. Concurrently, identifiers such as cookies are fading, and traditional models and incumbent suppliers are being questioned. In reaction to all these happenings, new measurement initiatives and a new Joint Industry Committee (JIC) have risen to establish a path toward a new video measurement framework. In 2023, the Online-Offline Metrics Working Group, within the ARF Cross-Platform Measurement Council, conducted anonymous, in-depth-interviews (IDIs) with eight key decision-makers from major agency holding companies. The IDIs focused on three major issues involving the metric situation confronting the advertising industry. This report summarizes the learnings from those interviews.

Member Only Access

How to Calculate Reach and Frequency Using Virtual IDs (VIDs)

Current existing methods used to calculate reach and frequency of a campaign or media schedule are known to have deficiencies in measuring cross-device ad exposure. Restrictions to protect digital privacy complicate cross-platform exposure measurement even further. Multiple global research organizations have turned to a concept known as “virtual people,” to overcome these limitations in order to produce aggregate reach and frequency estimates. This report by the ARF Analytics Council provides a foundational overview of VIDs for a broad audience, providing ARF members with a stronger understanding of this vital topic.

Member Only Access

Next Generation Artificial Intelligence

  • TOWN HALL

Professor Russ Newman of New York University does not believe that AI will cause humanity’s extinction. Instead, it should help enhance human intelligence and productivity and our quality of life. After putting the AI revolution into historical context, Prof. Newman discussed aligning AI with human values. At our current stage, he believes the regulatory mechanisms in place are sufficient. He explained how large language models work, what allowed them to come into existence and their future impact, describing the effect on marketing and advertising, as well as what the individual user experience will be like. A democratizing, hyper-personalized experience could take place where AI agents advocate on their owner’s behalf and negotiate each transaction with their owner’s preferences in mind. Over time, he sees a great diversification of models coming into being. Historically speaking, each groundbreaking technology that changed the world has been a net gain for humanity. What makes AI different is that if applied correctly, it could make us smarter. The question is, if AI gives us exceptional advice, will we take it?

Member Only Access

The ARF Handbook for Using AI in Advertising Research

Significant developments in AI have occurred in the last two years, allowing it to be used in various places in the advertising industry. One area that has received little attention however is advertising research. Recognizing this, the ARF has conducted a significant number of its own research. The product of this effort is an AI handbook that offers practical advice in several key aspects of using AI for advertising research. Moreover, an interactive function allows experts to leave comments that, once verified, will be integrated into the report, making it a living, breathing document that continues to evolve as AI advances.

Member Only Access

MSI Blue Ribbon Report Preview Charts the Future of MMM

  • MSI

The practice of marketing mixed modeling (MMM) is increasing, research finds, partially because of the implementation of privacy restrictions. Today, finding appropriate providers to optimize marketing investments remains challenging. This was the impetus behind the Marketing Science Institute (MSI)’s Blue Ribbon Report on MMM. This free preview of the full white paper outlines what best practices to employ in a rapidly changing landscape. It identifies challenges for MMM veterans and ways to meet them. It also introduces executives to the opportunities that exist when introducing MMM into their firm. The report preview provides a brief overview of the top-level findings found in the full report, which is only available to MSI members.

Member Only Access