How To Measure Attention: The ARF’s Three-Part Validation Initiative

So while attention measurement can sometimes sound like a new discipline the underlying idea is not new at all What is new is the quality scale and variety of methods now available to measure itIn recent years as a wave of attention measurement companies have entered the market with new approaches and solutions the ARF has been a steady supporter In the early 2020s the ARF hosted and promoted The Attention Council which Adelaide cofounded in 2019 alongside fellow measurement firms In 2024 The Attention Council became part of CIMM the ARFamp8217s measurement subsidiary where it now operates as the industryamp8217s main subjectmatter working group The ARF has also featured research from several attention measurement companies including Adelaide across its conferences and eventsIn 2022 responding to growing market interest the ARF launched its Attention Measurement Validation Initiative a threephase multiyear effort to describe test and quantify attention measurement with the highest degree of scholarly rigor That initiative has now concluded with the publication of the Phase 3 report which focuses on media attentionTaken together the three phases give the industry a useful framework for understanding where attention measurement is the strongest where it is still developing and how marketers should apply it in practicePhase 1 initiated in 2022 mapped the attention measurement landscape The report described 29 providers and found wide variation in how they defined attention what methods they used to measure it and what data sources they relied on One important distinction was that providers could be roughly sorted into two groups those that measure the attention a creative asset earns and those that measure the attention a media environment earns That distinction matters because creative and media both influence an adamp8217s ability to capture and hold attention but their roles in that process are differentPhase 2 published in 2024 focused on creative attention measurement A dozen providers scored the same set of ads and the ARF assessed whether their findings agreed The results were inconclusive not because the work lacked rigor but because amp8220attentionamp8221 to a piece of creative can mean genuinely different things depending on what is being measured and how One method studies visual focus another studies emotional response a third studies memory encoding These are all real signals but they donamp8217t necessarily resolve into one common verdict on a given execution Creative attention is hard to standardize and the ARFamp8217s Phase 2 report was candid about thatSince then the market has largely settled on a practical view that different creative attention measurement methods serve different needs customers and use cases A variety of approaches appears to be working well for all parties and there has not been a strong push toward standardizing creative attention around a single metric or methodPhase 3 published this year turned to media attention measurement and tested it in the field The study followed four live national campaigns across four advertiser categories Each campaign was measured inflight by up to seven independent providers eight providers participated across the full study though not every provider measured every channelAt the channel level the findings were strikingly consistent Despite using different methods providers generally agreed that television and online video drew more attention than social channels When independent media measurement providers leveraging different methods arrive at the same answer that answer is typically understood as a more reliable characterization of something real about the medium rather than something idiosyncratic about the measurement methodThat finding is meaningful because it suggests that media attention can be measured consistently enough to inform planning comparison and decisionmakingBut Phase 3 was also clear about attention measurementamp8217s limits The channels with the highest attention did not always produce the strongest brand lift and channels with more modest attention sometimes did That does not invalidate attention measurement it reinforces the fact that attention is one input in media planning and evaluationMedia weight reach targeting and frequency all need to work alongside attention in a campaign A highattention placement with little investment behind it can be outperformed by a lowerattention placement that receives significant supportThe Phase 3 report closes with five recommendations for marketersUnderstand what an attention metric actually measures before using it Some methods estimate the probability that an ad is noticed others capture visual focus cognitive engagement or emotional response Marketers should ask any provider what their metric captures where its limits lie and whether it comes with guidance they can act onAsk for historical platform norms not just raw scores Different platforms generate different baseline levels of attention so a number only becomes meaningful when marketers understand what is typical for that placement or environmentKeep the measurement approach consistent across campaigns Because each method captures something distinct holding one framework steady helps marketers distinguish a real change in performance from a change in methodUse judgment for the most granular decisions Attention is clearest at the broad channel level The more granular the optimization the more it should be paired with experience and contextUse attention alongside media weight reach and frequency Attention describes the conditions an ad meets not the outcome it will produce When attention and lift diverge marketers should examine creative targeting design and investment weight before concluding the attention score is wrongAt Adelaide we read these recommendations as a fair description of how good media attention measurement should work Candidly they also closely reflect how we have tried to build our solutionAdelaide measures media quality using attentionbased data Our metric AU estimates the probability that an ad placement will capture attention It is trained on real outcomes and reported against norms so a score can be read in context AU is a comparable metric across 19 channels and is designed to accompany reach frequency and other planning inputsThe ARFamp8217s Phase 3 guidance and Adelaideamp8217s approach point in the same direction which is a good place for a measurement company to find itselfThe larger lesson of the ARF Attention Measurement Validation Initiative is that attention is not magic and it is not a single portable number that answers every question But it can be a dependable compass for media decisionmaking when it is measured consistently read against norms and used alongside the other levers of a campaignFour years of careful work by the ARF have brought muchneeded discipline to attention measurement and how the industry discusses evaluates and applies itWe thank the leaders of the ARF Attention Measurement Validation Initiative Chief Research Officer Paul Donato and Senior Director Research ampamp Insights Tracy Adams for their work as well as ARF CEO Scott McDonald for his support of the projectPosted at MediaVillage through the Thought Leadership selfpublishing platformClick the social buttons to share this story with colleagues and friendsThe opinions expressed here are the author39s views and do not necessarily represent the views of MediaVillageorgMyersBizNet

Become a Thought Leader. Share your thought leadership article with industry professionals & have them archived in Thought Leadership

How To Measure Attention: The ARF’s Three-Part Validation Initiative

Author

Publish date

Channel

Claire Browne

Lead Human: Paul Polman’s Leadership Lessons and Legacy - By Jack Myers

More Videos:

Become a Thought Leader. Share your thought leadership article with industry professionals & have them archived in Thought Leadership

How To Measure Attention: The ARF’s Three-Part Validation Initiative

Enjoying This Commentary? There's More to Love

Claire Browne

Lead Human: Paul Polman’s Leadership Lessons and Legacy - By Jack Myers

The payment was successful

Cookies