The advertising industry has long held a comfortable belief about generative AI: the visuals are striking, sure, but when real money is on the line, human designers still win on brand discipline and taste. A field study released by INFORMS, the Institute for Operations Research and the Management Sciences, delivers a data point against that belief: in a live Instagram campaign, an AI-generated ad portfolio beat the human-designed one on click-through rate — and the advantage was still there 18 months later.
How the study was run
The researchers skipped lab simulations and plugged directly into a real campaign for an outdoor-activities company. They deployed an active-learning engine to generate background images promoting nature exploration, learning online as the campaign ran, with the twin goals of surfacing high-performing AI images while keeping them on-brand and effective. The comparison group was not a historical archive but the company's contemporary, professionally designed human campaign — which makes the contest much closer to "AI system vs design team" in real conditions.
The 18-month retest
The more telling part came later. Eighteen months after the original run, during a high-stakes booking season and without any model retraining, the team brought the AI portfolio back and compared it against the company's then-current human-designed campaign. The AI portfolio achieved a mean click-through rate of 3.38% versus 3.24% for the human campaign, again with lower variance — meaning it wasn't just higher on average, but more consistent. In an industry where creative fatigue is the norm, an unrefreshed AI portfolio outperforming contemporary human work 18 months on is arguably more interesting than the initial win.
Read the headline with a discount
To be clear, 3.38% versus 3.24% is a 0.14-percentage-point gap. In absolute terms, this is far less dramatic than the "Dramatically Outperform" phrasing in the press release headline — press releases are written for distribution, and judgment should rest on the numbers. The other caveats matter too: this is a single company, a single platform, and a single category, so generalizing to the entire ad industry deserves caution. And note what actually did the winning: the engine's ability to learn online from live campaign data, not the static quality of any single generated image. What likely won was not "AI taste" but the speed of the feedback loop — a human design iteration takes days, an active-learning iteration takes hours, and that compounding edge eventually shows up in CTR.
What it means for generative models in production
For the application side of image-generation models, the study carries two implications. First, the commercial value of generative models may lie less in "drawing one picture for a designer" and more in automated creative optimization once the model is coupled with a live feedback loop — high-iteration, low-per-image-value formats like Instagram backgrounds are exactly where this logic thrives. Second, it offers a harder evaluation standard for AI-generated content quality: not whether it looks good in a blind human rating, but whether it converts under real traffic. Notably, a separate recent study by Taboola with Columbia University used a "sibling ads" pairing method — matched pairs of AI-generated and human-made ads from the same advertiser, same campaign, same day — and reached a compatible conclusion: AI creative can now stand toe-to-toe with human work. A slice of the advertising industry is quietly turning from a "creative business" into an "optimization problem."
One study doesn't remake an industry, but its method is worth remembering: put AI and humans on the same battlefield, under the same traffic, on the same timeline, and let them fight for real. If you're still using "AI images aren't polished enough" as the reason not to experiment, consider this — in performance advertising, the judge has never been polish. It's the data. (Study details: https://www.informs.org/News-Room/INFORMS-Releases/News-Releases/AI-Generated-Ads-Dramatically-Outperform-Human-Designers-in-Live-Campaign)