Research

eBay switched off its brand search ads. Nothing happened.

Paid MediaAugust 28, 20265 min read

The paper we are reading

Free to read

Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment

Econometrica · 2015 · 83(1), 155-174

Blake, T., Nosko, C., Tadelis, S. (2015). Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment. Econometrica, 83(1), 155-174.

Paywalled at the publisher. A free earlier draft is available from NBER.

Free NBER working-paper version (earlier draft, not the published article).

DOI: 10.3982/ECTA12423

What they found

Ads bought against eBay’s own brand name produced no measurable short-term benefit. People searching for eBay went to eBay whether or not an ad was there. On non-brand keywords the picture was more mixed: new and infrequent users did respond, but the bulk of the spend landed on frequent users who were going to buy anyway, so average returns came out negative. Estimates from ordinary non-experimental analysis were many times larger than the experiment found.

How they tested it

They turned the ads off. A series of large-scale field experiments at eBay withheld paid search in some regions and not others, then compared outcomes. That is the difference that matters: rather than modelling what would have happened without the ads, they created a world without the ads and measured it.

What it does not show

It is eBay — one of the most recognised brands on the internet, with a direct-navigation audience and an established organic presence. A brand nobody searches for by name has nothing to cannibalise, so the brand-keyword result does not transfer to it. The measurement is short-term, so genuine long-run brand effects would not show up. It is a 2015 study of a search landscape that has changed considerably. And it is a marketplace, not a considered-purchase category with a long sales cycle.

Our reading

Why this one is on our site

We sell paid media. This is the most cited piece of evidence that a large share of paid media spend does nothing, and it comes from an experiment rather than an argument. Leaving it out of a page called Research would tell you everything about how seriously to take the rest of it.

The mechanism, in one line

Search ads are shown to people who are already searching. That is the whole point of the channel and also its central measurement problem: the ad gets credit for demand it did not create.

Brand keywords are the extreme case. Somebody typing your brand name has already decided. Buy the click and you have paid for a visit that was coming free.

What this does and does not say about your account

It does not say switch off brand search. It says the value of brand search is a real question with a testable answer, and that the answer is often much smaller than the platform reports. There are decent reasons to keep buying it — a competitor bidding on your name, control over the landing page, a thin organic listing. Those reasons are defensible. "It shows a 12x ROAS in the dashboard" is not, because that is the number the experiment showed to be an artefact.

It does not transfer to unknown brands. eBay's result depends on eBay being eBay. If nobody searches your name, there is no free traffic to cannibalise, and the calculation is different.

The non-brand finding is the underrated half. Most of the spend landed on people who were already customers. Not the same problem as brand cannibalisation, but the same shape: the channel is best at reaching people you had already reached.

The test, which almost nobody runs

Turn brand search off in one geography for a fortnight. Watch total orders, not paid orders. If total holds while paid falls, the paid number was moving from one column to another.

It costs a fortnight and it settles an argument that otherwise runs for years. In practice it is rarely run, and we understand why: it is a test where the agency can only lose. Ask anyway.

Ten years on

Search in 2026 is not search in 2015. Auctions are more automated, targeting is broadly worse to observe, and a growing share of queries never reach a results page at all because an AI answer intercepts them.

None of that undoes the finding. If anything, the drift toward automated bidding — where the system optimises toward conversions it is also crediting itself with — makes the underlying confusion harder to see, not easier.

The study above is the work of its authors and is not ours. The summary and commentary on this page are written by Big Bang Story and are our interpretation, not the authors’. We do not host copies of other people’s papers — read it at the source.

Ready when you are

Want this applied to your spend?

We read this so it changes what we do, not so it fills a slide. Start with a free audit, or tell us what you are trying to grow.