← Writing

When zero leads mean stop

The most expensive mistake in cheap demand testing is treating an empty inbox as an answer.

Someone sends 20 people to an offer page, collects nothing, and concludes the idea is dead. It is a tidy story. Most of the time, it is also wrong.

Say the idea truly converts at 5%, a strong rate for cold traffic. A short run can still produce zero leads. Here is how often:

VisitsChance of zero leads anyway
2036%
605%
1200.2%
191under 0.1%

At 20 visits, an offer that truly converts at the assumed rate still comes back empty better than a third of the time. That describes the sample, not the quality of the idea.

Two different sentences

“We found no evidence of demand” and “we found evidence of no demand” are not the same claim. After enough valid traffic, zero leads is a negative result; before then, it is only an absence of evidence.

Thin or failed delivery is no result. The code makes that call before the report is written, so you never read a verdict the traffic did not earn.

What to actually do with an empty run

  • Look further up the funnel. Click-through rate is measured on impressions, and impressions are cheap. A run too thin to judge conversion can still tell you clearly whether the message landed.
  • Check delivery before conclusions. If the ads barely spent, or reached the wrong geography, the experiment produced no result. That does not mean the idea failed.
  • Decide whether the answer is worth the money. Sometimes the honest read is “resolving this costs $400 and I'd rather spend it building”. That's a legitimate decision. It just isn't a finding.

The tools that hand you a confident “no demand” after twenty clicks aren't being rigorous. They're being fast, and hoping you don't check the arithmetic.

When zero leads mean stop | portaficta