optimisation

A/B Testing (Outbound)

Also called: Split Testing, A/B Test, Email Split Test

Definition

Running two variants of a message — different subject lines, opening lines, CTAs, or value propositions — simultaneously to identify which version performs better.

A/B testing in outbound means sending variant A of a sequence to one group of prospects and variant B to another, then comparing performance across open rate, reply rate, and meeting booked rate to determine which version wins.

The discipline matters because the “best” cold email is almost never obvious from first principles. What feels compelling to the person writing it often isn’t what resonates with the prospect receiving it. Systematic testing replaces instinct with data.

What to A/B test in outbound

Highest leverage tests (biggest impact on results):

  • Subject line: even small differences can move open rates 10–20 percentage points
  • Opening line: the first sentence drives the decision to keep reading
  • CTA: “book a call” vs “worth a quick chat?” vs “would it make sense to connect?”

Medium leverage:

  • Personalisation depth (light research vs deeper trigger-event personalisation)
  • Message length (3 paragraphs vs 5 lines)
  • Value proposition framing (outcome-focused vs pain-focused)

Testing requirements

A valid A/B test needs sufficient volume to reach statistical significance. With cold email reply rates of 3–8%, you typically need 100–200 contacts per variant before drawing conclusions. Running a test with 20 contacts per side produces noise, not insight.

Continuous optimisation

Top-performing outbound teams run permanent A/B tests — rotating a new variable every 2–4 weeks. Over 6–12 months, systematic testing compounds: each improvement builds on the last, producing sequences that are materially better than the original.

A/B test results feed into reply rate optimisation. Sequencing tools like Instantly, Lemlist, and Outreach have built-in split testing functionality.

Want help putting this into practice?

We build and run outbound systems for B2B companies — cold email, LinkedIn, and cold calling, engineered around your ICP.

Talk to Our Team