Pest Control Email A/B/C Test — Experiment Hub

What This Was

A blind ranked-choice comparison of 3 cold email drafts — draft (Golden 4-Sentence Framework), revised (rubric-critique rewrite), and copywriter (10 distinct copy strategies) — tested across 10 email groups covering different hooks and angles for the pest-control-spring-2026 campaign. Two panels judged independently: 5 gatekeeper personas (business consultants/advisors) and 3 pest control owner-operators (Mike Deluca / Ohio / 12 trucks, Sandra Kowalski / Texas / 8 trucks, Ray Tanner / Georgia / 7 trucks). Results were compiled 2026-03-14.

Key Numbers

Emails compared: 30 (10 groups × 3 versions)
Judges: 5 gatekeepers + 3 owner personas = 8 total
Gatekeeper accuracy: 60% (6/10 groups correctly predicted owner preference)
Overall winner: Revised (175 weighted points across all judges — 108 GK + 67 owner)
Runner-up: Copywriter (163 total — 99 GK + 64 owner)
Draft: distant third (142 total — 93 GK + 49 owner)
Unanimous sweeps: 2 — Group 3 Revised (wasp nest Saturday), Group 7 Copywriter (Scenario A vs. B)
Owner unanimous groups: 5 of 10 (groups 2, 3, 5, 7, 8)

Executive Findings

Revised wins overall but copywriter leads in raw first-place owner votes (15 vs 13) — revised's consistency across more groups pushed the weighted score higher; copywriter is high-variance (dominant when it works, last-place when it doesn't).
Gatekeepers are a useful but incomplete proxy at 60% accuracy — they reliably catch obvious losers (ROI math, review-shaming, escape hatches) but cannot predict which of two strong versions will resonate with a specific operator profile.
Core gatekeeper blind spot: they over-index on research signals and analytical depth vs. emotional recognition — in Group 8, gatekeepers ranked the GorillaDesk/P&L email first; all three owners unanimously chose the one-sentence Saturday text scenario.
Owners reject fabricated revenue math universally — the $136,500 ROI projection (Group 5 copywriter) earned zero second-place votes from any owner; no ROI projections belong in Email 1.
Review-shaming openers trigger defensive shutdown, not curiosity — any opener framed as "I noticed something wrong with your business" lost to scenario-based openers regardless of how it was softened.
Two unanimous sweeps emerged — Group 3 Revised (wasp-nest Saturday scenario + Driven Results citation) swept both panels; Group 7 Copywriter (Scenario A vs. B two-format structure) earned identical positive reactions from all three owner personas across different profiles.
The LSA-anchor version (Group 4) requires audience segmentation — strong for paid-acquisition operators (owners 1 and 2), immediately rejected by referral-only operator (owner 3) from sentence one; do not use as default for mixed lists.
5 emails recommended for live sequence — covering weekend call capture, speed-to-lead, voicemail reframe, after-hours scenario, and termite-season urgency; together they represent the clearest consensus across both panels.

5 Recommended Emails for Live Sequence

Priority	Group	Version	Hook
1	Group 3	Revised	Saturday wasp nest scenario
2	Group 7	Copywriter	Scenario A vs. B two-format
3	Group 9	Revised	"Lead disappearance problem" reframe
4	Group 2	Copywriter	Bed bugs at 11pm scenario
5	Group 5	Revised	Termite LTV urgency ("first callback wins")

Structural Patterns to Adopt

Two-scenario contrast format (Group 7): "Scenario A: [current]. Scenario B: [proposed]. Same [situation]. Completely different outcome." — the only format to earn identical reactions from all 3 owner personas.
Scenario first, stat second: open with a specific named operational moment the owner recognizes; follow with a verifiable citation to prove the point.
Reframe before solution: "That's not a voicemail problem. It's a lead disappearance problem." creates a named mental category that stops owners mid-read.
Single closing question with an honest out: "Have you managed to stay ahead of it?" outperforms closes that imply the problem is certain.

Patterns to Retire

Fabricated revenue math in Email 1 (no baselines, no LTV multiplication before engagement)
Review-shaming openers ("I noticed your reviews show X")
Escape-hatch closes ("or are you not running paid ads right now?")
Guessed specificity (truck-count assumptions, coverage-area merge tokens)
Self-aware meta-openers ("You probably get emails like this. I'm not doing that.") — experienced operators recognize it as a trope

2026-03-14-pest-control-email-a-b-c-test-per-group-copy-and-scores — Full email copy + scores for all 10 groups
2026-03-14-what-pest-control-owners-respond-to-and-reject-in-cold-email — Owner psychology guide + copy rubric input
2026-03-14-blind-email-a-b-c-test-experiment-methodology-and-replication-guide — How to replicate this experiment

Campaign Files

Local experiment artifacts (may be archived/deleted after vault notes are saved): go-to-market/campaigns/pest-control-spring-2026/experiments/email-version-comparison/

Email sequence files:

sequences/v4-golden-framework-draft.md
sequences/v4-golden-framework-revised.md
sequences/v4-copywriter-draft.md

5.5 KiB Raw Blame History Unescape Escape