75 lines
5.5 KiB
Markdown
75 lines
5.5 KiB
Markdown
---
|
||
source: "niche-automation-prospecting"
|
||
date: "2026-03-14"
|
||
tags: [research, cold-email, pest-control, pest-control-spring-2026, copy-testing, ab-test, hub]
|
||
---
|
||
|
||
# Pest Control Email A/B/C Test — Experiment Hub
|
||
|
||
## What This Was
|
||
|
||
A blind ranked-choice comparison of 3 cold email drafts — draft (Golden 4-Sentence Framework), revised (rubric-critique rewrite), and copywriter (10 distinct copy strategies) — tested across 10 email groups covering different hooks and angles for the pest-control-spring-2026 campaign. Two panels judged independently: 5 gatekeeper personas (business consultants/advisors) and 3 pest control owner-operators (Mike Deluca / Ohio / 12 trucks, Sandra Kowalski / Texas / 8 trucks, Ray Tanner / Georgia / 7 trucks). Results were compiled 2026-03-14.
|
||
|
||
## Key Numbers
|
||
|
||
- Emails compared: 30 (10 groups × 3 versions)
|
||
- Judges: 5 gatekeepers + 3 owner personas = 8 total
|
||
- Gatekeeper accuracy: 60% (6/10 groups correctly predicted owner preference)
|
||
- Overall winner: Revised (175 weighted points across all judges — 108 GK + 67 owner)
|
||
- Runner-up: Copywriter (163 total — 99 GK + 64 owner)
|
||
- Draft: distant third (142 total — 93 GK + 49 owner)
|
||
- Unanimous sweeps: 2 — Group 3 Revised (wasp nest Saturday), Group 7 Copywriter (Scenario A vs. B)
|
||
- Owner unanimous groups: 5 of 10 (groups 2, 3, 5, 7, 8)
|
||
|
||
## Executive Findings
|
||
|
||
- **Revised wins overall but copywriter leads in raw first-place owner votes (15 vs 13)** — revised's consistency across more groups pushed the weighted score higher; copywriter is high-variance (dominant when it works, last-place when it doesn't).
|
||
- **Gatekeepers are a useful but incomplete proxy at 60% accuracy** — they reliably catch obvious losers (ROI math, review-shaming, escape hatches) but cannot predict which of two strong versions will resonate with a specific operator profile.
|
||
- **Core gatekeeper blind spot: they over-index on research signals and analytical depth vs. emotional recognition** — in Group 8, gatekeepers ranked the GorillaDesk/P&L email first; all three owners unanimously chose the one-sentence Saturday text scenario.
|
||
- **Owners reject fabricated revenue math universally** — the $136,500 ROI projection (Group 5 copywriter) earned zero second-place votes from any owner; no ROI projections belong in Email 1.
|
||
- **Review-shaming openers trigger defensive shutdown, not curiosity** — any opener framed as "I noticed something wrong with your business" lost to scenario-based openers regardless of how it was softened.
|
||
- **Two unanimous sweeps emerged** — Group 3 Revised (wasp-nest Saturday scenario + Driven Results citation) swept both panels; Group 7 Copywriter (Scenario A vs. B two-format structure) earned identical positive reactions from all three owner personas across different profiles.
|
||
- **The LSA-anchor version (Group 4) requires audience segmentation** — strong for paid-acquisition operators (owners 1 and 2), immediately rejected by referral-only operator (owner 3) from sentence one; do not use as default for mixed lists.
|
||
- **5 emails recommended for live sequence** — covering weekend call capture, speed-to-lead, voicemail reframe, after-hours scenario, and termite-season urgency; together they represent the clearest consensus across both panels.
|
||
|
||
## 5 Recommended Emails for Live Sequence
|
||
|
||
| Priority | Group | Version | Hook |
|
||
|---|---|---|---|
|
||
| 1 | Group 3 | Revised | Saturday wasp nest scenario |
|
||
| 2 | Group 7 | Copywriter | Scenario A vs. B two-format |
|
||
| 3 | Group 9 | Revised | "Lead disappearance problem" reframe |
|
||
| 4 | Group 2 | Copywriter | Bed bugs at 11pm scenario |
|
||
| 5 | Group 5 | Revised | Termite LTV urgency ("first callback wins") |
|
||
|
||
## Structural Patterns to Adopt
|
||
|
||
- **Two-scenario contrast format** (Group 7): "Scenario A: [current]. Scenario B: [proposed]. Same [situation]. Completely different outcome." — the only format to earn identical reactions from all 3 owner personas.
|
||
- **Scenario first, stat second**: open with a specific named operational moment the owner recognizes; follow with a verifiable citation to prove the point.
|
||
- **Reframe before solution**: "That's not a voicemail problem. It's a lead disappearance problem." creates a named mental category that stops owners mid-read.
|
||
- **Single closing question with an honest out**: "Have you managed to stay ahead of it?" outperforms closes that imply the problem is certain.
|
||
|
||
## Patterns to Retire
|
||
|
||
- Fabricated revenue math in Email 1 (no baselines, no LTV multiplication before engagement)
|
||
- Review-shaming openers ("I noticed your reviews show X")
|
||
- Escape-hatch closes ("or are you not running paid ads right now?")
|
||
- Guessed specificity (truck-count assumptions, coverage-area merge tokens)
|
||
- Self-aware meta-openers ("You probably get emails like this. I'm not doing that.") — experienced operators recognize it as a trope
|
||
|
||
## Related Notes
|
||
|
||
- [[2026-03-14-pest-control-email-a-b-c-test-per-group-copy-and-scores]] — Full email copy + scores for all 10 groups
|
||
- [[2026-03-14-what-pest-control-owners-respond-to-and-reject-in-cold-email]] — Owner psychology guide + copy rubric input
|
||
- [[2026-03-14-blind-email-a-b-c-test-experiment-methodology-and-replication-guide]] — How to replicate this experiment
|
||
|
||
## Campaign Files
|
||
|
||
Local experiment artifacts (may be archived/deleted after vault notes are saved):
|
||
`go-to-market/campaigns/pest-control-spring-2026/experiments/email-version-comparison/`
|
||
|
||
Email sequence files:
|
||
- `sequences/v4-golden-framework-draft.md`
|
||
- `sequences/v4-golden-framework-revised.md`
|
||
- `sequences/v4-copywriter-draft.md`
|