Agent skill · marketing growth · aiskillstore
send-experiment-designer
Use when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email result statistically and practically material?"; produces a falsifiable hypothesis, one-variable-per-cell matrix, sample-size/MDE/duration/power plan, and an effect/uncertainty read from own ESP data. Applies only a precommitted owner-approved action rule; the helper never chooses a business action. Not for EQS/vetoes or writing the email. 邮件AB测试设计/多变量测试/发送时间测试/留出组/显著性判定
Why this skill is useful
Provides a structured framework for designing email experiments and analyzing statistical significance that the AI wouldn't reliably generate on its own.
What it needs
About 8k tokens when loaded. Last updated 2026-08-07. 405 stars on the source repository.
What this skill does
Send Experiment Designer Designs email experiments across four modes and reads them out: a falsifiable hypothesis, a variant matrix that isolates one variable per cell, a sample-size / minimum-detectable-effect / run-duration / power plan, and a documented effect/uncertainty read. It may apply an owner-approved precommitted action rule, but statistical output alone never chooses a business action. Mode set (pick one): Mode Isolated variable Primary metric ------ ------------------- ---------------- a-b one change — subject or preheader or CTA or creative open (subject) / click / CTOR (CTA/creative) multivariate 2+ factors crossed (e.g. subject × CTA), one variable per cell the goal metric, powered per cell send-time deploy hour/day; subject, segment, creative held constant same-window engagement (open/click) hold-out send vs no-send (randomized control receives nothing / current default) conversion or revenue-per-recipient (incremental lift) Default the mode from the request when it is unambiguous (e.g. "test two subject lines" → a-b, "best hour to send" → send-time, "measure incremental revenue" → hold-out); state the picked mode back and proceed. Scope guard: this skill owns email experiment design + the significance read only. It scores the SEND E (Engagement) lever as a test signal — it does not compute the profile-weighted EQS or run the S1/S2/N1/D1 vetoes (email-quality-auditor does), and it does not write the subject/preheader/body/CTA under test (email-creative-builder does). Design here, produce there, gate there. Quick Start Output: a test-design doc (mode, hypothesis, variant matrix, primary/secondary/guardrail metrics, sample size + MDE + duration + power) and/or a read-out (effect/interval, statistical and practical flags, guardrails, and either an owner-governed recommendation or decision: UNDECIDED). …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aiskillstore/send-experiment-designer