Agent skill · marketing growth · aiskillstore
ad-test-designer
Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants — use ad-creative-builder; not for reading back one shipped change — use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试
Why this skill is useful
Provides a structured approach to designing A/B tests with specific statistical methodologies that the AI wouldn't reliably generate on its own.
What it needs
About 5k tokens when loaded. Last updated 2026-08-07. 405 stars on the source repository.
What this skill does
Ad Test Designer Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, effect size, uncertainty, practical-effect status, and guardrail state. This skill owns experiment design + statistical interpretation. It may apply an owner-approved, precommitted action rule, but it never treats a p-value or helper output as an automatic business decision. It does not produce variants (ad-creative-builder), read back one already-shipped change (paid-measurement-loop), or do cross-channel reporting (performance-analyzer). Quick Start Skill Contract Expected output: a test design (hypothesis, variant matrix, primary/secondary/guardrail metrics, sample-size + duration + power plan) and/or a read-out (effect estimate, interval, statistical flag, practical-effect flag, guardrails, and either an owner-governed recommendation or decision: UNDECIDED). Reads: what the user wants to test, the ROAS profile (direct-response prospecting incremental-profit), baseline CVR/CTR and traffic volume; for a read-out, the user's own exported results CSV (variant, sessions/impressions, conversions/clicks). Writes: a user-facing test-design or read-out doc plus a ### Handoff Summary. Promotes: the chosen hypothesis, design parameters, calculated read-out, and any explicitly owner-approved action (ask before writing memory). Done when: a falsifiable hypothesis is stated; the matrix isolates one variable per variant; baseline, MDE, alpha, power, multiplicity/sequential policy, duration, and guardrails are declared; and a read-out reports effect/interval/statistical/practical flags with Calculated provenance. Without a precommitted action rule and owner, return decision: UNDECIDED. Primary next skill: ad-creative-builder (to produce the winning direction) or paid-measurement-loop. Handoff Summary Emit the standard shape from skill-contract.md §Handoff Summary Format. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aiskillstore/ad-test-designer