Agent skill · marketing growth · alirezarezvani
prompt-engineer-toolkit
Use when a marketing team's AI prompts need testing, versioning or governance, before shipping a prompt. A/B tests prompts against cases with prompt_tester.py and keeps diffed versions with prompt_versioner.py.
Why this skill is useful
Adds executable scripts for A/B testing and versioning of marketing prompts, which are not commonly found in public documentation.
What it needs
Requires python3 installed locally. About 3k tokens when loaded. Last updated 2026-08-05. 23,939 stars on the source repository.
What this skill does
Prompt Engineer Toolkit Overview Use this skill to move prompts from ad-hoc drafts to production assets with repeatable testing, versioning, and regression safety. It emphasizes measurable quality over intuition. Apply it when launching a new LLM feature that needs reliable outputs, when prompt quality degrades after model or instruction changes, when multiple team members edit prompts and need history/diffs, when you need evidence-based prompt choice for production rollout, or when you want consistent prompt governance across environments. Core Capabilities A/B prompt evaluation against structured test cases Quantitative scoring for adherence, relevance, and safety checks Prompt version tracking with immutable history and changelog Prompt diffs to review behavior-impacting edits Reusable prompt templates and selection guidance Regression-friendly workflows for model/prompt updates Key Workflows 1. Run Prompt A/B Test Prepare JSON test cases and run: Input can also come from stdin/--input JSON payload. 2. Choose Winner With Evidence The tester scores outputs per case and aggregates: expected content coverage forbidden content violations regex/format compliance output length sanity Use the higher-scoring prompt as candidate baseline, then run regression suite. 3. Version Prompts 4. Regression Loop 1. Store baseline version. 2. Propose prompt edits. 3. Re-run A/B test. 4. Promote only if score and safety constraints improve. Script Interfaces python3 scripts/prompttester.py --help Reads prompts/cases from stdin or --input Optional external runner command Emits text or JSON metrics python3 scripts/promptversioner.py --help Manages prompt history (add, list, diff, changelog) Stores metadata and content snapshots locally Pitfalls, Best Practices & Review Checklist Avoid these mistakes: 1. Picking prompts from single-case outputs — use a realistic, edge-case-rich test suite. 2. Changing prompt and model simultaneously — always isolate variables. 3. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills alirezarezvani/prompt-engineer-toolkit--47f276