Agent skill · software engineering · jeremylongshore
anth-ci-integration
Configure CI/CD pipelines for Anthropic Claude API integrations.
Why this skill is useful
Adds a complete CI/CD pipeline configuration with executable scripts for testing Claude API integrations that aren't available in public documentation.
What it needs
Requires pytest, python installed locally. Requires anthropic, github account access. About 3k tokens when loaded. Last updated 2026-08-07. 2,604 stars on the source repository.
What this skill does
Anthropic CI Integration Overview Set up CI/CD pipelines that validate Claude API integrations with mock-based unit tests (free, fast) and prompt regression tests (live API, gated to main). Prerequisites Create a dedicated ANTHROPICAPIKEY repository secret with a spend limit that is appropriate for test traffic. Keep unit fixtures independent of that secret; only the protected prompt-regression job should call the API. Install Python 3.12, pytest, and the Anthropic SDK in the test environment, and decide which branch is allowed to incur live-test cost before enabling the workflow. Instructions 1. Put deterministic request-shaping and tool-routing assertions in tests/unit/ and mock anthropic.Anthropic there. 2. Put a small, representative set of API-backed prompt checks in tests/promptregression/; make them skip cleanly when the secret is absent. 3. Run unit tests on every push and pull request. Gate the live job to main (or an equivalent protected release branch) and inject the secret only into that job. 4. Set explicit timeouts, concurrency limits, and a cost ceiling. Fail the pipeline with a clear message when the ceiling is exceeded so an incident cannot silently consume the test budget. GitHub Actions Workflow Mock-Based Unit Tests Prompt Regression Tests CI Cost Guard Error Handling CI Issue Cause Fix ---------- ------- ----- Flaky prompt tests Non-deterministic output Use temperature: 0, check patterns not exact strings 429 in CI Parallel jobs sharing key Use separate CI key Secret not found Missing GitHub secret Add ANTHROPICAPIKEY in repo Settings > Secrets Output The pipeline produces a fast unit-test result for every change and, on the allowed branch, a separate prompt-regression result. The latter is either a pass with the tested prompt assertions, a deliberate skip when no key is available, or an actionable failure that identifies a timeout, rate limit, response-contract regression, or cost-guard breach. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills jeremylongshore/anth-ci-integration