Agent skill · data analytics · yonatangross
golden-dataset
Golden dataset lifecycle patterns for curation, versioning, quality validation, and CI integration. Use when building evaluation datasets, managing dataset versions, validating quality scores, or integrating golden tests into pipelines.
Why this skill is useful
Provides specific patterns and rules for managing and validating golden datasets that the AI wouldn't reliably generate on its own.
What it needs
About 4k tokens when loaded. Last updated 2026-08-06. 215 stars on the source repository.
What this skill does
Golden Dataset Comprehensive patterns for building, managing, and validating golden datasets for AI/ML evaluation. Each category has individual rule files in rules/ loaded on-demand. Quick Reference Category Rules Impact When to Use -------- ----- ------ ----------- Curation 2 HIGH Content collection, annotation pipelines Management 2 HIGH Versioning, backup/restore Validation 1 CRITICAL Regression testing Add Workflow 1 HIGH 9-phase curation, quality scoring, bias detection, silver-to-gold Total: 6 rules across 4 categories. House thresholds and scars: references/ork-delta.md. Curation Content collection, multi-agent annotation, and diversity analysis for golden datasets. Rule File Key Pattern ---- ---- ----------- Collection rules/curation-collection.md Content type classification, quality thresholds, duplicate prevention Annotation rules/curation-annotation.md Multi-agent pipeline, consensus aggregation, Langfuse tracing Difficulty ladder, coverage floors, and duplicate thresholds: references/ork-delta.md. Management Versioning, storage, and CI/CD automation for golden datasets. Rule File Key Pattern ---- ---- ----------- Versioning rules/management-versioning.md JSON backup format, embedding regeneration, disaster recovery Storage rules/management-storage.md Backup strategies, URL contract, data integrity checks CI automation for backups is upstream's job; see "Upstream coverage" below. Validation Quality scoring, drift detection, and regression testing for golden datasets. Rule File Key Pattern ---- ---- ----------- Regression rules/validation-regression.md Difficulty distribution, pre-commit hooks, full dataset validation Schema validation and duplicate detection are upstream's job (see "Upstream coverage" below); the house thresholds they must enforce live in references/ork-delta.md. Add Workflow Structured workflow for adding new documents to the golden dataset. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills yonatangross/golden-dataset--bde8e7