Agent skill · data analytics · claude-office-skills

ETL Pipeline

Design and automate Extract, Transform, Load data pipelines for data integration and analytics

Why this skill is useful

Adds executable scripts for data extraction, transformation, and loading from various sources that aren't in public documentation.

What it needs

Requires bigquery, mongodb, mysql, postgresql, snowflake installed locally. Requires salesforce, stripe account access. About 4k tokens when loaded. Last updated 2026-01-31. 363 stars on the source repository.

What this skill does

ETL Pipeline Comprehensive skill for designing and automating Extract, Transform, Load data pipelines. Pipeline Architecture Core ETL Flow Source Connectors Database Connections API Sources Transformation Layer Common Transformations Aggregation Rules Join Operations Load Strategies BigQuery Load Snowflake Load Pipeline Orchestration DAG Definition Error Handling Data Quality Validation Rules Quality Metrics Dashboard Monitoring & Alerting Pipeline Metrics Alert Configuration Best Practices 1. Incremental Loading: Use incremental extraction when possible 2. Idempotency: Ensure pipelines can be re-run safely 3. Partitioning: Partition large tables by date 4. Monitoring: Track pipeline health metrics 5. Documentation: Document all transformations 6. Testing: Test with sample data before production 7. Version Control: Track pipeline changes in git

How to use it

Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:

@skills claude-office-skills/etl-pipeline

View the source on GitHub

Browse the @skills marketplace