Agent skill · data analytics · aradotso
harvard-artifacts-etl-streamlit-app
Build ETL pipelines and analytics dashboards using Harvard Art Museums API with Python, SQL, and Streamlit
Why this skill is useful
Adds a complete ETL pipeline with executable scripts for data extraction, transformation, and loading into SQL, along with a Streamlit dashboard for visualization.
What it needs
Requires mysql-connector-python, plotly, streamlit installed locally. Requires harvard-art-museums account access. About 6k tokens when loaded. Last updated 2026-08-05. 5 stars on the source repository.
What this skill does
Harvard Artifacts ETL & Analytics App Skill by ara.so — Data Skills collection. This project is an end-to-end data engineering application that demonstrates real-world ETL pipelines using the Harvard Art Museums API. It extracts artifact data, transforms it into relational structures, loads it into SQL databases, and provides interactive analytics through a Streamlit dashboard. What This Project Does API Integration: Fetches artifact data from Harvard Art Museums API with pagination and rate limiting ETL Pipeline: Transforms nested JSON into normalized relational tables SQL Storage: Stores data in MySQL/TiDB with proper schema design Analytics: Executes 20+ predefined SQL queries for insights Visualization: Creates interactive dashboards with Plotly charts Installation Configuration API Key Setup Get your free API key from Harvard Art Museums API: Database Configuration Database Schema The application uses three main tables: Core ETL Pipeline Extract: Fetch Data from API Transform: Process JSON Data Load: Insert into SQL Database Streamlit Application Main App Structure Common Patterns Rate Limiting and Error Handling Incremental ETL Running the Application Troubleshooting API Key Issues Database Connection Issues Missing Data Fields Memory Issues with Large Datasets This skill enables AI agents to help developers build complete ETL pipelines with the Harvard Art Museums API, including data extraction, transformation, SQL storage, and interactive visualization dashboards.
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aradotso/harvard-artifacts-etl-streamlit-app