Agent skill · software engineering · aradotso
terraform-iac-data-engineering
Infrastructure-as-Code with Terraform for data engineering on AWS (S3, EC2, IAM)
Why this skill is useful
Provides specific Terraform patterns and commands for provisioning AWS resources tailored for data engineering workflows.
What it needs
Requires awscli, terraform installed locally. Requires aws account access. About 6k tokens when loaded. Last updated 2026-08-05. 5 stars on the source repository.
What this skill does
Terraform IaC for Data Engineering Skill by ara.so — Data Skills collection. This project provides Infrastructure-as-Code (IaC) patterns using Terraform specifically for data engineering workloads on AWS. It demonstrates how to provision and manage AWS resources (S3, EC2, IAM) needed for data pipelines and processing. What This Project Does Provisions AWS S3 buckets for data storage Creates EC2 instances for data processing workloads Manages IAM users, roles, and policies Demonstrates Terraform state management Provides reusable IaC patterns for data engineering infrastructure Installation Prerequisites 1. Terraform CLI 2. AWS CLI 3. Configure AWS CLI Project Setup Key Terraform Commands Initialize Terraform Plan and Apply Infrastructure Inspect Infrastructure Destroy Infrastructure Configuration Structure Basic Terraform Configuration for Data Engineering main.tf - Core infrastructure definition: variables.tf - Input variables: outputs.tf - Output values: terraform.tfvars - Variable values (gitignore this file): Common Data Engineering Patterns Multi-Environment Setup environments/dev/main.tf: environments/prod/main.tf: S3 Bucket with Lifecycle Policies VPC Setup for Data Processing Remote State Configuration backend.tf: Create state backend resources: Verification and Testing Verify S3 Bucket Creation Verify EC2 Instances Verify IAM Roles State Management Inspect State Import Existing Resources Move Resources in State Troubleshooting Common Issues Issue: Bucket name already exists Issue: AWS credentials not found Issue: State file locked Issue: Resource already exists Issue: Terraform version mismatch Debugging Validate and Format Best Practices 1. Always use variables for environment-specific values 2. Enable S3 versioning for state files and data buckets 3. Use remote state for team collaboration 4. Tag all resources with environment, project, and owner 5. Implement lifecycle policies for cost optimization 6. Use modules for reusable infrastructure patterns 7. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aradotso/terraform-iac-data-engineering