Agent skill · data analytics · aiskillstore
parquet-optimization
Proactively analyzes Parquet file operations and suggests optimization improvements for compression, encoding, row group sizing, and statistics. Activates when users are reading or writing Parquet files or discussing Parquet performance.
Why this skill is useful
Provides specific optimization patterns and configurations for Parquet file operations that the AI wouldn't reliably generate on its own.
What it needs
About 4k tokens when loaded. Last updated 2026-08-07. 405 stars on the source repository.
What this skill does
Parquet Optimization Skill You are an expert at optimizing Parquet file operations for performance and efficiency. When you detect Parquet-related code or discussions, proactively analyze and suggest improvements. When to Activate Activate this skill when you notice: Code using AsyncArrowWriter or ParquetRecordBatchStreamBuilder Discussion about Parquet file performance issues Users reading or writing Parquet files without optimization settings Mentions of slow Parquet queries or large file sizes Questions about compression, encoding, or row group sizing Optimization Checklist When you see Parquet operations, check for these optimizations: Writing Parquet Files 1. Compression Settings ✅ GOOD: Compression::ZSTD(ZstdLevel::trynew(3)?) ❌ BAD: No compression specified (uses default) 🔍 LOOK FOR: Missing .setcompression() in WriterProperties Suggestion template: 2. Row Group Sizing ✅ GOOD: 100MB - 1GB uncompressed (100000000 rows) ❌ BAD: Default or very small row groups 🔍 LOOK FOR: Missing .setmaxrowgroupsize() Suggestion template: 3. Statistics Enablement ✅ GOOD: .setstatisticsenabled(EnabledStatistics::Page) ❌ BAD: Statistics disabled 🔍 LOOK FOR: Missing statistics configuration Suggestion template: 4. Column-Specific Settings ✅ GOOD: Dictionary encoding for low-cardinality columns ❌ BAD: Same settings for all columns 🔍 LOOK FOR: No column-specific configurations Suggestion template: Reading Parquet Files 1. Column Projection ✅ GOOD: .withprojection(ProjectionMask::roots(...)) ❌ BAD: Reading all columns 🔍 LOOK FOR: Reading entire files when only some columns needed Suggestion template: 2. Batch Size Tuning ✅ GOOD: .withbatchsize(8192) for memory control ❌ BAD: Default batch size for large files 🔍 LOOK FOR: OOM errors or uncontrolled memory usage Suggestion template: 3. Row Group Filtering ✅ GOOD: Using statistics to filter row groups ❌ BAD: Reading all row groups 🔍 LOOK FOR: Missing row group filtering logic Suggestion template: 4. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aiskillstore/parquet-optimization