Agent skill · research science · davila7
zarr-python
Chunked N-D arrays for cloud storage. Compressed arrays, parallel I/O, S3/GCS integration, NumPy/Dask/Xarray compatible, for large-scale scientific computing pipelines.
Why this skill is useful
Provides domain-specific knowledge on chunking strategies and integration with cloud storage that the AI wouldn't reliably generate on its own.
What it needs
Requires gcsfs, s3fs, zarr installed locally. About 10k tokens when loaded. Last updated 2026-08-06. 30,138 stars on the source repository.
What this skill does
Zarr Python Overview Zarr is a Python library for storing large N-dimensional arrays with chunking and compression. Apply this skill for efficient parallel I/O, cloud-native workflows, and seamless integration with NumPy, Dask, and Xarray. Quick Start Installation Requires Python 3.11+. For cloud storage support, install additional packages: Basic Array Creation Core Operations Creating Arrays Zarr provides multiple convenience functions for array creation: Opening Existing Arrays Reading and Writing Data Zarr arrays support NumPy-like indexing: Resizing and Appending Chunking Strategies Chunking is critical for performance. Choose chunk sizes and shapes based on access patterns. Chunk Size Guidelines Minimum chunk size: 1 MB recommended for optimal performance Balance: Larger chunks = fewer metadata operations; smaller chunks = better parallel access Memory consideration: Entire chunks must fit in memory during compression Aligning Chunks with Access Patterns Critical: Chunk shape dramatically affects performance based on how data is accessed. Performance example: For a (200, 200, 200) array, reading along the first dimension: Using chunks (1, 200, 200): ~107ms Using chunks (200, 200, 1): ~1.65ms (65× faster!) Sharding for Large-Scale Storage When arrays have millions of small chunks, use sharding to group chunks into larger storage objects: Benefits: Reduces file system overhead from millions of small files Improves cloud storage performance (fewer object requests) Prevents filesystem block size waste Important: Entire shards must fit in memory before writing. Compression Zarr applies compression per chunk to reduce storage while maintaining fast access. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills davila7/zarr-python