Agent skill · data analytics · aiskillstore
fiftyone-find-duplicates
Find duplicate or near-duplicate images in FiftyOne datasets using brain similarity computation. Use when users want to deduplicate datasets, find similar images, cluster visually similar content, or remove redundant samples. Requires FiftyOne MCP server with @voxel51/brain plugin installed.
Why this skill is useful
Adds specific commands and workflows for deduplicating images using FiftyOne's brain similarity operators, which are not commonly known.
What it needs
Requires fiftyone installed locally. About 4k tokens when loaded. Last updated 2026-08-07. 405 stars on the source repository.
What this skill does
Find Duplicates in FiftyOne Datasets Overview Find and remove duplicate or near-duplicate images using FiftyOne's brain similarity operators. Uses deep learning embeddings to identify visually similar images. Use this skill when: Removing duplicate images from datasets Finding near-duplicate images (similar but not identical) Clustering visually similar images Cleaning datasets before training Prerequisites FiftyOne MCP server installed and running @voxel51/brain plugin installed and enabled Dataset with image samples loaded in FiftyOne Key Directives ALWAYS follow these rules: 1. Set context first 2. Launch FiftyOne App Brain operators are delegated and require the app: Wait 5-10 seconds for initialization. 3. Discover operators dynamically 4. Compute embeddings before finding duplicates 5. Close app when done Complete Workflow Step 1: Setup Step 2: Verify Brain Plugin Step 3: Discover Brain Operators Step 4: Compute Similarity Step 5: Find Near Duplicates Threshold guidelines (distance-based, lower = more similar): 0.1 = Very similar (near-exact duplicates) 0.3 = Near duplicates (recommended default) 0.5 = Similar images 0.7 = Loosely similar This operator creates two saved views automatically: near duplicates: all samples that are near duplicates representatives of near duplicates: one representative from each group Step 6: View Duplicates in App After finding duplicates, use setview to display them in the FiftyOne App: Option A: Filter by neardupid field Option B: Show specific duplicate group Option C: Load saved view (if available) Option D: Clear filter to show all samples The findnearduplicates operator adds a neardupid field to samples. Samples with the same ID are duplicates of each other. Step 7: Delete Duplicates Option A: Use deduplicate operator (keeps one representative per group) Option B: Manual deletion from App UI 1. Use setview(exists=["neardupid"]) to show duplicates 2. Review samples in the App at http://localhost:5151/ 3. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aiskillstore/fiftyone-find-duplicates