Agent skill · data analytics · supermemoryai
memorybench
memorybench — an agent skill for coding agents.
Why this skill is useful
Adds an automated benchmarking script that integrates custom memory implementations with competitor systems, providing performance metrics not easily accessible otherwise.
What it needs
Requires bun installed locally. Requires openai account access. About 6k tokens when loaded. Last updated 2026-05-19. 92 stars on the source repository.
What this skill does
MemoryBench Integration Skill Automatically benchmark your custom memory implementation against established systems like Supermemory, Mem0, and Zep. What This Skill Does When you invoke this skill from your project, it handles the complete benchmarking process end-to-end: 1. Asks you 5 questions about your setup preferences 2. Analyzes your memory code to understand how it works 3. Generates integration code automatically 4. Runs the full benchmark comparing your system to competitors 5. Shows you the results with clear performance comparisons No manual commands needed - everything runs automatically from start to finish. When to Use This Skill Use this skill when you: Built a custom memory/context system and want to see how it performs Need objective metrics comparing your implementation to industry solutions Want to benchmark on standardized datasets (conversational memory, RAG, dialogue) Are considering which memory system to use and want data-driven comparison How It Works The 7 Automated Phases Phase 1: Setup Clones memorybench from https://github.com/supermemoryai/memorybench into your project (./memorybench) Installs dependencies with bun Verifies environment is ready Phase 2: Discovery Uses AI agents to analyze your memory codebase Identifies initialization, ingestion, and search methods Detects required configuration and API keys Understands your data formats Phase 3: Code Generation Creates a provider adapter implementing the MemoryBench interface Copies and adapts your memory code into the provider Generates custom prompts if needed for your result format See Provider Template Reference Phase 4: Registration Updates src/types/provider.ts with your provider name Registers provider in src/providers/index.ts Adds configuration in src/utils/config.ts Documents environment variables Phase 5: Configuration Creates .env.local with required API keys Asks for your provider credentials Asks for comparison provider keys (if selected) Asks for OpenAI/Anthropic key fo …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills supermemoryai/memorybench