Agent skill · software engineering · aradotso
freellmapi-proxy
OpenAI-compatible proxy aggregating 14 free-tier LLM providers with automatic failover and per-key rate tracking.
Why this skill is useful
Adds a self-hosted proxy solution with executable scripts for aggregating multiple LLM providers, enabling automatic failover and rate tracking.
What it needs
Requires node, npm installed locally. About 7k tokens when loaded. Last updated 2026-07-09. 70 stars on the source repository.
What this skill does
FreeLLMAPI Proxy Skill by ara.so — Daily 2026 Skills collection. FreeLLMAPI is a self-hosted OpenAI-compatible proxy that aggregates free-tier API keys from ~14 AI providers (Google, Groq, Cerebras, SambaNova, NVIDIA, Mistral, OpenRouter, GitHub Models, Hugging Face, Cohere, Cloudflare, Zhipu, Moonshot, MiniMax) behind a single /v1/chat/completions endpoint. It handles automatic failover on 429/5xx, per-key rate tracking, sticky sessions for multi-turn conversations, and AES-256-GCM encrypted key storage. --- Installation Prerequisites: Node.js 20+, npm. --- Environment Variables Never commit .env. The ENCRYPTIONKEY protects all stored provider API keys. --- Key Commands --- Provider Setup 1. Open the dashboard at http://localhost:5173 (dev) or http://localhost:3001 (prod). 2. Navigate to Keys page. 3. Add raw API keys for each provider you have. Keys are encrypted before SQLite storage. 4. Navigate to Fallback Chain to reorder provider priority. 5. Copy your unified freellmapi-… bearer token from the Keys page header. Supported providers and what to put in: Provider Where to get a free key --- --- Google Gemini https://ai.google.dev Groq https://groq.com Cerebras https://cerebras.ai SambaNova https://cloud.sambanova.ai NVIDIA NIM https://build.nvidia.com Mistral https://mistral.ai OpenRouter https://openrouter.ai GitHub Models https://github.com/marketplace/models Hugging Face https://huggingface.co Cohere https://cohere.com Cloudflare Workers AI https://developers.cloudflare.com/workers-ai Zhipu https://bigmodel.cn Moonshot https://platform.moonshot.cn MiniMax https://platform.minimax.io --- Using the API Python (openai SDK) Request a specific model Streaming curl TypeScript / Node.js --- Tool Calling Tool calling works across all supported providers. OpenAI-compatible providers receive requests verbatim; Gemini requests are automatically translated to functionDeclarations/functionResponse format and back. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills aradotso/freellmapi-proxy