Agent skill · data analytics · jeremylongshore
groq-cost-tuning
Optimize Groq costs through model routing, token management, and usage
Why this skill is useful
Adds domain-specific knowledge for optimizing Groq API costs through model routing and usage monitoring that the AI wouldn't reliably generate on its own.
What it needs
Requires node installed locally. Requires groq account access. About 3k tokens when loaded. Last updated 2026-08-07. 2,604 stars on the source repository.
What this skill does
Groq Cost Tuning Overview Optimize Groq inference costs through smart model routing, token minimization, and caching. Groq pricing is already extremely competitive, but at high volume the savings from routing classification to 8B vs 70B are 12x per request. Prerequisites A Groq account with an API key exported as the GROQAPIKEY environment variable — the groq-sdk client reads it automatically (new Groq()). Node.js with the groq-sdk package installed (npm install groq-sdk). Access to the Groq Console to set spending caps and read the usage dashboard. Groq Pricing (per million tokens) Model Input Output ------- ------- -------- llama-3.1-8b-instant ~$0.05 ~$0.08 llama-3.3-70b-versatile ~$0.59 ~$0.79 llama-3.3-70b-specdec ~$0.59 ~$0.99 meta-llama/llama-4-scout-17b-16e-instruct ~$0.11 ~$0.34 whisper-large-v3-turbo ~$0.04/hr — Check current pricing at groq.com/pricing. Instructions Apply these six levers in order. Each compounds on the last — routing alone is the biggest win (~12x), and caching plus batching halve the remainder. The lean skeleton below shows the routing core; the full code for every step lives in references/implementation.md. 1. Smart model routing — map each use case to the cheapest model that meets its quality bar (classification/extraction/summarization → llama-3.1-8b-instant; reasoning/code review/chat → llama-3.3-70b-versatile; vision → llama-4-scout). 2. Minimize tokens per request — trim verbose system prompts and cap maxtokens so a one-word answer never bills for a paragraph. 3. Batch to reduce overhead — fold many items into one request; 10-in-1 cuts per-request overhead and RPM pressure ~90%. 4. Cache deterministic requests — at temperature: 0, hash identical prompts into a cache for zero-cost, zero-latency repeat hits. 5. Usage tracking — log token counts and estimated cost per call to catch spend regressions before the invoice. 6. Spending limits in console — set a monthly cap, alerts at 50%/80%, and auto-pause in Groq Console > Billing. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills jeremylongshore/groq-cost-tuning--643189