Agent skill · vasilyu1983
ai-local-model-ops
Runs local and self-hosted LLM workflows with Ollama, LM Studio, MLX, Open WebUI, llamafile, and adapters. Use when operating private model stacks.
What it needs
About 6k tokens when loaded.
What this skill does
Local Model Operations Use this skill to choose and operate local or self-hosted LLM workflows when privacy, offline access, or low-friction experimentation matter more than large-cluster serving. This skill covers: local runtime choice for laptops, workstations, and small self-hosted setups team-facing local or private chat surfaces single-binary or minimal-dependency model packaging lightweight adaptation paths before full training or cluster-scale serving evaluation and escalation rules before a local stack becomes a product dependency ASCII Flow Quick Reference Need Default path Notes ------ -------------- ------- Run a local model quickly Ollama Lowest-friction day-0 local runtime for experiments and private workflows Share a self-hosted chat UI Open WebUI Best fit when a team needs a ChatGPT-like local or private interface Ship a no-install demo or portable binary llamafile Useful for single-file distribution and low-ops delivery Apple Silicon on-device inference at framework level MLX (mlx-lm) Primary path for Metal-native inference and LoRA fine-tune on Mac; verify at https://github.com/ml-explore/mlx-lm GUI model browser and switcher (non-technical users) LM Studio Supports GGUF and MLX; good for rapid model comparisons Windows / enterprise SDK-first local inference Microsoft Foundry Local Curated Microsoft catalog; SDK + REST; verify at https://learn.microsoft.com/en-us/ai/foundry-local Fine-tune or adapt cheaply Unsloth + ../ai-llm/SKILL.md Good for lightweight adaptation, not a substitute for full training ops Optimize throughput or production serving ../ai-llm-inference/SKILL.md Use this skill for local ops; use ai-llm-inference for deeper serving engineering Runtime Selection Situation Best fit ----------- ---------- Solo developer or analyst on one machine Ollama Internal team chat with local or self-hosted models Open WebUI Portable model demo or offline executable distribution llamafile Fast adapter and fine-tuning iteration on limited hardware Unsl …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills vasilyu1983/ai-local-model-ops