Agent skill · nvidia

rtvi-vlm-customize-model

How to swap the VLM in the VSS Alerts Blueprint — covers RTVI-VLM microservice deployment methods, all three VLM consumers (rtvi-vlm, vlm-as-verifier, vss-agent), and health checks.

What it needs

About 9k tokens when loaded.

What this skill does

VLM Customization — VSS Alerts Blueprint When to use Use this skill when the user wants to: repoint the VSS Alerts Blueprint to a different VLM endpoint, run rtvi-vlm standalone with either an OpenAI-compatible endpoint or the in-container vLLM path, fix the assumption that changing one VLM config automatically updates rtvi-vlm, vlm-as-verifier, and vss-agent. Do not use this skill for CV detector swaps inside vss-rt-cv; use rtvi-cv-customize-model for those. Instructions Treat rtvi-vlm, vlm-as-verifier, and vss-agent as three separate VLM consumers. Do not imply that changing only RTVIVLM automatically repoints the verifier or the agent UI. Treat all paths in this skill as relative to a checkout of the public VSS Blueprint repository. Blueprint deployment files live under deploy/docker/...; customer-accessible RT-VLM source and standalone deployment files live under services/rtvi/rt-vlm/.... None of these paths resolve inside the DeepStream repository. For blueprint-side OpenAI-compatible routing, cover all three surfaces: RTVIVLM env vars, ${VSSPROFILEDIR}/vlm-as-verifier/configs/config.yml, and the vss-agent VLMMODELTYPE / VLMNAME / VLMBASEURL settings, then mention force-recreate plus log checks. For standalone vllm-compatible, set VLMMODELTOUSE=vllm-compatible, point MODELPATH at the weights source, mention HFTOKEN only when the model actually needs auth. Do not treat a log line as proof of a working deployment: v3.2.1 logs Warmup VlmProcess-0 done even when warm-up raised an exception. Require the absence of an Error during warmup line, readiness, and one successful /v1/chat/completions response. Never paste credentials into chat or logs; capture with a silent prompt (read -rsp), chmod 600 the env file, and never commit generated.env. …

How to use it

Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:

@skills nvidia/rtvi-vlm-customize-model

View the source on GitHub

Browse the @skills marketplace