Agent skill · NVIDIA
launch-nemo-rl
Playbook for launching, monitoring, stopping, and debugging NeMo-RL recipes on a Kubernetes cluster via the nrl-k8s CLI. Covers ephemeral vs long-lived RayCluster modes, iterating on runs, and debugging hung or failed training jobs.
What it needs
About 9k tokens when loaded.
What this skill does
launch-nemo-rl — running NeMo-RL recipes on Kubernetes via nrl-k8s This is the playbook for the nrl-k8s CLI at infra/nrlk8s/. Follow it when the user asks to launch / iterate / debug a NeMo-RL recipe on a Kubernetes cluster. Verify current state (kubectl, git log, the recipe + infra files) before acting — the cluster is shared and the cost of a wrong action is high. 1. One command, two modes There is a single top-level submission command: nrl-k8s run. It has two lifecycle modes. Mode Invocation When to use Cluster after? :----------------- :---------------- :---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- :------------- Ephemeral (default) nrl-k8s run One-shot. KubeRay applies a RayJob, runs, tears the cluster down. Best for most runs. No (auto) Long-lived nrl-k8s run --raycluster Dev loop. Reuses a matching live cluster, applies if absent, warns + reuses on drift (pass --recreate to replace). Then submits daemons and training. First-choice for iteration. Yes Ask: Do I need this cluster after the run? If yes, use --raycluster. Otherwise use the default (ephemeral). The rest of the CLI is observability / stage-by-stage control: Command Purpose :---------------------- :---------------------------------------------------------------------------------------------- nrl-k8s check Validate a recipe + infra pair; optionally write the fully-resolved manifests (-o). nrl-k8s status Per-role RayCluster state, head pod phase, worker pod phases, daemon job status. nrl-k8s cluster up/down/list/dashboard Manage RayClusters independently of a run (e.g. render a manifest with --dry-run). nrl-k8s job list/logs/stop Observability over Ray Jobs already submitted to a role's cluster. nrl-k8s logs Tail a role's pod / daemon logs without needing a submission id. 2. Recipe + infra pair Every launch takes two files. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills NVIDIA/launch-nemo-rl