Agent skill · google
gke-ai-troubleshooting-node-unresponsive-timeout
Diagnose and mitigate GKE TPU or GPU nodes stuck in NotReady / NodeStatusUnknown ("Kubelet stopped posting node status") due to host kernel panics, hardware lockups, or disabled node auto-repair. Use when nodes stop heartbeating beyond the node auto-repair threshold and pods remain stuck in Terminating. Don't use for healthy nodes, pod-only application crashes, or routine GKE upgrades.
What it needs
About 6k tokens when loaded.
What this skill does
Troubleshoot unresponsive GKE TPU and GPU nodes (NodeStatusUnknown) When the Compute Engine host of a TPU or GPU node has a fatal hardware error, kernel panic, or non-maskable interrupt (NMI) lockup, the guest OS stops responding. The kubelet can no longer send heartbeats, so the node Ready condition becomes Unknown with Reason: NodeStatusUnknown (Kubelet stopped posting node status.). If node auto-repair is disabled on the node pool, GKE doesn't repair the node. The node can stay NotReady, and pods on it can stay in Terminating, which blocks multi-host JobSet workloads from recovering. Attribution MUST READ: Before executing any gcloud, REST API, or MCP command, you MUST read Usage Attribution. For commands executed directly in the terminal (never in generated scripts, Terraform, or user code), prefix gcloud with CLOUDSDKMETRICSREQUESTATTRIBUTION="agent-skills/1.0 (skill:gke-ai-troubleshooting-node-unresponsive-timeout)" and append agent-skills/1.0 (skill:gke-ai-troubleshooting-node-unresponsive-timeout) to User-Agent headers. Prerequisites Tools: Install the Google Cloud SDK (gcloud) and kubectl. Cloud Billing & Project Configuration: Verify an active billing account is linked (gcloud billing projects describe {projectid}), authenticate (gcloud auth login), set the target project (gcloud config set project {projectid}), and ensure container.googleapis.com, compute.googleapis.com, logging.googleapis.com, and monitoring.googleapis.com are enabled. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills google/gke-ai-troubleshooting-node-unresponsive-timeout