KitScout

Categories › Cloud & DevOps › Monitoring, logs & incidents

gke-ai-troubleshooting-tpu-reservation-stockout

SkillInstall · skills CLI

Diagnose and resolve cluster-wide GKE TPU node pool creation or scale-up failures caused by Compute Engine reservation stockouts (GCE_STOCKOUT, ZONE_RESOURCE_POOL_EXHAUSTED) when existing unhealthy or NotReady TPU node pools in the cluster have node auto-repair disabled and hold reserved TPU capacity. Use when TPU node pool creation or scale-up fails with GCE_STOCKOUT, ZONE_RESOURCE_POOL_EXHAUSTED, or ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS despite having a specific Compute Engine TPU reservat

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

  • observability-and-instrumentation 117,221 ★
    Instruments code so production behavior is visible and diagnosable. Use when adding logging, metrics, tracing,
  • honeycomb-tracing 113,505 ★
    Trace Paperclip runs, requests, and full CI suites in Honeycomb. Use to find traces, diagnose latency, design
  • Netdata 81,392 ★
    Real-time infrastructure monitoring with metrics, logs, alerts, and ML-based anomaly detection.
  • azure-monitor-opentelemetry-ts 49,672 ★
    Auto-instrument Node.js applications with distributed tracing, metrics, and logs.
  • devops-troubleshooter 49,672 ★
    Expert DevOps troubleshooter specializing in rapid incident response, advanced debugging, and modern observabi