UptimeUptime Wiki

facility thermal runaway

Diagnostic checklist

  • Facility cooling is over capacity and heat is compounding — servers across the fleet throttle, then fail (this is facility-wide, not one rack).
  • Shed heat now: power down or relocate the densest gear, and check the facility's cooling capacity vs heat load.
  • Long term, add cooling capacity or stop packing dense hardware in faster than you can cool it.

On this page