Friday Jun 12

MIT Cooling Squeezes 35% More Tokens

10JUN
+35% TOKENS

A cooling trick just bought free AI capacity. MIT startup Ferveret says its chip-cooling system pulls 35% more tokens from the same power. Switch and FuriosaAI are already testing it.

Power is the hard limit on every AI buildout. Cooling waste is where a lot of it leaks.

Ferveret uses phase-change cooling that makes tiny bubbles detach faster. That moves heat off the chip quicker. It claims 15% better efficiency than top liquid cooling.

If real at scale, it stretches existing data centers without new megawatts. CleanSpark is on the test list too.

full brief & sources

Why this matters

  • Power and cooling are the real ceiling on AI compute.
  • A 35% token gain at the same power is free scale.
  • Cooling is the least-glamorous, highest-leverage part of the stack.

🔍 What happened

  • Ferveret is an MIT-founded cooling startup.
  • Its adaptive phase cooling makes smaller bubbles that detach faster.
  • It claims 15% better efficiency than state-of-the-art liquid cooling.
  • Combined gains let a data center pull 35% more tokens per watt.
  • Switch, FuriosaAI and CleanSpark are early testers.

💬 Smart takes

  • Ferveret: the same power budget can run far more inference.
  • MIT News: the founders came from nuclear-reactor heat transfer work.
  • Skeptic: lab numbers rarely survive contact with a live hyperscale floor.

🧭 Where this goes

  1. Likelycooling efficiency becomes a board-level capex metric this year.
  2. Likelyhyperscalers pilot phase-change cooling in new builds.
  3. Possible'tokens per watt' becomes a standard vendor spec.
  4. Wild Carda cooling startup gets acquired by a chipmaker within 12 months.

🥄 The Spoon Take

Everyone fights over chips and models. The quiet win is cooling. If you can pull a third more output from the same power, you just bought capacity no one else can match. Boring infrastructure keeps deciding who can actually ship AI at scale.

🤔 Pushback

A startup's bench numbers are not a hyperscale deployment - a Switch pilot is not Switch betting its floor on it.