Tuesday Jun 16

Google Ships A Diffusion Text Model

10JUN
4X FASTERWORD BY WORDWHOLE BLOCK

Google open-sourced a model that writes text in blocks, not word by word. DiffusionGemma hits 1,000-plus tokens a second on one H100, roughly 4x faster than normal models. Free to download under Apache.

Most AI writes one token at a time. DiffusionGemma starts from noise and denoises 256-token blocks in parallel until clean text appears. That parallelism is where the speed comes from.

It's a 26B mixture-of-experts, only 3.8B active per step. It takes text, image, and video in. The catch: quality trails standard Gemma 4 on reasoning and coding.

Speed-critical jobs get a cheap new option. Watch whether diffusion text closes the quality gap. If it does, the token-by-token default starts to look optional.

full brief & sources

Why this matters

  • First major open-weights text-diffusion model from a frontier lab, not a research demo.
  • 4x speed at 1,000-plus tokens a second changes the cost math for latency-sensitive products.
  • Apache 2.0 means anyone can deploy it without licensing friction.

🔍 What happened

  • Jun 10 — Google DeepMind released DiffusionGemma on Hugging Face, Kaggle, and Vertex AI.
  • It generates text via discrete diffusion: denoising blocks of 256 tokens in parallel.
  • It's a 26B-class MoE, 25.2B total params, about 3.8B active per step (labeled 26B A4B).
  • It runs 1,000-plus tokens a second on one NVIDIA H100, about 4x faster than autoregressive peers.
  • It accepts text, image, and video input and outputs text, under an Apache 2.0 license.
  • Quality lags standard Gemma 4 on MMLU and coding; Google calls it experimental.

💬 Smart takes

  • Google DeepMind: positions it as experimental for speed-critical workflows, not a quality leader.
  • Builders: day-zero vLLM and Nvidia optimization make it deployable now, not someday.
  • Skeptic: diffusion text has been promised for years; lower benchmark scores may keep it niche.

🧭 Where this goes

  1. Likelydiffusion text models become the default for high-throughput, low-stakes generation.
  2. Likelyother labs ship their own open diffusion text models within six months.
  3. Possiblethe quality gap closes enough that diffusion challenges autoregressive for mainstream use.
  4. Wild Carda diffusion model tops a major reasoning benchmark within a year, flipping the architecture debate.

🥄 The Spoon Take

Everyone assumes AI writes left to right, one token at a time. DiffusionGemma says maybe not. It trades some quality for 4x speed, and it's free. The real question isn't this model. It's whether parallel generation eventually beats the token-by-token default everyone built on.

🤔 Pushback

Text diffusion has underdelivered for years, and lower benchmark scores could keep this experimental forever, not the start of a real shift.