Two tutorial posts on Hacker News today trace the two distinct technical lineages of diffusion language models — discrete masked and continuous embedding-space — both of which have now reached production deployments with 2–10× throughput gains over autoregressive models. The quality gap with AR is measurably narrowing.
A new paper from a mix of academic and industry researchers identifies why diffusion language models consistently trail their autoregressive counterparts despite strong theoretical properties: they don't agree with what they generate. The proposed fix — Introspective Strided Decoding — lets an 8B DLM match same-scale AR quality while running 2.9–4.1x faster at high concurrency.