Kimi-K3 · AI Beat

02 Aug 2026 · AI Beat Desk

AMD's Inference Edge Was Two Bug Fixes Away

Wafer.ai's benchmarks of Kimi K3 on AMD MI355X tell a story that goes beyond the numbers: the hardware was capable all along, but two ROCm bugs were blocking it. Fixing them yields 48 tok/s per GPU-dollar, against 7 for B200 — a gap that challenges the assumption that NVIDIA owns frontier model inference.

01 Aug 2026 · AI Beat Desk

One pread Per Expert

SQLiteAI released WASTE, a dependency-free C inference engine that runs Kimi K3's 2.78-trillion-parameter model on 29GB of RAM at 0.50 tok/s by keeping the resident trunk in memory and streaming activated experts from NVMe with a single pread() per expert.