Prime Intellect rewrote Prime Agent — their open-source coding agent harness, 300k downloads, 8 trillion tokens — from TypeScript to Rust using ~2,000 AI agents across 10,000+ sandboxes. The result is 13x faster startup, 5.7x less memory, and a nine-crate architecture with session isolation. A practical test of whether agent fleets can handle serious infrastructure work, not just toy tasks.
Marcel Røed released GigaToken, a Rust tokenizer using SIMD and cache-optimized byte-pair encoding that runs 500–1,000× faster than HuggingFace's tokenizers and up to 681× faster than tiktoken — reaching 24 GB/s on a single CPU.
NVIDIA's NVlabs released cuda-oxide v0.1.0 on May 7, an experimental compiler that takes standard Rust and emits NVIDIA PTX directly — no CUDA C++, no DSLs, no foreign language bindings. The pipeline goes through a custom rustc codegen backend and a Rust-native MLIR-like IR called Pliron. Alpha-stage and Linux-only, but it signals where NVIDIA thinks GPU kernel development might eventually land.