Agentic AI news, research notes, and industry analysis.
Category
4 stories in this category.
Ternlight ships a sentence embedding model as a 7MB WASM bundle that runs on CPU in the browser — no API, no model download, no GPU required. Ternary weights are the key to the footprint; the result is semantic search you can include in an npm install.
Read more →DeepSeek released DSpark on June 27 — a semi-parallel speculative decoding framework already running in production for DeepSeek-V4 — alongside DeepSpec, an MIT-licensed toolkit packaging three drafting algorithms with complete training and evaluation pipelines. Together they let anyone train a custom draft model for their own target LLM, not just the models DeepSeek ships.
Read more →Vicki Boykis published a careful practitioner's report on her local-inference stack this week, and the conclusion that stuck — ~75% of frontier model capability for agentic coding on a 64 GB M2 Mac — is more significant than the raw number suggests. The tooling layer finally grew up, and that changes what "running locally" means.
Read more →CODA, a new paper from Tri Dao and colleagues, extends FlashAttention's core insight — keep data on-chip, avoid DRAM round-trips — to all the non-attention operations in a transformer block. Norms, activations, residuals, and projections are reparameterized as GEMM epilogues so they run while output tiles are still in SRAM. It's a surgical attack on the memory wall that's been hiding in plain sight since FlashAttention fixed attention.
Read more →