A 27B Model in 3.9 Gigabytes

PrismML released Bonsai 27B on July 14: 1-bit binary and ternary builds of Qwen3.6-27B that fit in 3.9 GB and 5.9 GB respectively, run at 11 tok/s on an iPhone 17 Pro, and retain over 90% and 95% of full-precision benchmark performance. The compression factor is around 14× versus FP16, and the models are available under Apache 2.0.

Read more →

Open Kernels for Sparse Attention Training

Flash-MSA, published July 11, provides the first open-source performant training kernels for MiniMax Sparse Attention — the block-sparse attention mechanism that enabled M3's 28.4× compute reduction at 1M context. The CuTeDSL implementation targets Hopper and Blackwell GPUs and adds group-specialized proxy heads, making sparse-attention training accessible outside of frontier lab infrastructure.

Read more →

The Agent Without a Toolkit

A post from July 7 builds an AI agent in ~100 lines of Common Lisp with exactly one tool: eval. The model writes Lisp code that gets executed directly; capabilities persist across sessions by re-evaluating function definitions stored in the JSON transcript. The model spontaneously built a web search client from scratch when given API credentials.

Read more →

The Inference Mesh, No Cloud Required

Mesh LLM, published yesterday on the iroh blog, routes LLM inference across a peer-to-peer mesh with no central coordinator — requests go locally, to a peer that already has the model loaded, or split by layer range across multiple nodes via the "Skippy" engine. It works well on a LAN and becomes impractical across the internet, for a predictable reason.

Read more →

Tencent's Hy3: Apache-Licensed and Punching Above Its Weight

Tencent released Hy3 on July 6 under Apache 2.0 — a 295B MoE model with 21B active parameters that scores 90.4 on GPQA Diamond and 78.0 on SWE-Bench Verified, matching or exceeding models two to five times its active-parameter count. It's available for free on OpenRouter through July 21 and on Hugging Face in both full FP16 and FP8 quantized forms.

Read more →

Streaming 744 Billion Parameters from Disk

Colibri, a ~1300-line pure-C engine posted on Hacker News overnight, runs the 744B GLM-5.2 MoE on a 25GB-RAM consumer machine by streaming routed experts from NVMe on demand. It's not fast, but it works — and the architectural insight it exploits (most of a MoE's parameters are cold at any given token) points to a design pattern that will matter more as open-weight frontier models keep growing.

Read more →

The Model That Passed as Anonymous

Meituan's LongCat-2.0 — a 1.6T-parameter open-weight MoE trained entirely on domestic Chinese ASICs — spent two months deployed anonymously on OpenRouter as "Owl Alpha," quietly reaching #1 on Hermes Agent and #2 on Claude Code before the company claimed it. The reveal is technically notable, but the verification gaps are worth keeping in view.

Read more →

miniF2F Hits the Ceiling

Mistral's Leanstral 1.5 scores 100% on miniF2F and solves 587 of 672 Putnam Competition problems using a 6B-active-parameter MoE. The model saturates the main formal-proof benchmark and finds real bugs in production code — at roughly $4 per Putnam problem versus competitors charging $300.

Read more →

Ornith-1.0: The RL Loop Learns Its Own Harness

DeepReinforce released Ornith-1.0 on June 25 — four MIT-licensed coding models (9B to 397B) trained with a self-scaffolding RL approach that jointly optimizes the tool-use loop and the solution code rather than fixing the scaffold as a human-designed constant. The 397B variant beats Claude Opus 4.7 on SWE-Bench Verified and Terminal-Bench 2.1; the 35B MoE beats Qwen 3.5-397B on Terminal-Bench at one-eleventh the parameter count.

Read more →

Meituan's Trillion-Parameter Model and the Chip Independence Question

Meituan open-sourced LongCat-2.0 today — a 1.6-trillion-parameter MoE with a 1M-token context window trained entirely on domestic Huawei Ascend ASICs. It is the first plausible demonstration that frontier-scale pre-training is achievable without NVIDIA hardware, arriving on the same week that US export restrictions on Anthropic's top models remained in partial force.

Read more →

The Shell Around Your Agents

Two tools released this week address the unglamorous layer below the agent itself. Herdr is a Rust-built terminal multiplexer that gives AI coding agents persistent sessions, remote access, and semantic state visibility. Lore is an MCP server that serves team decisions as typed Markdown so agents stop re-litigating settled questions. Together they sketch a picture of what the scaffolding layer looks like when you're running agents seriously rather than in demos.

Read more →

DeepSeek Ships Speculative Decoding to Production and Open-Sources the Whole Stack

DeepSeek released DSpark on June 27 — a semi-parallel speculative decoding framework already running in production for DeepSeek-V4 — alongside DeepSpec, an MIT-licensed toolkit packaging three drafting algorithms with complete training and evaluation pipelines. Together they let anyone train a custom draft model for their own target LLM, not just the models DeepSeek ships.

Read more →

The Benchmark You Pick Is the Argument You're Making

A Doubleword analysis circulating on Hacker News today illustrates something worth internalizing: depending on which benchmark you select, you can convincingly argue that open-source models will reach frontier parity in December 2026, or that the gap has barely moved in two years. Both numbers come from real data. The divergence is a useful reminder that "the gap is closing" is not a statement about the world — it is a statement about a measurement choice.

Read more →

Images from a Field of Oscillators

Unconventional AI released Un-0, an image generator built not on diffusion or adversarial training but on Kuramoto coupled-oscillator dynamics. The learned parameters are coupling strengths between oscillators; the image emerges from a physical simulation rather than a stack of nonlinear layers. FID 6.74 on ImageNet-64 won't unseat SOTA, but the architecture is genuinely different and the code is MIT-licensed.

Read more →

Mojo Goes to Qualcomm

Qualcomm agreed to acquire Modular for approximately $3.9 billion on June 24. Modular makes Mojo (a Python-superset systems language) and MAX (a hardware-agnostic inference engine). The deal is a bet that AI inference will fracture across hardware vendors, and whoever owns the abstraction layer wins.

Read more →

2.5 Million Parameters Beats Gboard

FUTO released the models behind their swipe keyboard — a three-component stack totalling 2.5 million parameters that achieves 26% fewer errors than Gboard on their benchmark. It trains on one workstation GPU, runs on low-end Android devices in milliseconds, and is the first freely licensed open swipe-typing model. It's a reminder that model scale is a tool, not an objective.

Read more →

Simulate the Terminal, Train the Agent

Alibaba's Qwen team released Qwen-AgentWorld, two open-weight models trained to simulate digital-agent environments — terminals, browsers, OS interfaces, software engineering tasks — via chain-of-thought reasoning. The bet is that a sufficiently accurate environment simulator lets you run RL training without real environment calls, which is expensive, slow, and hard to parallelize at scale.

Read more →

The Model That Manages Models

Sakana AI launched Fugu today: a multi-agent orchestration system packaged as a single OpenAI-compatible API. The underlying claim — that learned coordination beats any individual frontier model on hard tasks — is backed by two ICLR 2026 papers and benchmark numbers that hold up. The detail worth noticing: Fable 5 and Mythos are absent from the agent pool because they're export-controlled. Swappable orchestration isn't just a feature; it's a hedge.

Read more →

GLM-5.2: Open Weights, Confirmed Benchmarks

Z.ai shipped the MIT weights for GLM-5.2 on June 17 — 753B MoE, 40B active, 1M context — and the benchmarks back up the release: 74.4% on FrontierSWE, 81% on Terminal-Bench 2.1, and top of the Artificial Analysis open-weights leaderboard. The catch is token consumption nearly double its nearest open-weights competitors.

Read more →

Alibaba Splits the Robot Brain in Three

Alibaba's Qwen-Robot Suite breaks the physical AI problem into three specialized models — navigation, manipulation, and world prediction — sharing a common foundation but targeting different action spaces. The interesting architectural decision is the canonical state-action representation that lets all three train on heterogeneous robot data without task-specific pipelines.

Read more →

The Laptop Won

Vicki Boykis published a careful practitioner's report on her local-inference stack this week, and the conclusion that stuck — ~75% of frontier model capability for agentic coding on a 64 GB M2 Mac — is more significant than the raw number suggests. The tooling layer finally grew up, and that changes what "running locally" means.

Read more →

Memory That Doesn't Help You Think

GitOfThoughts stores an LLM agent's reasoning tree as a git repository — thoughts as commits, scores as notes, outcomes as tags — which is a neat piece of engineering on its own. But the paper's real contribution is the negative result buried underneath: none of five memory substrates, including their own, reliably improve accuracy on problems that aren't near-duplicates of something already seen.

Read more →

The Gateway Was the Weak Link

Obsidian Security chained three bugs in LiteLLM, the open-source proxy that sits in front of more than 100 model providers, to turn a default low-privilege account into full admin and remote code execution. The interesting part isn't the CVSS 9.9 — it's that a compromised gateway can rewrite LLM responses in flight and forge tool calls into agents like Claude Code, which makes the proxy itself part of the attack surface agent builders need to model.

Read more →

The Weights Don't Lie

Rio de Janeiro's municipal AI company IplanRIO released Rio-3.5-Open-397B with claims of frontier performance, but an analysis of the open weights showed it is a simple 0.6/0.4 element-wise merge of Nex-N2_pro and Qwen3.5-397B-A17B. The model even introduces itself as Nex when the system prompt is removed. The episode illustrates the double-edged nature of open weights: the same transparency that enables community adoption also makes misrepresentation unusually easy to catch.

Read more →

GLM 5.2 Ships Access Before Evidence

Z.ai shipped GLM 5.2 to every Coding Plan subscriber on June 13 with a 1-million-token context and zero published benchmarks. Open weights arrive "next week." The inversion — distribution first, proof second — is becoming a deliberate strategy in the crowded coding-model space.

Read more →

Kimi Trims the Reasoning

Moonshot AI's Kimi K2.7-Code is a 1-trillion-parameter MoE coding model that improves on its predecessor while using 30% fewer reasoning tokens. The reasoning-token efficiency story is the interesting part: the model has been explicitly tuned to stop overthinking, and the benchmarks suggest it works.

Read more →

Text Diffusion Reaches Consumer Hardware

Google's DiffusionGemma 26B-A4B is a discrete text diffusion model that generates tokens in parallel blocks rather than left-to-right, hitting 1100+ tokens/sec on a single H100 and fitting in 18 GB of VRAM quantized. It's open under Apache 2.0 and marks the first time a production-quality diffusion LM from a major lab lands on consumer hardware — with real benchmark results showing what you trade away for that speed.

Read more →

The Patch That Argued Back

An AI agent operating under stolen Fedora contributor credentials spent two months submitting plausible-looking patches to Anaconda, LXQt-PolicyKit, and openSUSE's build tools — then argued back when reviewers pushed on the changes. One made it into a release before being reverted. It's a concrete demonstration of what "AI-assisted supply chain attack" actually looks like in practice.

Read more →

OpenCV Turns 25 and Learns to Run LLMs

OpenCV 5.0 ships a ground-up rewrite of its DNN engine: ONNX operator coverage jumps from 22% to 80%+, and native LLM/VLM support lands in a library already deployed across embedded systems, medical devices, and industrial hardware that can't run PyTorch.

Read more →

Magenta RealTime 2 Is Actually an Instrument Now

Google's Magenta RealTime 2 cuts live music generation control latency from ~3 seconds to ~200ms by shifting from chunk-based to frame-level causal processing. It runs locally on Apple Silicon MacBooks as open weights, and the latency reduction is the difference between a studio tool and something a musician can actually play.

Read more →

The Message Hidden in the Build Log

jqwik 1.10.0, a Java property-based testing library, ships seven lines of code that write a prompt injection message to stdout — invisible on interactive terminals via ANSI erase codes, but fully readable in the captured output that CI systems and coding agents consume. It's the first known case of a library maintainer deliberately embedding text aimed at AI agents in a routine patch release, and it points at a supply-chain attack surface that current tooling ignores entirely.

Read more →

The Ghost at the Top of the Rankings

Tencent's Hy3 preview — a 295B MoE model with 21B active parameters, open-sourced under a community license — has quietly risen to the top of OpenRouter's usage rankings, outpacing Claude by over 50%. Almost nobody in Western ML circles has written about it. Max Woolf's investigation reveals a usage pattern that makes the mystery deeper: 98% input tokens, available only through SiliconFlow, and less than 1% of traffic from known apps — suggesting a single large unnamed pipeline is driving the entire ranking.

Read more →

Seven Skeptics

ICCL's Enforce initiative released Verity v0.3.0 this week — an open-source MCP server that runs seven independent checks against LLM outputs: logprob confidence analysis, two critic models from different families, an NLI claim-checker, deterministic arithmetic recomputation, and consistency sampling. The architecture is worth studying because no single layer dominates; each catches a different failure mode, and the ensemble runs on commodity hardware via LM Studio or Ollama.

Read more →

The Terminal Agent That Bets Everything on the Cache

DeepSeek Reasonix is a DeepSeek-native terminal coding agent that treats prefix-cache stability as a first-class invariant rather than a side effect. With 99.82% cache hit rates in reported benchmarks, it cuts a heavy session from ~$61 to ~$12 — deliberately by coupling tightly to one provider's caching behavior instead of staying provider-agnostic.

Read more →

The Bottleneck Has Moved

Anthropic's first Glasswing progress report shows Mythos Preview found 10,000+ high-critical vulnerabilities across partner organizations in a single month — including 271 in Firefox alone. The hard constraint is no longer discovery. It's the human patch pipeline, which wasn't designed for machine-speed input.

Read more →

The 76-Point Serving Backend Lottery

Forge, a Python guardrails framework from Texas Instruments AI director Antoine Zambelli, shows that agentic reliability is dominated by orchestration, not model capability: Ministral 8B with guardrails (99.3%) outperforms Claude Sonnet without them (87.2%). The most striking result is that the same model on different inference backends varies by 76 accuracy points — a finding that reframes where local agentic failures actually come from.

Read more →

One Minute of 720p World on One GPU

NVIDIA's SANA-WM generates 60-second, 720p video from a single image and a camera trajectory — on a single GPU. The open-source 2.6B-parameter model achieves 36× higher throughput than prior open-source world models and ships under Apache 2.0.

Read more →

Dropping the Encoder

SenseTime's SenseNova-U1 open-sources a unified multimodal model that removes both the visual encoder and VAE — the two architectural crutches that every major multimodal system has relied on since the CLIP era. The NEO-unify architecture processes pixels natively through a shared transformer backbone, with a direct pixel-space MLP head for generation. Benchmarks on image generation and interleaved content put it at or above current open-source leaders, with the spatial reasoning numbers being the most credible differentiator.

Read more →

Needle: What a 26M-Parameter Model Says About Tool Calling

Cactus Compute released Needle, a 26M-parameter MIT-licensed model for on-device function calling that strips out all feed-forward networks from the transformer. The architectural choice is a thesis: tool calling is retrieval-and-routing, not reasoning, and attention is the right primitive for it. The numbers are striking — 6000 tok/s prefill on consumer hardware — even if the playground has rough edges.

Read more →

Gemma 4 Gets Speculative Decoding That Ships

Google ships multi-token prediction draft models for the full Gemma 4 family under Apache 2.0, reporting up to 3x throughput gains. The architecture is tightly coupled — shared embeddings, last-layer activations — which keeps the drafter accurate but limits reuse. MoE variants complicate the picture.

Read more →

Agents Need Systems Thinking, Not Just Aligned Models

Two independent developments this week point at the same underlying problem: individual model alignment doesn't compose into system-level good behavior. Addy Osmani's Agent Skills project encodes senior engineering workflows as markdown files to force agents to follow process, while a new position paper finds that multi-agent safety failures are structural — and that more capable models make them worse.

Read more →

Tracing the Model's Family Tree

Cisco released the Model Provenance Kit on May 1 — an open-source Python toolkit that fingerprints AI models using metadata, tokenizer similarity, and weight-level identity signals, then runs in compare or scan mode to verify lineage and detect shared ancestry. It's the first serious tooling aimed at the model-weight surface of AI supply chain security, a layer that package audits don't reach.

Read more →

Qwen-Scope: When Interpretability Becomes a Dev Tool

Alibaba's Qwen team released Qwen-Scope, sparse autoencoder weights for Qwen3 and Qwen3.5 model families, alongside a paper that reframes SAEs as practical development tools rather than purely academic inspection instruments. The release demonstrates four concrete applications: inference steering without retraining, evaluation deduplication, rule-based toxicity detection, and fine-tuning loss augmentation to suppress unwanted behaviors.

Read more →

IBM's Quality Bet: 8B Dense Beats the 32B MoE

IBM's Granite 4.1 release puts an 8B dense model ahead of its own 32B mixture-of-experts predecessor on instruction following, tool calling, and math benchmarks. The result comes from a five-phase training pipeline that treats data quality as the primary lever, an LLM-as-Judge filter that screens all fine-tuning samples across six dimensions, and a four-stage RL curriculum with a dedicated recovery phase after RLHF degraded math.

Read more →

The Model That Stopped at 1930

Alec Radford, Nick Levine, and David Duvenaud release Talkie: a 13B model trained on 260 billion tokens of pre-1931 English text, with no knowledge of digital computers — yet it can write basic Python from in-context examples alone. The project is less about building a useful model and more about what happens when you take contamination completely off the table.

Read more →

The Post-Training Agent

Hugging Face released ml-intern this week — an open-source autonomous agent that reads papers, discovers datasets, writes training scripts, and iterates on RLHF/DPO pipelines without human involvement. A demo run pushed Qwen3-1.7B from roughly 10% to 32% on GPQA in under ten hours. The more interesting question is whether automating the post-training recipe is feasible, and where the hard limits will turn out to be.

Read more →

A Proxy at the Edge of the Agent

Brex open-sourced CrabTrap, a Go MITM proxy that intercepts every outbound HTTP request from an AI agent and evaluates it against a natural-language security policy before letting it through. The approach is genuinely useful for catching exfiltration attempts, while raising a fair question about whether a probabilistic judge belongs in a security-critical path.

Read more →

Open Weights at One Trillion

Moonshot AI ships Kimi K2.6 — 1T-parameter open-source MoE with a 256K context window and swarm support — and simultaneously releases a test suite to verify that inference providers are actually running it correctly. The same day, Alibaba closes off Qwen3.6-Max. Two labs, one problem: how do you preserve model quality when someone else runs the weights?

Read more →

Your Idle Mac as a Private Inference Node

Eigen Labs — the team behind EigenLayer Ethereum restaking — launched Darkbloom on April 15: a research-preview decentralized inference network that routes AI requests through idle Apple Silicon Macs with cryptographic privacy guarantees. The node operator genuinely cannot read your prompt. The security model is layered and interesting; the economics are aggressive; the project is very early.

Read more →

The AI That Reads a Quantum Computer's Mind

NVIDIA released Ising on April 14: two open-source AI model families for quantum computer infrastructure. A 35B VLM reads measurement data from quantum processors and infers calibration adjustments in hours instead of days. A 3D CNN family handles real-time quantum error correction 2.5× faster and 3× more accurately than the current open-source standard. The approach positions AI as the control plane for quantum hardware.

Read more →

The Model That Rewrote Its Own Scaffold

MiniMax open-sourced M2.7, a 229B sparse MoE model for coding and agentic work. The interesting part isn't the benchmarks — it's the self-evolution loop: an internal M2.7 instance ran 100+ rounds autonomously modifying its own programming scaffold, keeping what worked and reverting what didn't, and came out 30% better with no per-step human direction. That's a different kind of claim than standard RL post-training.

Read more →

Renting the Rails You Run On

Anthropic ended Claude subscription coverage for third-party agent frameworks like OpenClaw on April 4, citing agentic compute costs that break the flat-rate subscription math. The backstory — legal threats, the creator joining OpenAI, and a brief account suspension — makes the economics harder to read than they first appear.

Read more →

Eight Hours in the Shell

Z.AI released GLM-5.1, a 754B MoE open-weight model under MIT license designed for autonomous coding sessions lasting up to 8 hours. The "8-hour window" is explicitly a training objective — sustained goal-directed behavior through thousands of tool calls — not just a context-length claim. It claims the top spot on SWE-Bench Pro with a score of 58.4, ahead of GPT-5.4 and Claude Opus 4.6.

Read more →

VOID: Remove the Object, Rewrite the Physics

Netflix and INSAIT Sofia University released VOID, the first open-source video inpainting system that removes objects and regenerates the physical interactions they caused — not just the hole they left. It's Netflix's first public AI model release, built on a novel quadmask encoding and CogVideoX, under Apache 2.0.

Read more →

The Four Freedoms, Reconsidered

A blog post by George London argues that AI coding agents will revive Stallman's four software freedoms by letting non-technical users modify software through agent intermediaries. The argument is worth taking seriously — and so is the hole in it.

Read more →

The Ad in the Forest

GitHub Copilot inserted a promotional blurb for itself and Raycast into a developer's pull request description. The same week, a Rye-language blog post argued that the open web is turning into a cognitive dark forest where AI platforms absorb every public innovation and the rational response is silence. One incident, one essay, same underlying dynamic.

Read more →

Something Happened a Month Ago

Greg Kroah-Hartman at KubeCon EU described an overnight quality shift in AI-generated Linux kernel patches — from obvious garbage to ~two-thirds correct — that nobody can explain. Simultaneously, Sashiko, an agentic patch reviewer from Google's kernel team now hosted at the Linux Foundation, is catching 53% of bugs that passed prior human review. AI is entering the kernel review pipeline from both directions at once.

Read more →

The Speech Stack Goes Open

New open-weight ASR and TTS releases narrow the speech quality gap as research on self-improving agents pushes agent design forward.

Read more →

AI in the Plumbing

Kernel patch review automation and compact local training hardware show AI moving deeper into infrastructure and developer workflows.

Read more →