Tencent's Hy4 Is a Very Aggressive MoE

Tencent released Hy4 preview under Apache 2.0 on August 28: 770B total parameters, 49B active, 256 routed experts per layer with top-8 routing, 1M context, and a built-in speculative-decoding layer. The architecture makes some interesting bets — and the ratio of total to active compute is the most aggressive we've seen at this scale.

Read more →

The Station Makes New Math

Stephen Chung, Wenyu Du, and William Wesley's Station system — an open-world multi-agent environment where AI agents autonomously choose research directions without central coordination — produced novel results on five open mathematical problems, including new infinite families of finite-field Kakeya sets and improved kissing configurations in dimension 11.

Read more →

Agent Memory as a Deductive Database

Jordy Zomer's Lemmalog treats LLM agent memory as a Datalog deductive database rather than a vector store: facts carry provenance, conclusions retract when their premises are invalidated, and incremental evaluation keeps per-query cost constant regardless of history length — yielding 45x token savings on LongMemEval.

Read more →

The Agent That Never Stops Thinking

Headlong, a new open-source agent microharness from Laude Institute and MIT, rejects the request-response model: instead of spinning up on each message, the agent runs a continuous inner monologue loop and treats incoming messages as observations in an already-running stream of thought. Built in under 10K lines of Bash, it's a deliberately minimal bet that persistent agency doesn't require a complicated runtime.

Read more →

The Agent Lives in a Lisp Image

Lambda Symbolics' Autolith is a Common Lisp programming agent that runs inside a live SBCL image it can inspect and redefine at runtime — a design that takes the Lisp machine idea of a persistent, self-modifiable environment and applies it to AI coding agents.

Read more →

The 753B Model on Your Workstation

FreeToken, from a team at UC Berkeley and MIT, proposes a serving stack that treats a personal machine's CPU, GPU, and RAM as a single elastic compute surface, adapting to what's actually available rather than committing to a fixed offloading strategy. The result: a 35B model on an 8GB laptop GPU, 284B on a gaming desktop, and the 753B GLM-5.2 on a single workstation with one high-end GPU.

Read more →

Vercel Labs Ships a 6 MB Coding Agent

Vercel Labs open-sourced fx, a Zig-native coding agent harness that weighs 6.3 MB, cold-starts in 10 microseconds, and compiles to WebAssembly. It is model-agnostic, fully hermetic, and designed for embedding in larger systems rather than for IDE-style interactive use.

Read more →

Ornith-1.5 Teaches Itself to Code

Ornith released a three-size open-weight model family trained entirely by its own curriculum — the model proposes tasks, builds evaluation scaffolds, and generates rollouts, with a multiplicative reward structure that prevents gaming any one signal. DeepSWE jumped from 8.0 to 56.0; Terminal-Bench reached 86.1. The training mechanism is worth understanding even if the benchmark numbers prove optimistic.

Read more →

The One You Can Actually Run

Alibaba dropped Qwen3.8-27B open weights under Apache 2.0 a day after the 2.4T Max. The 27B dense model achieves 90.3% on LiveCodeBench and 89.2% on GPQA Diamond — within touching distance of closed frontier models — while fitting on hardware that actually exists in people's garages.

Read more →

DeepSeek's Plugin-First Agent Runtime

DeepSeek released Harness v0.1, an MIT-licensed open-source agent framework where every component — model, tools, storage, agent loop, UI — is a swappable plugin on a Cordis microkernel. Released alongside a Peking University research paper on the formal foundations of dynamic component composition.

Read more →

Meta's Muse Glimmer: A 30B Local Agent Model

Meta's Muse Glimmer is a 30B open-weight model distilled from Muse Spark 1.2, targeting local agent workflows on a single consumer GPU. It slots in above LFM2.5-2.6B and Needle2 in the increasingly crowded on-device agent tier, with Apache 2.0 licensing, hybrid attention, and speculative decoding via a dedicated drafter model.

Read more →

antirez Ports MiniMax H3 to Metal

Salvatore Sanfilippo — the author of Redis — published a native C+Metal inference engine for MiniMax H3 targeting M3/M5 Macs, roughly repeating what llama.cpp did for language models: bypass the Python stack, write tight hardware-specific kernels, and find out how fast the silicon can actually go.

Read more →

Who Wrote This Line?

us-vs-them is a small open-source library that reads git version history to produce line-level human/agent authorship scores — no markup required. As agentic editors increasingly co-author code, distinguishing human-written lines from machine-generated ones is becoming a practical necessity, and the git history turns out to be a surprisingly clean signal.

Read more →

Five Models Walk Into a Diff

OpenChamber v1.18.0, an open-source agentic IDE that lets you run the same task across up to five models and fuse the strongest results, ships a guided diff walkthrough that reorders large changesets into explained stops. It's a privacy-first alternative to commercial tools: code stays local, API keys are yours, and the project now supports any OpenAI-compatible endpoint.

Read more →

The Policy Belongs in the Prompt

Mistral's Shieldstral is a 3B open-weights multimodal safety classifier that accepts plain-language policy descriptions at inference time, framing each moderation call as binary QA against whatever policy you provide — no retraining needed when policies change. It matches or outperforms guard models up to 7× its size and ships under Apache 2.0.

Read more →

Born Ternary

DeepGrove's Maple-Preview is a 20B ternary-weight MoE reasoning model trained from scratch at {-1, 0, +1} precision — not quantized down from float. The 5.31 GB checkpoint runs at 218 tokens/second on an M4 Mac mini and 120 tok/s on iPhone, with competitive AIME and GPQA-D scores and an MIT license.

Read more →

The Expert That Lives on Disk

Swiftlet is a new Swift+Metal runtime that runs 80B-parameter Qwen3-Next in 4.3 GB of RAM on an M5 Mac — not through compression magic, but by exploiting a structural property of MoE models: they activate only about 3B parameters per token regardless of total size. The missing piece is fast enough SSD I/O to stream expert weights on demand, which Apple silicon happens to provide.

Read more →

Open Weights, Closed Markets

MiniMax released open weights for H3 on August 3 — a 33B video generation model that produces native stereo audio in the same forward pass as video and currently tops open-weight video rankings. The catch is a geographic restriction that effectively prohibits use in the US, EU, UK, and South Korea, the result of active copyright litigation from Hollywood studios and regulatory uncertainty in Western markets.

Read more →

One pread Per Expert

SQLiteAI released WASTE, a dependency-free C inference engine that runs Kimi K3's 2.78-trillion-parameter model on 29GB of RAM at 0.50 tok/s by keeping the resident trunk in memory and streaming activated experts from NVMe with a single pread() per expert.

Read more →

The Quartermaster Problem

Y Combinator open-sourced qm, the multi-agent harness they've been running internally across accounting, legal, events, and engineering. It's not another personal AI assistant — it's a framework designed around the premise that different people in an organization need isolated, scoped environments that can also collaborate in shared channels.

Read more →

GCC Will Not Take Your AI Code

The GCC steering committee adopted a policy declining "legally significant" LLM-generated contributions, with a carve-out for test cases. The motivation is copyright clarity for GPL enforcement, not code quality — a distinction that matters more than it might seem, and that every major open-source project will eventually have to address.

Read more →

31 Tokens Per Second from Disk

TurboFieldfare, a Swift/Metal inference engine posted to Hacker News overnight, runs Gemma 4 26B in roughly 2 GB of RAM by keeping the model's shared core in memory and streaming routed experts from SSD via explicit pread I/O — achieving 31–35 tok/s on an M5 MacBook Pro, well into interactive usability. It's the expert-streaming technique from Colibri, applied to a smaller MoE on purpose-built Apple hardware, and the throughput gap shows what platform-specific implementation buys.

Read more →

The Line Anthropic Actually Drew

Anthropic breaks its silence as the last major AI lab not to sign the open-weight defense letter — and their position is more carefully drawn than either "ban them" or "let them run." They want mandatory safety testing for capable models, chip export enforcement, and a crackdown on industrial-scale distillation. The capability question, not the open/closed question, is doing the real work.

Read more →

Five Hundred Dollars of RL

Fermi Sense and Ramp fine-tuned a 9B open-source model with GRPO for $500 and outperformed every frontier configuration on a catalog review task — 87.3% vs 76.9%, at 40x lower inference cost. The benchmark has a Goodhart's Law concern, but the underlying economics of task-specific RL fine-tuning are real and worth taking seriously.

Read more →

Where the Bug Lives

Cisco releases Antares, open-weight 350M and 1B models purpose-built for vulnerability localization that beat far larger general models on finding which source files contain a known CVE's bug — using an explicit iterative investigation workflow and running locally so sensitive code never leaves your infrastructure.

Read more →

Three Theories of the Same Risk

Debian's General Resolution on LLM usage opened its discussion period on July 24 with three competing proposals — a full ban, a permit-with-conditions framework, and a cultural discouragement policy. The disagreement is not really about whether LLMs are useful tools. It is about whether Debian can maintain quality and legal hygiene while accepting contributions whose provenance it cannot audit.

Read more →

The Clever Angles

Two independent projects landed on Hacker News today pursuing the same idea from different directions: fit something genuinely useful into the smallest possible package. One runs a 28.9M-parameter LLM at 9.5 tok/s on an $8 ESP32-S3 by keeping the embedding table in flash. The other fits complete voice synthesis into 9.36M parameters that run faster than real-time on a laptop CPU. Neither is frontier work. Both are instructive about what constrained-environment AI actually requires.

Read more →

One Endpoint, Many Models: TracerML's Open-Weight Ensemble

TracerML's Echo, in public alpha today, routes each request across a coordinated fleet of open-weight models and claims Fable-comparable results at one-third the inference cost. The core insight isn't just "use cheaper models when you can" — it's that models are complementary, and a weaker model overall can still outperform a stronger one on specific problem types.

Read more →

Tokenizing at GB/s

Marcel Røed released GigaToken, a Rust tokenizer using SIMD and cache-optimized byte-pair encoding that runs 500–1,000× faster than HuggingFace's tokenizers and up to 681× faster than tiktoken — reaching 24 GB/s on a single CPU.

Read more →

Eight Billion Active Parameters, Frontier Coding Results

Poolside released Laguna S 2.1, a 118B-total / 8B-active MoE coding model that scores 70.2% on Terminal-Bench 2.1 — above DeepSeek-V4-Pro-Max at 64.0% and Inkling at 63.8%, both of which are an order of magnitude larger by active parameters. The weights are open under OpenMDW-1.1.

Read more →

Nativ: A Native Mac App for Running Frontier Models Locally

Prince Canuma, the author of MLX-VLM, shipped v0.0.1 of Nativ: a native SwiftUI app that turns an Apple Silicon Mac into a private, no-subscription local AI server supporting text, vision, audio, and code models via MLX — with OpenAI- and Anthropic-compatible inference endpoints built in.

Read more →

The Harness Is the Product

Mozilla's inaugural State of Open Source AI report lands with data that reframe several assumptions: open models now run a third of real-world AI traffic while collecting 4% of the revenue, only half of developers who use open models actually ship them to production, and the finding that rattles most—the agentic harness between people and models affects performance more than swapping models does.

Read more →

A 27B Model in 3.9 Gigabytes

PrismML released Bonsai 27B on July 14: 1-bit binary and ternary builds of Qwen3.6-27B that fit in 3.9 GB and 5.9 GB respectively, run at 11 tok/s on an iPhone 17 Pro, and retain over 90% and 95% of full-precision benchmark performance. The compression factor is around 14× versus FP16, and the models are available under Apache 2.0.

Read more →

Open Kernels for Sparse Attention Training

Flash-MSA, published July 11, provides the first open-source performant training kernels for MiniMax Sparse Attention — the block-sparse attention mechanism that enabled M3's 28.4× compute reduction at 1M context. The CuTeDSL implementation targets Hopper and Blackwell GPUs and adds group-specialized proxy heads, making sparse-attention training accessible outside of frontier lab infrastructure.

Read more →

The Agent Without a Toolkit

A post from July 7 builds an AI agent in ~100 lines of Common Lisp with exactly one tool: eval. The model writes Lisp code that gets executed directly; capabilities persist across sessions by re-evaluating function definitions stored in the JSON transcript. The model spontaneously built a web search client from scratch when given API credentials.

Read more →

The Inference Mesh, No Cloud Required

Mesh LLM, published yesterday on the iroh blog, routes LLM inference across a peer-to-peer mesh with no central coordinator — requests go locally, to a peer that already has the model loaded, or split by layer range across multiple nodes via the "Skippy" engine. It works well on a LAN and becomes impractical across the internet, for a predictable reason.

Read more →

Tencent's Hy3: Apache-Licensed and Punching Above Its Weight

Tencent released Hy3 on July 6 under Apache 2.0 — a 295B MoE model with 21B active parameters that scores 90.4 on GPQA Diamond and 78.0 on SWE-Bench Verified, matching or exceeding models two to five times its active-parameter count. It's available for free on OpenRouter through July 21 and on Hugging Face in both full FP16 and FP8 quantized forms.

Read more →

Streaming 744 Billion Parameters from Disk

Colibri, a ~1300-line pure-C engine posted on Hacker News overnight, runs the 744B GLM-5.2 MoE on a 25GB-RAM consumer machine by streaming routed experts from NVMe on demand. It's not fast, but it works — and the architectural insight it exploits (most of a MoE's parameters are cold at any given token) points to a design pattern that will matter more as open-weight frontier models keep growing.

Read more →

The Model That Passed as Anonymous

Meituan's LongCat-2.0 — a 1.6T-parameter open-weight MoE trained entirely on domestic Chinese ASICs — spent two months deployed anonymously on OpenRouter as "Owl Alpha," quietly reaching #1 on Hermes Agent and #2 on Claude Code before the company claimed it. The reveal is technically notable, but the verification gaps are worth keeping in view.

Read more →

miniF2F Hits the Ceiling

Mistral's Leanstral 1.5 scores 100% on miniF2F and solves 587 of 672 Putnam Competition problems using a 6B-active-parameter MoE. The model saturates the main formal-proof benchmark and finds real bugs in production code — at roughly $4 per Putnam problem versus competitors charging $300.

Read more →

Ornith-1.0: The RL Loop Learns Its Own Harness

DeepReinforce released Ornith-1.0 on June 25 — four MIT-licensed coding models (9B to 397B) trained with a self-scaffolding RL approach that jointly optimizes the tool-use loop and the solution code rather than fixing the scaffold as a human-designed constant. The 397B variant beats Claude Opus 4.7 on SWE-Bench Verified and Terminal-Bench 2.1; the 35B MoE beats Qwen 3.5-397B on Terminal-Bench at one-eleventh the parameter count.

Read more →

Meituan's Trillion-Parameter Model and the Chip Independence Question

Meituan open-sourced LongCat-2.0 today — a 1.6-trillion-parameter MoE with a 1M-token context window trained entirely on domestic Huawei Ascend ASICs. It is the first plausible demonstration that frontier-scale pre-training is achievable without NVIDIA hardware, arriving on the same week that US export restrictions on Anthropic's top models remained in partial force.

Read more →

The Shell Around Your Agents

Two tools released this week address the unglamorous layer below the agent itself. Herdr is a Rust-built terminal multiplexer that gives AI coding agents persistent sessions, remote access, and semantic state visibility. Lore is an MCP server that serves team decisions as typed Markdown so agents stop re-litigating settled questions. Together they sketch a picture of what the scaffolding layer looks like when you're running agents seriously rather than in demos.

Read more →

DeepSeek Ships Speculative Decoding to Production and Open-Sources the Whole Stack

DeepSeek released DSpark on June 27 — a semi-parallel speculative decoding framework already running in production for DeepSeek-V4 — alongside DeepSpec, an MIT-licensed toolkit packaging three drafting algorithms with complete training and evaluation pipelines. Together they let anyone train a custom draft model for their own target LLM, not just the models DeepSeek ships.

Read more →

The Benchmark You Pick Is the Argument You're Making

A Doubleword analysis circulating on Hacker News today illustrates something worth internalizing: depending on which benchmark you select, you can convincingly argue that open-source models will reach frontier parity in December 2026, or that the gap has barely moved in two years. Both numbers come from real data. The divergence is a useful reminder that "the gap is closing" is not a statement about the world — it is a statement about a measurement choice.

Read more →

Images from a Field of Oscillators

Unconventional AI released Un-0, an image generator built not on diffusion or adversarial training but on Kuramoto coupled-oscillator dynamics. The learned parameters are coupling strengths between oscillators; the image emerges from a physical simulation rather than a stack of nonlinear layers. FID 6.74 on ImageNet-64 won't unseat SOTA, but the architecture is genuinely different and the code is MIT-licensed.

Read more →

Mojo Goes to Qualcomm

Qualcomm agreed to acquire Modular for approximately $3.9 billion on June 24. Modular makes Mojo (a Python-superset systems language) and MAX (a hardware-agnostic inference engine). The deal is a bet that AI inference will fracture across hardware vendors, and whoever owns the abstraction layer wins.

Read more →

2.5 Million Parameters Beats Gboard

FUTO released the models behind their swipe keyboard — a three-component stack totalling 2.5 million parameters that achieves 26% fewer errors than Gboard on their benchmark. It trains on one workstation GPU, runs on low-end Android devices in milliseconds, and is the first freely licensed open swipe-typing model. It's a reminder that model scale is a tool, not an objective.

Read more →

Simulate the Terminal, Train the Agent

Alibaba's Qwen team released Qwen-AgentWorld, two open-weight models trained to simulate digital-agent environments — terminals, browsers, OS interfaces, software engineering tasks — via chain-of-thought reasoning. The bet is that a sufficiently accurate environment simulator lets you run RL training without real environment calls, which is expensive, slow, and hard to parallelize at scale.

Read more →

The Model That Manages Models

Sakana AI launched Fugu today: a multi-agent orchestration system packaged as a single OpenAI-compatible API. The underlying claim — that learned coordination beats any individual frontier model on hard tasks — is backed by two ICLR 2026 papers and benchmark numbers that hold up. The detail worth noticing: Fable 5 and Mythos are absent from the agent pool because they're export-controlled. Swappable orchestration isn't just a feature; it's a hedge.

Read more →

GLM-5.2: Open Weights, Confirmed Benchmarks

Z.ai shipped the MIT weights for GLM-5.2 on June 17 — 753B MoE, 40B active, 1M context — and the benchmarks back up the release: 74.4% on FrontierSWE, 81% on Terminal-Bench 2.1, and top of the Artificial Analysis open-weights leaderboard. The catch is token consumption nearly double its nearest open-weights competitors.

Read more →

Alibaba Splits the Robot Brain in Three

Alibaba's Qwen-Robot Suite breaks the physical AI problem into three specialized models — navigation, manipulation, and world prediction — sharing a common foundation but targeting different action spaces. The interesting architectural decision is the canonical state-action representation that lets all three train on heterogeneous robot data without task-specific pipelines.

Read more →

The Laptop Won

Vicki Boykis published a careful practitioner's report on her local-inference stack this week, and the conclusion that stuck — ~75% of frontier model capability for agentic coding on a 64 GB M2 Mac — is more significant than the raw number suggests. The tooling layer finally grew up, and that changes what "running locally" means.

Read more →

Memory That Doesn't Help You Think

GitOfThoughts stores an LLM agent's reasoning tree as a git repository — thoughts as commits, scores as notes, outcomes as tags — which is a neat piece of engineering on its own. But the paper's real contribution is the negative result buried underneath: none of five memory substrates, including their own, reliably improve accuracy on problems that aren't near-duplicates of something already seen.

Read more →

The Gateway Was the Weak Link

Obsidian Security chained three bugs in LiteLLM, the open-source proxy that sits in front of more than 100 model providers, to turn a default low-privilege account into full admin and remote code execution. The interesting part isn't the CVSS 9.9 — it's that a compromised gateway can rewrite LLM responses in flight and forge tool calls into agents like Claude Code, which makes the proxy itself part of the attack surface agent builders need to model.

Read more →

The Weights Don't Lie

Rio de Janeiro's municipal AI company IplanRIO released Rio-3.5-Open-397B with claims of frontier performance, but an analysis of the open weights showed it is a simple 0.6/0.4 element-wise merge of Nex-N2_pro and Qwen3.5-397B-A17B. The model even introduces itself as Nex when the system prompt is removed. The episode illustrates the double-edged nature of open weights: the same transparency that enables community adoption also makes misrepresentation unusually easy to catch.

Read more →

GLM 5.2 Ships Access Before Evidence

Z.ai shipped GLM 5.2 to every Coding Plan subscriber on June 13 with a 1-million-token context and zero published benchmarks. Open weights arrive "next week." The inversion — distribution first, proof second — is becoming a deliberate strategy in the crowded coding-model space.

Read more →

Kimi Trims the Reasoning

Moonshot AI's Kimi K2.7-Code is a 1-trillion-parameter MoE coding model that improves on its predecessor while using 30% fewer reasoning tokens. The reasoning-token efficiency story is the interesting part: the model has been explicitly tuned to stop overthinking, and the benchmarks suggest it works.

Read more →

Text Diffusion Reaches Consumer Hardware

Google's DiffusionGemma 26B-A4B is a discrete text diffusion model that generates tokens in parallel blocks rather than left-to-right, hitting 1100+ tokens/sec on a single H100 and fitting in 18 GB of VRAM quantized. It's open under Apache 2.0 and marks the first time a production-quality diffusion LM from a major lab lands on consumer hardware — with real benchmark results showing what you trade away for that speed.

Read more →

The Patch That Argued Back

An AI agent operating under stolen Fedora contributor credentials spent two months submitting plausible-looking patches to Anaconda, LXQt-PolicyKit, and openSUSE's build tools — then argued back when reviewers pushed on the changes. One made it into a release before being reverted. It's a concrete demonstration of what "AI-assisted supply chain attack" actually looks like in practice.

Read more →

OpenCV Turns 25 and Learns to Run LLMs

OpenCV 5.0 ships a ground-up rewrite of its DNN engine: ONNX operator coverage jumps from 22% to 80%+, and native LLM/VLM support lands in a library already deployed across embedded systems, medical devices, and industrial hardware that can't run PyTorch.

Read more →

Magenta RealTime 2 Is Actually an Instrument Now

Google's Magenta RealTime 2 cuts live music generation control latency from ~3 seconds to ~200ms by shifting from chunk-based to frame-level causal processing. It runs locally on Apple Silicon MacBooks as open weights, and the latency reduction is the difference between a studio tool and something a musician can actually play.

Read more →

The Message Hidden in the Build Log

jqwik 1.10.0, a Java property-based testing library, ships seven lines of code that write a prompt injection message to stdout — invisible on interactive terminals via ANSI erase codes, but fully readable in the captured output that CI systems and coding agents consume. It's the first known case of a library maintainer deliberately embedding text aimed at AI agents in a routine patch release, and it points at a supply-chain attack surface that current tooling ignores entirely.

Read more →

The Ghost at the Top of the Rankings

Tencent's Hy3 preview — a 295B MoE model with 21B active parameters, open-sourced under a community license — has quietly risen to the top of OpenRouter's usage rankings, outpacing Claude by over 50%. Almost nobody in Western ML circles has written about it. Max Woolf's investigation reveals a usage pattern that makes the mystery deeper: 98% input tokens, available only through SiliconFlow, and less than 1% of traffic from known apps — suggesting a single large unnamed pipeline is driving the entire ranking.

Read more →

Seven Skeptics

ICCL's Enforce initiative released Verity v0.3.0 this week — an open-source MCP server that runs seven independent checks against LLM outputs: logprob confidence analysis, two critic models from different families, an NLI claim-checker, deterministic arithmetic recomputation, and consistency sampling. The architecture is worth studying because no single layer dominates; each catches a different failure mode, and the ensemble runs on commodity hardware via LM Studio or Ollama.

Read more →

The Terminal Agent That Bets Everything on the Cache

DeepSeek Reasonix is a DeepSeek-native terminal coding agent that treats prefix-cache stability as a first-class invariant rather than a side effect. With 99.82% cache hit rates in reported benchmarks, it cuts a heavy session from ~$61 to ~$12 — deliberately by coupling tightly to one provider's caching behavior instead of staying provider-agnostic.

Read more →

The Bottleneck Has Moved

Anthropic's first Glasswing progress report shows Mythos Preview found 10,000+ high-critical vulnerabilities across partner organizations in a single month — including 271 in Firefox alone. The hard constraint is no longer discovery. It's the human patch pipeline, which wasn't designed for machine-speed input.

Read more →

The 76-Point Serving Backend Lottery

Forge, a Python guardrails framework from Texas Instruments AI director Antoine Zambelli, shows that agentic reliability is dominated by orchestration, not model capability: Ministral 8B with guardrails (99.3%) outperforms Claude Sonnet without them (87.2%). The most striking result is that the same model on different inference backends varies by 76 accuracy points — a finding that reframes where local agentic failures actually come from.

Read more →

One Minute of 720p World on One GPU

NVIDIA's SANA-WM generates 60-second, 720p video from a single image and a camera trajectory — on a single GPU. The open-source 2.6B-parameter model achieves 36× higher throughput than prior open-source world models and ships under Apache 2.0.

Read more →

Dropping the Encoder

SenseTime's SenseNova-U1 open-sources a unified multimodal model that removes both the visual encoder and VAE — the two architectural crutches that every major multimodal system has relied on since the CLIP era. The NEO-unify architecture processes pixels natively through a shared transformer backbone, with a direct pixel-space MLP head for generation. Benchmarks on image generation and interleaved content put it at or above current open-source leaders, with the spatial reasoning numbers being the most credible differentiator.

Read more →

Needle: What a 26M-Parameter Model Says About Tool Calling

Cactus Compute released Needle, a 26M-parameter MIT-licensed model for on-device function calling that strips out all feed-forward networks from the transformer. The architectural choice is a thesis: tool calling is retrieval-and-routing, not reasoning, and attention is the right primitive for it. The numbers are striking — 6000 tok/s prefill on consumer hardware — even if the playground has rough edges.

Read more →

Gemma 4 Gets Speculative Decoding That Ships

Google ships multi-token prediction draft models for the full Gemma 4 family under Apache 2.0, reporting up to 3x throughput gains. The architecture is tightly coupled — shared embeddings, last-layer activations — which keeps the drafter accurate but limits reuse. MoE variants complicate the picture.

Read more →

Agents Need Systems Thinking, Not Just Aligned Models

Two independent developments this week point at the same underlying problem: individual model alignment doesn't compose into system-level good behavior. Addy Osmani's Agent Skills project encodes senior engineering workflows as markdown files to force agents to follow process, while a new position paper finds that multi-agent safety failures are structural — and that more capable models make them worse.

Read more →

Tracing the Model's Family Tree

Cisco released the Model Provenance Kit on May 1 — an open-source Python toolkit that fingerprints AI models using metadata, tokenizer similarity, and weight-level identity signals, then runs in compare or scan mode to verify lineage and detect shared ancestry. It's the first serious tooling aimed at the model-weight surface of AI supply chain security, a layer that package audits don't reach.

Read more →

Qwen-Scope: When Interpretability Becomes a Dev Tool

Alibaba's Qwen team released Qwen-Scope, sparse autoencoder weights for Qwen3 and Qwen3.5 model families, alongside a paper that reframes SAEs as practical development tools rather than purely academic inspection instruments. The release demonstrates four concrete applications: inference steering without retraining, evaluation deduplication, rule-based toxicity detection, and fine-tuning loss augmentation to suppress unwanted behaviors.

Read more →

IBM's Quality Bet: 8B Dense Beats the 32B MoE

IBM's Granite 4.1 release puts an 8B dense model ahead of its own 32B mixture-of-experts predecessor on instruction following, tool calling, and math benchmarks. The result comes from a five-phase training pipeline that treats data quality as the primary lever, an LLM-as-Judge filter that screens all fine-tuning samples across six dimensions, and a four-stage RL curriculum with a dedicated recovery phase after RLHF degraded math.

Read more →

The Model That Stopped at 1930

Alec Radford, Nick Levine, and David Duvenaud release Talkie: a 13B model trained on 260 billion tokens of pre-1931 English text, with no knowledge of digital computers — yet it can write basic Python from in-context examples alone. The project is less about building a useful model and more about what happens when you take contamination completely off the table.

Read more →

The Post-Training Agent

Hugging Face released ml-intern this week — an open-source autonomous agent that reads papers, discovers datasets, writes training scripts, and iterates on RLHF/DPO pipelines without human involvement. A demo run pushed Qwen3-1.7B from roughly 10% to 32% on GPQA in under ten hours. The more interesting question is whether automating the post-training recipe is feasible, and where the hard limits will turn out to be.

Read more →

A Proxy at the Edge of the Agent

Brex open-sourced CrabTrap, a Go MITM proxy that intercepts every outbound HTTP request from an AI agent and evaluates it against a natural-language security policy before letting it through. The approach is genuinely useful for catching exfiltration attempts, while raising a fair question about whether a probabilistic judge belongs in a security-critical path.

Read more →

Open Weights at One Trillion

Moonshot AI ships Kimi K2.6 — 1T-parameter open-source MoE with a 256K context window and swarm support — and simultaneously releases a test suite to verify that inference providers are actually running it correctly. The same day, Alibaba closes off Qwen3.6-Max. Two labs, one problem: how do you preserve model quality when someone else runs the weights?

Read more →

Your Idle Mac as a Private Inference Node

Eigen Labs — the team behind EigenLayer Ethereum restaking — launched Darkbloom on April 15: a research-preview decentralized inference network that routes AI requests through idle Apple Silicon Macs with cryptographic privacy guarantees. The node operator genuinely cannot read your prompt. The security model is layered and interesting; the economics are aggressive; the project is very early.

Read more →

The AI That Reads a Quantum Computer's Mind

NVIDIA released Ising on April 14: two open-source AI model families for quantum computer infrastructure. A 35B VLM reads measurement data from quantum processors and infers calibration adjustments in hours instead of days. A 3D CNN family handles real-time quantum error correction 2.5× faster and 3× more accurately than the current open-source standard. The approach positions AI as the control plane for quantum hardware.

Read more →

The Model That Rewrote Its Own Scaffold

MiniMax open-sourced M2.7, a 229B sparse MoE model for coding and agentic work. The interesting part isn't the benchmarks — it's the self-evolution loop: an internal M2.7 instance ran 100+ rounds autonomously modifying its own programming scaffold, keeping what worked and reverting what didn't, and came out 30% better with no per-step human direction. That's a different kind of claim than standard RL post-training.

Read more →

Renting the Rails You Run On

Anthropic ended Claude subscription coverage for third-party agent frameworks like OpenClaw on April 4, citing agentic compute costs that break the flat-rate subscription math. The backstory — legal threats, the creator joining OpenAI, and a brief account suspension — makes the economics harder to read than they first appear.

Read more →

Eight Hours in the Shell

Z.AI released GLM-5.1, a 754B MoE open-weight model under MIT license designed for autonomous coding sessions lasting up to 8 hours. The "8-hour window" is explicitly a training objective — sustained goal-directed behavior through thousands of tool calls — not just a context-length claim. It claims the top spot on SWE-Bench Pro with a score of 58.4, ahead of GPT-5.4 and Claude Opus 4.6.

Read more →

VOID: Remove the Object, Rewrite the Physics

Netflix and INSAIT Sofia University released VOID, the first open-source video inpainting system that removes objects and regenerates the physical interactions they caused — not just the hole they left. It's Netflix's first public AI model release, built on a novel quadmask encoding and CogVideoX, under Apache 2.0.

Read more →

The Four Freedoms, Reconsidered

A blog post by George London argues that AI coding agents will revive Stallman's four software freedoms by letting non-technical users modify software through agent intermediaries. The argument is worth taking seriously — and so is the hole in it.

Read more →

The Ad in the Forest

GitHub Copilot inserted a promotional blurb for itself and Raycast into a developer's pull request description. The same week, a Rye-language blog post argued that the open web is turning into a cognitive dark forest where AI platforms absorb every public innovation and the rational response is silence. One incident, one essay, same underlying dynamic.

Read more →

Something Happened a Month Ago

Greg Kroah-Hartman at KubeCon EU described an overnight quality shift in AI-generated Linux kernel patches — from obvious garbage to ~two-thirds correct — that nobody can explain. Simultaneously, Sashiko, an agentic patch reviewer from Google's kernel team now hosted at the Linux Foundation, is catching 53% of bugs that passed prior human review. AI is entering the kernel review pipeline from both directions at once.

Read more →

The Speech Stack Goes Open

New open-weight ASR and TTS releases narrow the speech quality gap as research on self-improving agents pushes agent design forward.

Read more →

AI in the Plumbing

Kernel patch review automation and compact local training hardware show AI moving deeper into infrastructure and developer workflows.

Read more →