TorchTPU: PyTorch on TPUs Without the Friction

Google has open-sourced TorchTPU, its long-planned successor to PyTorch/XLA, which brings native tensor integration and MPMD execution support to TPUs. The Fused Eager mode delivers 50–100%+ speedups over strict eager, and vLLM integration is on the roadmap — a meaningful step toward hardware-portable inference.

Read more →

One Vector Space to Rule Them All

Google released EmbeddingGemma 2, a 740M-parameter open model that maps text, code, images, audio, and video into the same embedding space. Built on Gemma 4, with Matryoshka support and 8K context. The interesting part is not the benchmarks — it's the cross-modal retrieval that becomes practical when audio and video share a space with text.

Read more →

Four TPUs at Altitude

Google's Project Suncatcher scheduled its first hardware test for October 1 on SpaceX's Transporter-18 rideshare: four Trillium TPUs going to low Earth orbit to test radiation tolerance, thermal cycling, and launch forces. The companion research paper describes the full engineering stack — free-space optical links at 1.6 Tbps, close-formation station-keeping with Hill-Clohessy-Wiltshire equations, and economics that only close if launch costs fall below $200/kg by the mid-2030s.

Read more →

Google Ships kubectl for Agents

Google open-sourced AX, a declarative orchestration platform for running agent workloads at scale. The Kubernetes-familiar API — apply, get, describe, watch — is deliberate: they want infrastructure engineers, not AI researchers, to be the ones running this. The interesting claim is that agents need a different resource model than containers, specifically around idle cost and untrusted code isolation.

Read more →

TimesFM-3 Crosses the Multivariate Line

Google Research released TimesFM-3 on August 31 — the first version of the family that handles multiple coevolving series natively, zero-shot. The architecture alternates causal temporal attention with full cross-variate attention to capture both within-series structure and cross-series dependency, and tops three public forecasting benchmarks. The pretrained weights are non-commercial only, which is awkward given that the most natural use case is commercial demand forecasting.

Read more →

ML on Ciphertexts

Google's August 14 post on HEIR describes four production deployments of homomorphic encryption for ML inference — fraud detection, recommendations, network intrusion detection, hotword detection — with hardware accelerator partnerships starting to close the latency gap that has kept HE in the lab for the past decade.

Read more →

The Reasoning Traces Were Never Really Private

A paper submitted to arxiv on August 10 shows that OpenAI, Anthropic, and Google were all storing encrypted reasoning traces client-side — passed back as opaque blobs with every request — and that the encryption was trivially bypassed by replaying traces into weaker, jailbroken sibling models. All three providers patched after responsible disclosure.

Read more →

Tabular Data Finally Gets a Foundation Model

Google Research published TabFM, a foundation model for tabular classification and regression that applies in-context learning to structured data — no task-specific training, no hyperparameter tuning. It beats gradient-boosted trees on TabArena's 51 datasets. The field has been promising this result for years; what TabFM does differently is solve the training data problem with massive synthetic generation.

Read more →

Text Diffusion Reaches Consumer Hardware

Google's DiffusionGemma 26B-A4B is a discrete text diffusion model that generates tokens in parallel blocks rather than left-to-right, hitting 1100+ tokens/sec on a single H100 and fitting in 18 GB of VRAM quantized. It's open under Apache 2.0 and marks the first time a production-quality diffusion LM from a major lab lands on consumer hardware — with real benchmark results showing what you trade away for that speed.

Read more →

Magenta RealTime 2 Is Actually an Instrument Now

Google's Magenta RealTime 2 cuts live music generation control latency from ~3 seconds to ~200ms by shifting from chunk-based to frame-level causal processing. It runs locally on Apple Silicon MacBooks as open weights, and the latency reduction is the difference between a studio tool and something a musician can actually play.

Read more →

Gemma 4 12B Goes Encoder-Free

Google DeepMind's Gemma 4 12B discards the conventional encoder-stack approach to multimodal models, feeding raw pixel patches and audio waveforms directly into the LLM backbone through lightweight linear projections. The result fits in 16 GB of RAM, accepts native audio, and fine-tunes as a single unified model.

Read more →

The Opt-Out Market

A week after Google I/O declared AI Mode had a billion monthly active users, DuckDuckGo saw iOS installs spike 69.9% week-over-week and YouTube moved to automatically label AI-generated video. The data suggests that forcing AI into default experiences creates measurable resistance — distinct from users who actively choose AI tools.

Read more →

Invisible Ink That Washes Off

OpenAI announced it is embedding Google DeepMind's SynthID invisible watermarks and C2PA metadata into all AI-generated images, along with a public verification portal. Hours later, a Python CLI appeared on GitHub that defeats SynthID v2 by round-tripping images through SDXL diffusion. The episode illustrates what content provenance systems can and can't do.

Read more →

Gemma 4 Gets Speculative Decoding That Ships

Google ships multi-token prediction draft models for the full Gemma 4 family under Apache 2.0, reporting up to 3x throughput gains. The architecture is tightly coupled — shared embeddings, last-layer activations — which keeps the drafter accurate but limits reuse. MoE variants complicate the picture.

Read more →