The Model That Edits Its Own Notes
A Meta AI and Allen AI paper proposes Context Language Models: give a model read-write access to its own context as a plain file, let it use Bash tools to edit what it carries forward, and watch it cut FLOPs by up to 59% on long-horizon tasks while scoring higher. The serving side gets a matching trick — Suffix Cache Reuse — that reuses unchanged KV cache states after an edit rather than recomputing from scratch.
Read more →