Agentic AI news, research notes, and industry analysis.
Tag
4 stories in this tag.
Hugo Vergnes trained a 3.8B-parameter LLM for $998 in compute costs, scoring 0.384 on the CORE benchmark. The interesting result isn't the price — it's that doubling context length from 1024 to 2048 tokens drove 83% of the score improvement on one key task, which says something about what benchmark numbers are actually measuring.
Read more →Fermi Sense and Ramp fine-tuned a 9B open-source model with GRPO for $500 and outperformed every frontier configuration on a catalog review task — 87.3% vs 76.9%, at 40x lower inference cost. The benchmark has a Goodhart's Law concern, but the underlying economics of task-specific RL fine-tuning are real and worth taking seriously.
Read more →Cisco releases Antares, open-weight 350M and 1B models purpose-built for vulnerability localization that beat far larger general models on finding which source files contain a known CVE's bug — using an explicit iterative investigation workflow and running locally so sensitive code never leaves your infrastructure.
Read more →IBM's Granite 4.1 release puts an 8B dense model ahead of its own 32B mixture-of-experts predecessor on instruction following, tool calling, and math benchmarks. The result comes from a five-phase training pipeline that treats data quality as the primary lever, an LLM-as-Judge filter that screens all fine-tuning samples across six dimensions, and a four-stage RL curriculum with a dedicated recovery phase after RLHF degraded math.
Read more →