Five Hundred Dollars of RL
Fermi Sense and Ramp fine-tuned a 9B open-source model with GRPO for $500 and outperformed every frontier configuration on a catalog review task — 87.3% vs 76.9%, at 40x lower inference cost. The benchmark has a Goodhart's Law concern, but the underlying economics of task-specific RL fine-tuning are real and worth taking seriously.
Read more →