The Clever Angles

Two independent projects landed on Hacker News today pursuing the same idea from different directions: fit something genuinely useful into the smallest possible package. One runs a 28.9M-parameter LLM at 9.5 tok/s on an $8 ESP32-S3 by keeping the embedding table in flash. The other fits complete voice synthesis into 9.36M parameters that run faster than real-time on a laptop CPU. Neither is frontier work. Both are instructive about what constrained-environment AI actually requires.

Read more →

OpenCV Turns 25 and Learns to Run LLMs

OpenCV 5.0 ships a ground-up rewrite of its DNN engine: ONNX operator coverage jumps from 22% to 80%+, and native LLM/VLM support lands in a library already deployed across embedded systems, medical devices, and industrial hardware that can't run PyTorch.

Read more →