Seven Microcontrollers, One Language Model
Low-Zi-Hong sliced a ~0.4B BitNet model across a cluster of seven ESP32S3 microcontrollers connected by daisy-chain SPI: master handles tokenization and embeddings, six compute nodes process four transformer layers each using 1.58-bit ternary weights from flash. It works. It is slow. It is the most literal possible demonstration of the BitNet "run anywhere" claim.
Read more →