Someone Split an LLM Across Seven Microcontrollers.
Share

A 0.5B-parameter language model, sliced across seven ESP32-S3 boards daisy-chained over SPI, with weights quantised down to roughly 1.58…

 

 A 0.5B-parameter language model, sliced across seven ESP32-S3 boards daisy-chained over SPI, with weights quantised down to roughly 1.58…Continue reading on Medium » Read More IoT on Medium 

#iot

By ali

Leave a Reply