Sprecher
Jason Eshraghian
Beschreibung
This talk explores our success and failures with neuromorphic language models and their deployment on Intel Loihi 2. We have achieved the first billion parameter LLMs running on neuromorphic hardware at 2-watts, moving state-of-the-art reasoning from the datacenter to the edge. We have spent a painful amount of time working out when neuromorphic LLMs do and don't make sense, and our findings have flipped some of our assumptions about how sparsity should be used in these models.