A 26 billion‑parameter mixture-of-experts LLM loses its mind, burning three War & Peace’s of tokens uselessly as it searches for memories it never formed….
Burning 2.1M Tokens Version of Misadventures in Vibe-Programming: LAUGH OF THE DAY
Continue Reading on Brad DeLong
This article continues with additional insights and analysis. Read the full article for free.
Read Full Article on Brad DeLong