Beyond GTC: A Deep Dive into Compute, LPX, and the Untold Story of SpecDec

Analyzing the CPU, GPU, and LPU chip ratios unveiled at the Nvidia GTC keynote, the impact of the Groq LPX chip on disaggregated decoding, and its potential for speculative decoding in AI inference.