The Stochastic Illusion: Why LLMs Aren’t Reasoning
Examining what Large Language Models actually do through the lens of stochastic generation rather than reasoning. Using Apple’s research and Google’s Self-Consistency work as bookends to define the boundaries of ’limited capacity stochastic constructors’ and their implications for AI development.