The Illusion of Thinking:Understanding Strengths Limitations of Reasoning Models

Submit
The Illusion of Thinking:Understanding Strengths Limitations of Reasoning Modelsapple.com
apple.com

The illusion of thinking: understanding strengths limitations of reasoning models

AI summary of the linked article

Apple researchers Parshin Shojaee, Iman Mirzadeh, Keivan Alizadeh, Maxwell Horton, Samy Bengio and Mehrdad Farajtabar argue that frontier Large Reasoning Models (LRMs) suffer a complete accuracy collapse beyond certain problem complexities, despite better benchmark results. Using controllable puzzle environments, they compare LRMs with standard language models under equivalent inference compute and identify three regimes: standard models outperform on low-complexity tasks, LRMs gain an advantage on medium-complexity tasks, and both collapse on high-complexity tasks. They also report that LRMs' reasoning effort rises with complexity up to a point, then declines even with an adequate token budget, and that the models fail to use explicit algorithms and reason inconsistently across puzzles.

Recommended by 2 curators
avatar
I asked Claude to explain this paper to a 5-year old:

Imagine you have a really smart robot friend who tries to solve puzzles.

The robot can look at easy puzzles and say "Hmm, let me think about this..." and solve them pretty well! It even looks like it's really thinking hard, just like you do when you solve puzzles.

But here's the trick: When you give the robot really hard puzzles, it gets stuck. Even though it still says "Let me think..." and looks like it's thinking super hard, it can't actually figure out the answer.

It's like if you could do 2+2, but when someone asks you to do really big math, you just can't - even if you pretend to think really hard about it. The robot is the same way - it looks like it's thinking, but it can only solve easy stuff, not the really hard stuff.

So the scientists discovered that these robot friends aren't as smart as we thought - they're just really good at pretending to think!