20250815 - AI ‘chain of thought’ still just a ‘brittle mirage’
Manage episode 500500663 series 3662020
a marketing lie from marketing liars Text version: https://pivot-to-ai.com/2025/08/15/ai-chain-of-thought-is-still-just-a-brittle-mirage/
Patreon: https://www.patreon.com/davidgerard Ko-Fi: https://ko-fi.com/A1529D5 Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6 REDBUBBLE SALE, 25% OFF TODAY: https://pivot-to-ai.redbubble.com
Sources:
Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens (PDF) https://arxiv.org/pdf/2508.01191 Learning to reason with LLMs: Hiding the Chains of Thought https://openai.com/index/learning-to-reason-with-llms/#hiding-the-chains-of-thought
Previously on Pivot to AI:
OpenAI does not want you delving into o1 Strawberry’s alleged ‘chain of thought’ https://pivot-to-ai.com/2024/09/17/openai-does-not-want-you-delving-into-o1-strawberrys-alleged-chain-of-thought/ LLMs can’t reason — they just crib reasoning-like steps from their training data https://pivot-to-ai.com/2024/10/13/llms-cant-reason-they-just-crib-reasoning-like-steps-from-their-training-data/ Apple: ‘Reasoning’ AIs fail hard if they actually have to think https://pivot-to-ai.com/2025/06/08/apple-reasoning-ais-fail-hard-if-they-actually-have-to-think/ video: https://www.youtube.com/watch?v=gSx9pI5so30&list=UU9rJrMVgcXTfa8xuMnbhAEA
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA
163 episodes