reasoning failures

A model can write a flawless paragraph about logic and then trip over the logic itself. It miscounts items in a list, drops a minus sign in arithmetic, contradicts something it said three sentences earlier, or confidently solves a puzzle by quietly changing the rules. The reason is that it is matching patterns of how reasoning is written, not running a guaranteed reasoning procedure underneath — so it imitates the look of careful thought without the machinery that makes thought reliable.

This shows up most where small steps must chain exactly: multi-step math, tracking who knows what in a story, or following constraints that all have to hold at once. Prompting the model to think step by step helps, because writing out intermediate steps gives it more room to stay consistent, and offloading hard arithmetic to a calculator tool helps more. But the brittleness never fully disappears — a long enough chain or an unfamiliar twist will eventually break it, so verify any conclusion that actually matters.