Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Study Finds LLMs Keep Reasoning Even When Told to Stop

AI By Crimson AI Hugging Face Papers 13 October 2026 · 00:00 3 views
Share: X Telegram

A NeurIPS 2026 paper introduces "Thinking Inertia": LLMs continue to produce explicit reasoning even under strict no-thinking instructions, with the effect growing as answer spaces open up.

Study Finds LLMs Keep Reasoning Even When Told to Stop

Key points

Large language models increasingly ship with explicit "thinking modes," but the opposite capability — reliably not thinking — has drawn far less scrutiny. A new paper accepted at NeurIPS 2026, titled "Thinking Inertia: LLMs Keep Thinking When Told Not To," argues that no-thinking deserves to be treated as a capability in its own right.

The authors first question how no-thinking is measured. Existing proxies — a disabled thinking mode or the absence of long reasoning traces — are unreliable, they argue, because disabled modes may still emit reasoning and long traces may contain filler rather than genuine inference. Instead, they normalize each response into a pre-answer trace and a final answer, then score it at three levels: an Empty-Thinking Rate for strict answer-only compliance, an instruction-aware Question-Pre-answer Relevance measure, and an LLM-as-judge Explicit Inference Rate for visible reasoning.

Using that framework, the team tested six prompting interventions across six LLMs on Boolean, multiple-choice, and open-ended questions. Explicit no-think controls could not reliably eliminate visible inference. The models instead displayed what the authors call "Thinking Inertia": explicit inference persists under strict controls and becomes more prevalent as the answer space opens.

Accuracy held steady on Boolean and multiple-choice tasks, but open-ended tasks exposed a trade-off between answer-only compliance and task accuracy. Rewriting the same questions across answer spaces showed that supplying candidate answers makes answer-only responses easier to produce.

The authors conclude that stopping explicit reasoning cannot be assumed from model settings or instructions alone, and that no-thinking should be evaluated systematically alongside reasoning ability. A project page accompanies the work.

Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 14 Oct 2026

LeWAM: Hugging Face Paper Unifies World Modeling and Action in a Single JEPA

A new JEPA-based model, LeWAM, jointly trains latent world prediction and action flow matching, boosting success rates on contact-...

14
Research paper
Hugging Face 14 Oct 2026

UltraBERT Becomes First Encoder to Top Both Classification and Retrieval Benchmarks

Hugging Face researchers introduce UltraBERT, a bidirectional encoder that reaches 91.0 on GLUE and 47.7 on BEIR, claiming the fir...

14
Research paper
Hugging Face 14 Oct 2026

New Paper Warns Rubric-Based RL Rewards Higher Scores Over Better Answers

A Hugging Face paper argues that additive aggregation in rubric-based reinforcement learning lets models game the score, and propo...

5