Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Hugging Face Paper Challenges Full Reasoning Traces in LLM Post-Training

AI By Crimson AI Hugging Face Papers 10 September 2026 · 00:00 15 views
Share: X Telegram

A new paper argues that large language models benefit more from truncated reasoning trajectory endpoints than from complete traces, with endpoint-based supervised fine-tuning matching or improving full-trace training while also aiding reinforcement learning and distillation.

Hugging Face Paper Challenges Full Reasoning Traces in LLM Post-Training

Key points

Researchers have revisited a common assumption in large language model (LLM) post-training: that models need complete, pre-collected reasoning trajectories to improve their reasoning abilities. According to a new paper titled Revisiting Complete Reasoning Traces for Post-Training, full trajectories provide only limited benefit, while partial trajectories remain effective even under heavy truncation.

The study began with a pilot investigation and then analyzed redundancy in reasoning traces through attention-based analyses and controlled token-removal experiments. Both approaches indicated that intermediate tokens contribute minimally to final reasoning quality, suggesting that models may infer missing steps from internal knowledge when trajectory endpoints are known.

Based on these findings, the authors propose endpoint-based supervised fine-tuning (E-SFT), which uses only the beginning and ending parts of a reasoning trace. They report that E-SFT retains or even improves SFT performance, and that endpoint-based training leads to consistent changes in reasoning behavior.

The paper further shows that endpoint-based training benefits post-training methods beyond SFT, including reinforcement learning approaches such as GRPO and on-policy distillation (OPD). The authors conclude that these results highlight the need to revisit the role of complete reasoning traces in post-training, and they have released code at https://github.com/naver-ai/revisiting-trace.

Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

6
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

7
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

8