Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Mid-Harness Boosts Terminal Agent Reliability by Verifying Actions Before Execution

AI By Crimson AI Hugging Face Papers 1 October 2026 · 00:00 15 views
Share: X Telegram

A new Hugging Face paper introduces Mid-Harness, a method that samples and verifies candidate actions at the model-harness boundary without altering the generator or harness, raising TerminalBench-Lite Pass@1 from 50.00% to 68.03% with a strong verifier.

Mid-Harness Boosts Terminal Agent Reliability by Verifying Actions Before Execution

Key points

Researchers have introduced Mid-Harness, a method that scales test-time compute for terminal agents by sampling and verifying candidate actions before one is forwarded for execution, while keeping the action generator and execution harness unchanged. The work addresses a key gap: a model's ability to generate a useful action does not guarantee that the action will execute reliably, and a poor command such as a wrong package install can alter the environment in ways that hinder later progress.

The paper's central finding is that verification quality determines how much agents benefit from additional action samples. With a TMAX-9B generator, more action sampling yielded little benefit under weak verification, whereas a capable verifier could exploit useful alternatives from the same generator.

On TerminalBench-Lite, a GPT-5.6 Sol verifier raised Pass@1 from 50.00% for the base agent to 68.03% with 8 sampled actions. When TMAX-9B itself served as the verifier, pairwise verification performed best among the evaluated verification mechanisms.

Distilling responses from the stronger verifier into TMAX-9B further improved Pass@1 while leaving the action generator unchanged. With TMAX-9B on TerminalBench-Lite, combining action and trajectory scaling reached higher success at lower estimated token cost than generating more trajectories alone.

The authors report that Mid-Harness also improves performance across additional models, benchmarks, and harnesses, identifying action scaling as a promising target for test-time compute scaling in terminal agents.

SettingVerifierPass@1 (TerminalBench-Lite)
Base agent—50.00%
Mid-Harness, 8 sampled actionsGPT-5.6 Sol68.03%
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

4
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

5
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

5