Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Gavel Reads Skill Routing Signals Inside a Frozen LLM's Hidden States

AI By Crimson AI Hugging Face Papers 16 September 2026 · 00:00 12 views
Share: X Telegram

A new Hugging Face paper proposes Gavel, a method that extracts skill-routing signals from a frozen LLM's hidden states using two lightweight linear projections, avoiding skill metadata in context or a separate retrieval model.

Gavel Reads Skill Routing Signals Inside a Frozen LLM's Hidden States

Key points

Skill libraries let an LLM agent act beyond its parametric knowledge, but only if the agent picks the right skill. Common harnesses preload every skill's metadata into the context, which spreads the model's attention thin and limits how large the library can grow. Retrieval pipelines move selection outside the context, but also outside the agent's own capability.

A new paper, The Router Within: Eliciting Native Skill Routing from a Frozen LLM, argues that the frozen agent model already carries the routing signal in its forward passes. The proposed method, Gavel (Glance And Verdict from a frozen LLM), reads that signal with two linear maps and no skill text in the context.

Gavel works in two steps. A glance projects the task's and each skill's mid-layer states through the two maps — the only trained parameters — and scores the full library against compact per-skill banks built with a single forward pass at installation. A verdict then resumes the shortlisted skills' forward passes and reads the model's own likelihood and yes/no judgment, fused with the glance score as a product of experts.

According to the authors, the backbone stays frozen and the two projections contain just 7.9M trainable parameters on Qwen3-32B. Each new skill is indexed with one frozen forward pass, with no per-skill training. Trained once, Gavel is reported to transfer zero-shot to three public benchmarks and to SkillTraj, a new benchmark of 372 simulated agent trajectories that tests routing when the need for a skill arises mid-rollout.

On Qwen3-32B, the paper reports gains of up to 13.4 points on written tasks and up to 21.9 points when the need for a skill arises mid-rollout, compared with progressive disclosure and retrieve-and-rerank pipelines that add 1.2B to 16B external parameters. Routing accuracy is said to improve with the backbone, and in a bash-agent harness the same 32B model reportedly triggers the correct skill on Skill-Use more often than larger frontier models running in Codex.

ItemDetail
MethodGavel (Glance And Verdict from a frozen LLM)
BackboneFrozen LLM (evaluated on Qwen3-32B)
Trainable parameters7.9M (two linear projections on Qwen3-32B)
Skill indexingOne frozen forward pass per skill; no per-skill training
EvaluationThree public benchmarks plus SkillTraj (372 simulated agent trajectories)
Reported gains (Qwen3-32B)Up to 13.4 points on written tasks; up to 21.9 points when a skill is needed mid-rollout
Baselines comparedProgressive disclosure and retrieve-and-rerank pipelines adding 1.2B–16B external parameters
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

6
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

7
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

8