Papers
arxiv:2609.15982

The Router Within: Eliciting Native Skill Routing from a Frozen LLM

Published on Sep 14
· Submitted by
Ruishuo Chen
on Sep 16
Authors:
,
,
,

Abstract

Gavel extracts skill-routing signals from frozen LLM hidden states via lightweight linear projections to select tools without external retrieval or context overload.

Skills extend an LLM agent beyond its parametric knowledge, and the gain they promise rests on picking the right one. Deployed harnesses route by preloading every skill's metadata into the context, which disperses the agent's attention and caps the library size. Retrieval pipelines move the selection out of the context, but also out of the agent's capability. We show that the frozen agent LLM already carries the routing signal in its own forward passes, and that two linear maps suffice to read it out with no skill text in the context. Gavel (Glance And Verdict from a frozen LLM) reads it in two steps. A glance projects the task's and each skill's mid-layer states through the two maps, the only parameters trained, and scores the full library against compact per-skill banks that one forward pass builds at installation. A verdict then resumes the shortlisted skills' forward passes and reads the model's own likelihood and yes/no judgment, fused with the glance as a product of experts. Trained once, Gavel transfers zero-shot to three public benchmarks and SkillTraj, our new benchmark of 372 simulated agent trajectories. On Qwen3-32B it outperforms progressive disclosure and retrieve-and-rerank pipelines that add 1.2B to 16B external parameters, by up to 13.4 points on written tasks and up to 21.9 when the need for a skill arises mid-rollout. Routing accuracy improves as the backbone does, and in a bash-agent harness the same 32B triggers the correct skill on Skill-Use more often than far larger frontier models running in Codex.

Community

Paper author Paper submitter

⚖️ Gavel: skill routing without a skill catalog in your context.

Hi everyone! I’m Ruishuo, the first author of Gavel. Progressive disclosure lets the agent choose skills by reading their metadata in context. We show that a frozen LLM can instead route through its own hidden states and candidate judgments, without preloading skill metadata into the agent’s context or adding a separate retrieval model.

Gavel stands for Glance And Verdict from a frozen LLM:

  • 🔍 Glance uses the model’s hidden states to shortlist skills from compact, precomputed skill banks.
  • ⚖️ Verdict combines the glance score with the same LLM’s likelihood and yes/no judgments in a product of experts to select the final skill.
  • 🧊 The backbone stays frozen. The two projections contain just 7.9M trainable parameters on Qwen3-32B. Each new skill is indexed with one frozen forward pass, with no per-skill training.

We evaluate Gavel on three public benchmarks and introduce SkillTraj, which tests routing when the need for a skill arises amid the noisy context of an agent trajectory.

If you’re building agents with growing skill libraries, we’d love to hear how you handle routing today. Happy to discuss the method, results, and deployment trade-offs!

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2609.15982
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.15982 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2609.15982 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2609.15982 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.