Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

SKILLER: RL Framework Cuts Inference Costs for Small Language Models

AI By Crimson AI Hugging Face Papers 15 August 2026 · 00:00 16 views
Share: X Telegram

Hugging Face researchers introduce SKILLER, a natural-language-driven reinforcement learning framework that automatically generates tailored skills for small open-source models, cutting inference costs while matching closed-source performance on single-skill tasks.

SKILLER: RL Framework Cuts Inference Costs for Small Language Models

Key points

Hugging Face researchers have unveiled SKILLER, a reinforcement learning framework designed to automatically generate tailored skills for small open-source language models, addressing the high inference costs associated with closed-source models. The framework leverages natural language as the sole communication medium between a strong model (acting as actor and critic) and the small-model agent system, which serves as the environment.

Agent skills are standardized formats for packaging procedural knowledge and domain expertise, constraining a model's behavior for repeatable, high-quality task execution. However, popular agent harnesses like Codex and OpenClaw rely on expensive closed-source models, making skill deployment costly. SKILLER aims to change this by enabling small models, deployable on consumer-grade GPUs, to use skills effectively.

In experiments across five benchmarks using Qwen3.5-9B and Qwen3.5-4B, SKILLER outperformed three open-source and one closed-source skill generation or evolution methods. It achieved absolute gains of 4.3 to 20.4 percentage points for the 9B model and 1.8 to 13.3 points for the 4B model, while remarkably matching the performance of strong closed-source models on single-skill tasks in SkillsBench.

The project is open-sourced and available on GitHub, offering a practical solution for reducing inference costs without sacrificing task performance.

ModelAbsolute Gain (percentage points)
Qwen3.5-9B4.3 – 20.4
Qwen3.5-4B1.8 – 13.3
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 29 Aug 2026

Hugging Face Audit: 110 of 124 AI Evaluations Fail to Support Their Claims

A new commit-bound census of 124 Inspect Evals units reveals that 110 stop before deterministic inference due to missing historica...

4
Research paper
Hugging Face 29 Aug 2026

Aphanta: New Framework Diagnoses When Image Editing Boosts Multimodal Reasoning

Hugging Face researchers introduce Aphanta, a diagnostic framework that evaluates when image-editing intermediates improve multimo...

5
Research paper
Hugging Face 29 Aug 2026

EditaLive! Enables Real-Time Character Video Editing for Live Streaming

Hugging Face researchers introduce EditaLive, a framework for real-time human-centric video editing in live streams, achieving sta...

4