Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

ProWAM: Sparse Visual Sub-Goals Push World Action Models to New Robotic Control Records

AI By Crimson AI Hugging Face Papers 5 October 2026 · 00:00 9 views
Share: X Telegram

A new Hugging Face paper introduces ProWAM, a progressive world action model that predicts an ordered sequence of sparse visual sub-goals to guide robotic control, setting state-of-the-art results on LIBERO-Plus and randomized RoboTwin while improving zero-shot real-world success to 70.0%.

ProWAM: Sparse Visual Sub-Goals Push World Action Models to New Robotic Control Records

Key points

Researchers have introduced ProWAM, a progressive world action model (WAM) designed to improve long-horizon robotic control by jointly predicting actions and an ordered sequence of sparse visual sub-goals. The work, published as a paper on Hugging Face, addresses a key limitation of existing WAMs: generating dense video rollouts is highly inefficient, while predicting only a single future frame neglects how to progress toward a goal.

ProWAM instead provides explicit visual guidance by anchoring action generation to a sequence of sub-goals throughout task execution. According to the paper, this design scales naturally because sub-goal prediction can be learned from large-scale action-free videos, allowing the video backbone to offload complex visual planning from the action policy.

For efficient action generation, ProWAM performs a single video-backbone forward pass to cache sparse sub-goal features, eliminating iterative full-video generation and requiring only lightweight action denoising during replanning.

In evaluations, ProWAM demonstrated superior out-of-distribution robustness. On simulation benchmarks, it set new state-of-the-art results on LIBERO-Plus (85.8%) and randomized RoboTwin (75.7%), outperforming the strongest baseline with relative gains of up to +35.9%. On RoboCasa365, it achieved a 48.1% success rate and 18.2% on the challenging Composite-Unseen split, ranking 4th overall.

Crucially, in zero-shot real-world experiments, ProWAM reached 70.0% success, outperforming the strongest baseline by +15.0 points (from 55.0% to 70.0%, a +27.3% relative gain) in novel scenes. The authors state these results demonstrate the value of progress-indexed visual foresight for closed-loop control. The project page is available at https://sii-ferenas.github.io/ProWAM-page.

Benchmark / SettingProWAM ResultComparison
LIBERO-Plus85.8%New state-of-the-art
Randomized RoboTwin75.7%New state-of-the-art; up to +35.9% relative gain over strongest baseline
RoboCasa36548.1% success4th overall
RoboCasa365 Composite-Unseen18.2%Challenging split
Zero-shot real-world (novel scenes)70.0% success+15.0 points over strongest baseline (55.0% to 70.0%; +27.3% relative)
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

3
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

4
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

4