Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

WorldGuide Turns Video Generation Into Closed-Loop Task Execution

AI By Crimson AI Hugging Face Papers 10 October 2026 · 00:00 2 views
Share: X Telegram

A new Hugging Face paper from MBZUAI-ORYX introduces WorldGuide, a goal-directed video world model that plans and executes procedural tasks step by step, paired with a 59K-video benchmark for step-level action supervision.

WorldGuide Turns Video Generation Into Closed-Loop Task Execution

Key points

Researchers have introduced WorldGuide, a goal-directed video world model that reframes procedural video generation as closed-loop task execution rather than a fixed open-loop rollout. The work appears as a paper on Hugging Face, with a project page and code released by the MBZUAI-ORYX group.

The core problem the paper identifies is that long-horizon procedural tasks require generation to adapt to what has actually been produced. A model must determine the next action from its generated state, execute that action, and recognize when the task is complete. Open-loop generation cannot adapt to execution outcomes, while existing closed-loop systems often depend on pretrained executors or indirect verification, leaving a gap between deciding an action and realizing it.

WorldGuide addresses this with two components trained on the same step-level procedural demonstrations: a ContextPlanner that predicts the next atomic action — or a completion token — from the generated visual state, and an Executor trained to render that action as a video clip. The generated result then guides the next action or termination. A hierarchical visual memory maintains state across long-horizon execution while keeping history token cost bounded.

Because step-level action-video supervision for joint planner-executor training was lacking, the team built WorldGuide Bench, comprising roughly 59K step-annotated videos spanning 245 tasks and 27 procedural categories.

On WorldGuide Bench, WorldGuide reaches 33.33% Task Success, compared with 29.90% for the recent video model MiniMax-H3 — even though MiniMax-H3 receives reference action plans. On VideoCraft-Bench, WorldGuide scores 47.69% versus 32.73% for MiniMax-H3 under goal-only conditioning. The authors conclude that coupling planning with learned execution is central to goal-directed procedural video generation.

BenchmarkWorldGuideMiniMax-H3Conditioning
WorldGuide Bench (Task Success)33.33%29.90%MiniMax-H3 receives reference action plans
VideoCraft-Bench47.69%32.73%Goal-only conditioning
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

0
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

0
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

0