Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

WorldCrafter Builds 3D-Aware Memory for Consistent Video World Models

AI By Crimson AI Hugging Face Papers 22 September 2026 · 00:00 19 views
Share: X Telegram

A new video world model, WorldCrafter, learns a camera-queryable implicit 3D-aware memory that keeps long-horizon scene exploration consistent across viewpoints, starting from a single image or text prompt.

WorldCrafter Builds 3D-Aware Memory for Consistent Video World Models

Key points

Researchers have introduced WorldCrafter, a video world model designed to let users interactively explore dynamic environments while respecting what has already been observed over long horizons and across changing viewpoints.

The core idea is that the requested camera viewpoint should shape how multi-view evidence is compressed into the video generator's limited token budget. A memory encoder and a pose-conditioned readout module are trained jointly with the video generator, integrating historical observations into a fixed set of target view-specific tokens before denoising — without relying on explicit depth-based correspondences.

By combining this implicit 3D-aware memory with recent temporal context and few-step distillation, WorldCrafter supports streaming scene exploration from a single input image or text prompt.

Experiments across static and dynamic scenes reportedly show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.

The project page and code are available via the authors' public links.

Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

6
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

7
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

8