Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

WanPE: Hugging Face Paper Unveils 397B Cinematic Prompt Model for Text-to-Video

AI By Crimson AI Hugging Face Papers 25 September 2026 · 00:00 16 views
Share: X Telegram

A new paper introduces WanPE, a 397B-parameter prompt enhancement model trained on 1.05M real-world videos to bring director-level cinematic planning to text-to-video generation, alongside the WanPEval benchmark.

WanPE: Hugging Face Paper Unveils 397B Cinematic Prompt Model for Text-to-Video

Key points

Video generation starts in text space, where a cinematic screenplay is authored before it becomes pixels. As modern video generators scale to 30 seconds and follow increasingly complex conditions, the textual prompt increasingly drives production — planning actions, camera trajectories, lighting, and sound across multi-shot sequences.

A new paper on Hugging Face presents WanPE, a 397-billion-parameter prompt enhancement model trained on 1.05 million real-world videos to perform director-level cinematic planning. The model formulates shot-level cinematic plans through video-grounded reverse construction and applies Semantic-Consistency GRPO (SC-GRPO) to preserve user requirements faithfully across shots and over time.

To measure this capability, the authors curated WanPEval, a human-annotated testbed spanning durations from 5 to 30 seconds across varying intent granularities, supported by roughly 11,000 blind pairwise assessments.

When paired with Wan3.0's video generator, WanPE-397B reportedly raises human preference over raw user prompts by 10.66–18.84 points at 5–15 seconds and by 50.86 points in the 30-second arena. Ablations indicate reverse construction outperforms forward rewriting, while SC-GRPO preserves semantic fidelity across model scales.

The paper states WanPE leads all evaluated commercial offerings at 5–15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

MetricValue
Model parameters397B
Training videos1.05M real-world videos
BenchmarkWanPEval (5–30s durations)
Blind pairwise assessments~11K
Human preference gain (5–15s)10.66–18.84 points
Human preference gain (30s)50.86 points
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

5
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

6
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

6