Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Hugging Face Unveils Lucida: A New Pipeline for Composable Real-to-Sim Scene Modeling

AI By Crimson AI Hugging Face Papers 1 September 2026 · 00:00 1 views
Share: X Telegram

Lucida, a new method from Hugging Face, improves composable indoor scene reconstruction by redistributing pipeline requirements across parsing, asset generation, and VLM-guided placement, achieving high-fidelity editable replicas from cluttered captures.

Hugging Face Unveils Lucida: A New Pipeline for Composable Real-to-Sim Scene Modeling

Key points

Composable scene modeling aims to recover a real indoor scene as complete, editable object assets arranged as observed, providing robot simulation and embodied AI with a simulation-ready replica of the real environment where objects can be manipulated individually. Existing pipelines decompose the task into three steps: parse the observations into instances, generate an asset for each, and place each asset back. However, every step presumes an input that a cluttered capture rarely provides: accurate instance geometry, unoccluded views, and assets that accurately match the observations.

To address this, researchers propose Lucida, which keeps the same order but redistributes the requirements so that each step consumes only what a real capture reliably provides, and precision is reached at the end of the pipeline rather than demanded at its start. Lucida parses the video into a scene graph whose nodes carry per-instance multi-view evidence, generates a complete asset for each instance from its evidence, and places assets with GizmoAct, a VLM policy that casts placement as multi-turn GUI interaction, manipulating the object's gizmo in a closed loop and deciding itself when alignment is reached.

Across scene-level 3D object detection, object pose estimation, and scene reconstruction, Lucida improves mAP over Boxer by 69% on R2S-Scene, raises [email protected] from 57.8% to 83.4% on CA-1M, and increases scene F-Score from 0.794 for SAM3D to 0.924.

MetricLucidaBaselineImprovement
mAP on R2S-Scene (vs Boxer)--+69%
[email protected] on CA-1M83.4%57.8%+25.6 pp
Scene F-Score0.9240.794 (SAM3D)+0.13
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 1 Sep 2026

Hugging Face Unveils CogEvol: Single-Pass Learning Environment Generation

CogEvol, a new family of models from Hugging Face, generates structured learning artifacts like slides and interactive HTML pages...

2
Research paper
Hugging Face 1 Sep 2026

PaperGym: Turning Papers into Training Environments for AI Research Planning

Hugging Face researchers introduce PaperGym, a framework that converts scientific papers into reinforcement learning environments...

2
Research paper
Hugging Face 1 Sep 2026

Study: On-Policy Distillation Works by Suppressing Low-Probability Tokens, Not Teacher Guidance

A new Hugging Face paper reveals that on-policy distillation (OPD) improves reasoning mainly by suppressing low-probability tokens...

2