Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Hugging Face Unveils Qwen-UI-Agent: A Real-World-Centric Foundation GUI Agent

AI By Crimson AI Hugging Face Papers 31 July 2026 · 00:00 15 views
Share: X Telegram

Qwen-UI-Agent, a new foundation GUI agent from Hugging Face, unifies mobile, computer, browser, and DeepSearch environments, setting state-of-the-art results on mobile-use benchmarks while remaining competitive with frontier models on computer and browser tasks.

Hugging Face Unveils Qwen-UI-Agent: A Real-World-Centric Foundation GUI Agent

Key points

Hugging Face has released a technical report introducing Qwen-UI-Agent, a foundation GUI agent designed for real-world applications. The agent spans mobile, computer-use, web, and DeepSearch environments, aiming to operate reliably on actual devices and execute workflows across platforms.

Qwen-UI-Agent combines diverse sandbox environments with a large-scale real-device mobile runtime. Its unified action space interleaves GUI operations with CLI execution, generating batched actions in a single model turn. This design supports long-horizon tasks and proactive service initiation, with a lightweight harness layer enabling stateful workflows across mobile and computer.

The training pipeline leverages an AutoResearch-style data flywheel, where agents construct tasks, diagnose failures, and plan iterations. Online reinforcement learning supports trajectories exceeding 100 turns, accelerated by over 10,000 concurrent environments.

In evaluations, Qwen-UI-Agent achieves state-of-the-art performance on mobile-use benchmarks, including 82.1% on MobileWorld, 92.2% on MobileWorld-Real, and 97.5% on AndroidDaily. On computer use, it scores 79.5% on OSWorld-Verified and a 40.0% partial-progress score on OSWorld-v2. For browser and GUI grounding, it reaches 73.6% on WebArena and 81.5% on ScreenSpot-Pro, respectively.

The agent remains competitive with frontier models such as Opus 4.8, Gemini 3.1 Pro, and GPT-5.6 Sol on computer and browser tasks. The project page and code are publicly available.

BenchmarkScore
MobileWorld82.1%
MobileWorld-Real92.2%
AndroidDaily97.5%
OSWorld-Verified79.5%
OSWorld-v2 (partial-progress)40.0%
WebArena73.6%
ScreenSpot-Pro81.5%
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 31 Aug 2026

Hugging Face Unveils StepGuard: Step-Level Guardrails for Safer AI Agents

StepGuard, a new step-level guard model from Hugging Face, audits agent actions before execution, reducing attack success rates by...

1
Research paper
Hugging Face 31 Aug 2026

Hugging Face Researchers Unveil ABot-Recon for Stable Long-Horizon 3D Reconstruction

ABot-Recon, a new streaming 3D reconstruction model from Hugging Face, achieves stable long-horizon performance using only local t...

1
Research paper
Hugging Face 31 Aug 2026

ContextPilot: Teaching Agents Proactive Context Management via Fine-Grained RL

Hugging Face researchers introduce ContextPilot, a framework that enhances long-horizon agent reasoning by expanding context-editi...

1