Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

Study: Deep Research Agents Easily Fooled by Misleading Information

AI By Crimson AI Hugging Face Papers 2 August 2026 · 00:00 49 views
Share: X Telegram

A new framework, MisKnow-Agent, reveals that Deep Research agents adopt false conclusions when exposed to even a single misleading document, with adoption rates jumping from 0% to 54.7% on average.

Study: Deep Research Agents Easily Fooled by Misleading Information

Key points

Deep Research agents, which extend LLM-based assistants into long-horizon workflows involving planning, retrieval, evidence synthesis, and report generation, are increasingly used for complex information tasks. However, a new study from Hugging Face researchers highlights a critical reliability gap: these agents can be misled by apparently credible but factually false information encountered during their research process.

The researchers introduce MisKnow-Agent, a framework for constructing and validating misleading knowledge for Deep Research tasks. It generates misleading instances with controllable authority levels and styles, yielding 5,933 quality-controlled instances built on DeepResearch Benchmark tasks.

Experiments across open-source and closed-source Deep Research agents, including DeerFlow, WebThinker, and Gemini Deep Research, show that introducing just one misleading document increases the mean false-conclusion adoption rate (FCAR) from 0% in the control to 54.7%. FCAR varies with lifecycle stage, framework design, source authority, and presentation style, while search-result rank and additional documents have limited influence.

Notably, while search-enabled verifier models consistently identify the retained instances as misleading during focused corpus validation, the same instances can still be adopted during long-horizon research, revealing a disconnect between focused verification and workflow-level evidence use.

The study evaluates pre- and post-research defenses, both individually and in combination, finding that all three configurations mitigate but do not fully prevent false-conclusion adoption. The authors conclude that reliable Deep Research requires evidence verification and correction capabilities at both the model and framework levels, beyond improvements in planning, retrieval, evidence integration, or report-generation abilities.

MetricValue
Misleading instances generated5,933
Mean FCAR with no injection (control)0%
Mean FCAR with one misleading document54.7%
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 15 Oct 2026

New Survey Maps How Multimodal AI Agents Remember and Evolve

A Hugging Face survey proposes a two-axis framework for multimodal agent memory, separating how information is formed and represen...

18
Research paper
Hugging Face 15 Oct 2026

CriticOPD Fixes On-Policy Distillation by Letting Teachers Critique Student Errors

Hugging Face researchers introduce CriticOPD, a method that restores the teacher's ability to recover from student mistakes during...

20
Research paper
Hugging Face 15 Oct 2026

ActionOPD: Distilling Agent Decisions, Not Tokens

A new Hugging Face paper proposes ActionOPD, an action-level on-policy distillation method that aligns a student agent's decisions...

21