Skip to main navigation Skip to search Skip to main content

Dialectic-Med: Mitigating Diagnostic Hallucinations via Counterfactual Adversarial Multi-Agent Debate: Dialectic-Med

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

141 Downloads (Pure)

Abstract

Multimodal Large Language Models (MLLMs) in healthcare suffer from severe confirmation bias, often hallucinating visual details to support initial, potentially erroneous diagnostic hypotheses. Existing Chain-of-Thought (CoT) approaches lack intrinsic correction mechanisms, rendering them vulnerable to error propagation. To bridge this gap, we propose Dialectic-Med, a multi-agent framework that enforces diagnostic rigor through adversarial dialectics. Unlike static consensus models, Dialectic-Med orchestrates a dynamic interplay between three role-specialized agents: a proponent that formulates diagnostic hypotheses; an opponent equipped with a novel visual falsification module that actively retrieves contradictory visual evidence to challenge the Proponent; and a mediator that resolves conflicts via a weighted consensus graph. By explicitly modeling the cognitive process of falsification, our framework guarantees that diagnostic reasoning is tightly grounded in verified visual regions. Empirical evaluations on MIMIC-CXR-VQA, VQA-RAD, and PathVQA demonstrate that Dialectic-Med not only achieves state-of-the-art performance but also fundamentally enhances the trustworthiness of the reasoning process. Beyond accuracy, our approach significantly enhances explanation faithfulness and decisively mitigates hallucinations, establishing a new standard over single-agent baselines.
Original languageEnglish
Title of host publicationThe 64th Annual Meeting of the Association for Computational Linguistics
Subtitle of host publicationACL 2026
PublisherAssociation for Computational Linguistics (ACL)
Pages1-18
Number of pages18
Publication statusAccepted/In press - 7 Apr 2026
EventThe 64th Annual Meeting of the Association for Computational Linguistics: ACL 2026 - San Diego, California, United States, San Diego, United States
Duration: 2 Jul 20267 Jul 2026
https://2026.aclweb.org/

Conference

ConferenceThe 64th Annual Meeting of the Association for Computational Linguistics
Country/TerritoryUnited States
CitySan Diego
Period2/07/267/07/26
Internet address

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • Medical Multimodal LLMs
  • Multi-Agent Systems
  • Hallucination Mitigation

Cite this