Modality-specific impacts of distractors on visual and auditory categorical decision-making: an evidence accumulation perspective

Jianhua Li, Lin Hua, Sophia W. Deng*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Our brain constantly processes multisensory inputs to make decisions and guide behaviors, but how goal-relevant processes are influenced by irrelevant information is unclear. Here, we investigated the effects of intermodal and intramodal task-irrelevant information on visual and auditory categorical decision-making. In both visual and auditory tasks, we manipulated the modality of irrelevant inputs (visual vs. auditory vs. none) and used linear discrimination analysis of EEG and hierarchical drift-diffusion modeling (HDDM) to identify when and how task-irrelevant information affected decision-relevant processing. The results revealed modality-specific impacts of irrelevant inputs on visual and auditory categorical decision-making. The distinct effects on the visual task were shown on the neural components, with auditory distractors amplifying the sensory processing whereas visual distractors amplifying the post-sensory process. Conversely, the distinct effects on the auditory task were shown in behavioral performance and underlying cognitive processes. Visual distractors facilitate behavioral performance and affect both stages, but auditory distractors interfere with behavioral performance and impact on the sensory processing rather than the post-sensory decision stage. Overall, these findings suggested that auditory distractors affect the sensory processing stage of both tasks while visual distractors affect the post-sensory decision stage of visual categorical decision-making and both stages of auditory categorical decision-making. This study provides insights into how humans process information from multiple sensory modalities during decision-making by leveraging modality-specific impacts.

Original languageEnglish
Article number1380196
JournalFrontiers in Psychology
Volume15
DOIs
Publication statusPublished - May 2024
Externally publishedYes

Keywords

  • EEG decoding
  • categorical decision-making
  • evidence accumulation processes
  • hierarchical drift diffusion modeling
  • multisensory perception

Fingerprint

Dive into the research topics of 'Modality-specific impacts of distractors on visual and auditory categorical decision-making: an evidence accumulation perspective'. Together they form a unique fingerprint.

Cite this