Investigating ChatGPT Translation Hallucination from an Embodied-Cognitive Translatology Perspective

Hui Jiao, Xinwei Li, Jonathan Ding, Xiaojun Zhang*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

ChatGPT faces significant challenges in realising the dynamic construction of reality, cognition and language emphasised in Embodied-cognitive translatology. This study first examines the translation application of ChatGPT, defines hallucination phenomena, and reviews related research. It then explores the hallucination phenomena in ChatGPT’s translation tasks, categorizing them into semantic, pragmatic, syntactic, and cultural hallucinations. To quantify these manifestations, we manually annotate ChatGPT’s English-Chinese translations on the Flores-101 dataset, providing statistical insights into the frequency and severity of each type of hallucination. This analysis offers clarity on the prevalence of various hallucinations and suggests directions for improvement. Finally, this study summarises the current research on hallucination mitigation strategies in a targeted way, including the improvement of corpus quality, model architecture development, and prompt engineering techniques, offering novel insights for advancing machine translation technology towards greater intelligence.

Original languageEnglish
Title of host publicationAdvances in Brain Inspired Cognitive Systems - 14th International Conference, BICS 2024, Proceedings
EditorsAmir Hussain, Bo Jiang, Jinchang Ren, Mufti Mahmud, Erfu Yang, Aihua Zheng, Chenglong Li, Shuqiang Wang, Zhi Gao, Zhicheng Zhao
PublisherSpringer Science and Business Media Deutschland GmbH
Pages117-126
Number of pages10
ISBN (Print)9789819628841
DOIs
Publication statusPublished - 2025
Event14th International Conference on Brain Inspired Cognitive Systems, BICS 2024 - Hefei, China
Duration: 6 Dec 20248 Dec 2024

Publication series

NameLecture Notes in Computer Science
Volume15498 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Brain Inspired Cognitive Systems, BICS 2024
Country/TerritoryChina
CityHefei
Period6/12/248/12/24

Keywords

  • ChatGPT
  • Embodied-cognitive translatology
  • Hallucination
  • Translation

Fingerprint

Dive into the research topics of 'Investigating ChatGPT Translation Hallucination from an Embodied-Cognitive Translatology Perspective'. Together they form a unique fingerprint.

Cite this