Enhanced Human-Robot Interaction for Robotic Container Unloading Systems Utilizing Digital Cousin and LLM

Shihui Fang, Linfeng Yue, Yuqian Lin, Ziqi Xu, Jiawei Lu, Quan Zhang*, Min Chen*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

Existing robotic container unloading systems lack the adaptability and semantic reasoning required for robust performance due to dynamic environments and unstructured cargo arrangements. This paper proposes a novel LLM and Digital Cousins-driven robotic automation system to address these limitations. By leveraging the DeepSeek-V3LLM (large language model), the system integrates contextual understanding, real-time decision-making, and adaptive grasping strategies to handle irregular or occluded objects. A hybrid architecture synergizes LLM-based high-level planning with low-level robotic control, while a synchronized digital cousin framework ensures real-time physical-virtual synchronization. The digital cousin technique constructs semantically consistent virtual scenes from single RGB images using a 3D asset library, enabling cost-effective, automated synthesis while preserving core geometric and functional attributes. Experimental results demonstrate significant improvements in operational efficiency and robustness compared to conventional methods. This work bridges AI-driven cognitive capabilities with industrial robotics, offering a scalable and intelligent solution for autonomous logistics.

Original languageEnglish
Title of host publicationProceedings - 2025 10th International Conference on Automation, Control and Robotics Engineering, CACRE 2025
EditorsFuming Zhang, Li Chai
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages91-95
Number of pages5
ISBN (Electronic)9798331502843
DOIs
Publication statusPublished - 2025
Event10th International Conference on Automation, Control and Robotics Engineering, CACRE 2025 - Wuxi, China
Duration: 16 Jul 202519 Jul 2025

Publication series

NameProceedings - 2025 10th International Conference on Automation, Control and Robotics Engineering, CACRE 2025

Conference

Conference10th International Conference on Automation, Control and Robotics Engineering, CACRE 2025
Country/TerritoryChina
CityWuxi
Period16/07/2519/07/25

Keywords

  • Container unloading
  • Digital cousin
  • Human-robot interaction
  • Large language models
  • Robotic automation

Fingerprint

Dive into the research topics of 'Enhanced Human-Robot Interaction for Robotic Container Unloading Systems Utilizing Digital Cousin and LLM'. Together they form a unique fingerprint.

Cite this