Proxemic-aware Augmented Reality For Human-Robot Interaction

Jingyang Liu*, Hongyu Mao, Joshua Bard

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

1 Citation (Scopus)

Abstract

This study introduces a novel proxemic-aware augmented reality (AR) system to mitigate information overload in AR-enabled human-robot interaction (HRI). The system leverages human-robot proxemics to automatically adjust what and how much visual content needs to be presented. Therefore, the operator can perceive the relevant data through AR interfaces without being overwhelmed by excessive information exposure. We propose a task-specific model for evaluating human-robot proxemic (HRP), where the system can identify HRP levels based on raw features, such as distance and orientation. Based on HRP levels, we design a set of visual elements for presenting robots' information at various levels of detail. To demonstrate the functionality of the system, we present a series of proof-of-concept applications showing that our system can assist the operator in a wide range of HRI tasks. The user study proves that the proxemic-aware AR system can reduce mental loading, increase visual clarity, and improve interaction efficiency in HRI.

Original languageEnglish
Title of host publication2023 32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023
PublisherIEEE Computer Society
Pages1323-1330
Number of pages8
ISBN (Electronic)9798350336702
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023 - Busan, Korea, Republic of
Duration: 28 Aug 202331 Aug 2023

Publication series

NameIEEE International Workshop on Robot and Human Communication, RO-MAN
ISSN (Print)1944-9445
ISSN (Electronic)1944-9437

Conference

Conference32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023
Country/TerritoryKorea, Republic of
CityBusan
Period28/08/2331/08/23

Cite this