Skip to main navigation Skip to search Skip to main content

Exploring the Impact of User and System Factors on Human-AI Interactions in Head-Worn Displays

  • Feiyu Lu*
  • , Yan Xu
  • , Xuhai Xu
  • , Brennan Jones
  • , Laird Malamed
  • *Corresponding author for this work
  • Meta
  • Virginia Polytechnic Institute and State University
  • Reality Labs
  • University of Washington
  • University of Southern California

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

8 Citations (Scopus)

Abstract

Empowered by the rich sensory capabilities and the advancements in artificial intelligence (AI), head-worn displays (HWD) could understand the user's contexts and provide just-in-time assistance to users' tasks to augment their everyday lives. However, there has been limited understanding of how users perceive interacting with AI services, and how different factors impact the user experience in HWD applications. In this research, we investigated broadly what user and system factors play important roles in human-AI experiences during an AI-assisted spatial task. We conducted a user study to simulate an everyday scenario where augmented reality (AR) glasses could provide suggestions/assistance. We researched three AI system factors (performance, initiation, transparency) with multiple user factors (personality traits, trust propensity, and prior trust with AI). We not only identified the impact of user traits such as the levels of conscientiousness and prior trust with the AI, but also found interesting interactions between them and system factors such as AI's performance and initiation strategy. Based on the findings, we suggest that future AI assistance on HWD needs to take users' individual characteristics into account and customize the system design accordingly.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023
EditorsGerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages109-118
Number of pages10
ISBN (Electronic)9798350328387
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 - Sydney, Australia
Duration: 16 Oct 2023 → 20 Oct 2023

Publication series

NameProceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023

Conference

Conference22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023
Country/TerritoryAustralia
CitySydney
Period16/10/23 → 20/10/23

Keywords

  • Human-centered computing
  • Interaction paradigms
  • Interaction techniques
  • Mixed/augmented reality

Cite this