An Exploration of Hands-free Text Selection for Virtual Reality Head-Mounted Displays

Xuanru Meng, Wenge Xu, Hai Ning Liang*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

15 Citations (Scopus)

Abstract

Hand-based interaction, such as using a handheld controller or making hand gestures, has been widely adopted as the primary method for interacting with both virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs). In contrast, hands-free interaction avoids the need for users' hands and although it can afford additional benefits, there has been limited research in exploring and evaluating hands-free techniques for these HMDs. As VR HMDs become ubiquitous, people will need to do text editing, which requires selecting text segments. Similar to hands-free interaction, text selection is underexplored. This research focuses on both, text selection via hands-free interaction. Our exploration involves a user study with 24 participants to investigate the performance, user experience, and workload of three hands-free selection mechanisms (Dwell, Blink, Voice) to complement head-based pointing. Results indicate that Blink outperforms Dwell and Voice in completion time. Users' subjective feedback also shows that Blink is the preferred technique for text selection. This work is the first to explore handsfree interaction for text selection in VR HMDs. Our results provide a solid platform for further research in this important area.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
EditorsHenry Duh, Ian Williams, Jens Grubert, J. Adam Jones, Jianmin Zheng
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages74-81
Number of pages8
ISBN (Electronic)9781665453257
DOIs
Publication statusPublished - 2022
Event21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022 - Singapore, Singapore
Duration: 17 Oct 202221 Oct 2022

Publication series

NameProceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022

Conference

Conference21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
Country/TerritorySingapore
CitySingapore
Period17/10/2221/10/22

Keywords

  • Empirical studies in interaction design
  • Hands-free Interaction
  • Human computer interaction (HCI)
  • Human-centered computing
  • Interaction design
  • Interaction paradigms
  • Text Selection
  • User Study
  • Virtual Reality
  • Virtual reality
  • interaction techniques

Fingerprint

Dive into the research topics of 'An Exploration of Hands-free Text Selection for Virtual Reality Head-Mounted Displays'. Together they form a unique fingerprint.

Cite this