Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience

Yifan Wang; Yue Li; Hai Ning Liang

doi:10.1109/ISMAR59233.2023.00091

Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience

Yifan Wang, Yue Li^*, Hai Ning Liang

^*Corresponding author for this work

Department of Computing

Xi'an Jiaotong-Liverpool University

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

2 Citations (Scopus)

Abstract

For museums in Virtual Reality (VR), various interaction and manipulation techniques could be employed for users to engage with artefact interactions. This study examined four combinations of interaction (controller-based and hand-tracking) and manipulation (direct and indirect) techniques, assessing user performance and experience with these interaction techniques in a virtual museum environment. We conducted a within-subjects experiment and asked participants to perform a series of transform manipulation tasks using the four techniques. Participants' task completion time was measured. They also provided feedback on acceptance, learnability, presence, sickness, and fatigue, and gave an overall ranking through post-experiment questionnaires and interviews. The results revealed that controller-based direct manipulation outperformed the other techniques in terms of task performance and user experience, with hand-tracking indirect manipulation being the least efficient and the least preferred option. The study offers insights for future research and development in refining interaction and manipulation techniques and designing more user-friendly VR museum experiences.

Original language	English
Title of host publication	Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023
Editors	Gerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	761-770
Number of pages	10
ISBN (Electronic)	9798350328387
DOIs	https://doi.org/10.1109/ISMAR59233.2023.00091
Publication status	Published - 4 Dec 2023
Event	22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 - Sydney, Australia Duration: 16 Oct 2023 → 20 Oct 2023

Publication series

Name	Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023

Conference

Conference	22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023
Country/Territory	Australia
City	Sydney
Period	16/10/23 → 20/10/23

Keywords

Empirical studies in HCI Human-centered computing
Gestural input
Human computer interaction (HCI)
Human-centered computing
Interaction paradigms
Interaction techniques
Virtual reality Human-centered computing

Access to Document

10.1109/ISMAR59233.2023.00091

Cite this

Wang, Y., Li, Y., & Liang, H. N. (2023). Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience. In G. Bruder, A.-H. Olivier, A. Cunningham, E. Y. Peng, J. Grubert, & I. Williams (Eds.), Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 (pp. 761-770). (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR59233.2023.00091

Wang, Yifan ; Li, Yue ; Liang, Hai Ning. / Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums : A Study of Performance and User Experience. Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023. editor / Gerd Bruder ; Anne-Helene Olivier ; Andrew Cunningham ; Evan Yifan Peng ; Jens Grubert ; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 761-770 (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023).

@inproceedings{c858cbf66b61495188cc33c80741e8a8,

title = "Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience",

abstract = "For museums in Virtual Reality (VR), various interaction and manipulation techniques could be employed for users to engage with artefact interactions. This study examined four combinations of interaction (controller-based and hand-tracking) and manipulation (direct and indirect) techniques, assessing user performance and experience with these interaction techniques in a virtual museum environment. We conducted a within-subjects experiment and asked participants to perform a series of transform manipulation tasks using the four techniques. Participants' task completion time was measured. They also provided feedback on acceptance, learnability, presence, sickness, and fatigue, and gave an overall ranking through post-experiment questionnaires and interviews. The results revealed that controller-based direct manipulation outperformed the other techniques in terms of task performance and user experience, with hand-tracking indirect manipulation being the least efficient and the least preferred option. The study offers insights for future research and development in refining interaction and manipulation techniques and designing more user-friendly VR museum experiences.",

keywords = "Empirical studies in HCI Human-centered computing, Gestural input, Human computer interaction (HCI), Human-centered computing, Interaction paradigms, Interaction techniques, Virtual reality Human-centered computing",

author = "Yifan Wang and Yue Li and Liang, {Hai Ning}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023 ; Conference date: 16-10-2023 Through 20-10-2023",

year = "2023",

month = dec,

day = "4",

doi = "10.1109/ISMAR59233.2023.00091",

language = "English",

series = "Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "761--770",

editor = "Gerd Bruder and Anne-Helene Olivier and Andrew Cunningham and Peng, {Evan Yifan} and Jens Grubert and Ian Williams",

booktitle = "Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023",

}

Wang, Y, Li, Y & Liang, HN 2023, Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience. in G Bruder, A-H Olivier, A Cunningham, EY Peng, J Grubert & I Williams (eds), Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023. Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023, Institute of Electrical and Electronics Engineers Inc., pp. 761-770, 22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023, Sydney, Australia, 16/10/23. https://doi.org/10.1109/ISMAR59233.2023.00091

Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience. / Wang, Yifan; Li, Yue; Liang, Hai Ning.
Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023. ed. / Gerd Bruder; Anne-Helene Olivier; Andrew Cunningham; Evan Yifan Peng; Jens Grubert; Ian Williams. Institute of Electrical and Electronics Engineers Inc., 2023. p. 761-770 (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023).

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

TY - GEN

T1 - Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums

T2 - 22nd IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023

AU - Wang, Yifan

AU - Li, Yue

AU - Liang, Hai Ning

PY - 2023/12/4

Y1 - 2023/12/4

N2 - For museums in Virtual Reality (VR), various interaction and manipulation techniques could be employed for users to engage with artefact interactions. This study examined four combinations of interaction (controller-based and hand-tracking) and manipulation (direct and indirect) techniques, assessing user performance and experience with these interaction techniques in a virtual museum environment. We conducted a within-subjects experiment and asked participants to perform a series of transform manipulation tasks using the four techniques. Participants' task completion time was measured. They also provided feedback on acceptance, learnability, presence, sickness, and fatigue, and gave an overall ranking through post-experiment questionnaires and interviews. The results revealed that controller-based direct manipulation outperformed the other techniques in terms of task performance and user experience, with hand-tracking indirect manipulation being the least efficient and the least preferred option. The study offers insights for future research and development in refining interaction and manipulation techniques and designing more user-friendly VR museum experiences.

AB - For museums in Virtual Reality (VR), various interaction and manipulation techniques could be employed for users to engage with artefact interactions. This study examined four combinations of interaction (controller-based and hand-tracking) and manipulation (direct and indirect) techniques, assessing user performance and experience with these interaction techniques in a virtual museum environment. We conducted a within-subjects experiment and asked participants to perform a series of transform manipulation tasks using the four techniques. Participants' task completion time was measured. They also provided feedback on acceptance, learnability, presence, sickness, and fatigue, and gave an overall ranking through post-experiment questionnaires and interviews. The results revealed that controller-based direct manipulation outperformed the other techniques in terms of task performance and user experience, with hand-tracking indirect manipulation being the least efficient and the least preferred option. The study offers insights for future research and development in refining interaction and manipulation techniques and designing more user-friendly VR museum experiences.

KW - Empirical studies in HCI Human-centered computing

KW - Gestural input

KW - Human computer interaction (HCI)

KW - Human-centered computing

KW - Interaction paradigms

KW - Interaction techniques

KW - Virtual reality Human-centered computing

UR - http://www.scopus.com/inward/record.url?scp=85180362212&partnerID=8YFLogxK

U2 - 10.1109/ISMAR59233.2023.00091

DO - 10.1109/ISMAR59233.2023.00091

M3 - Conference Proceeding

AN - SCOPUS:85180362212

T3 - Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023

SP - 761

EP - 770

BT - Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023

A2 - Bruder, Gerd

A2 - Olivier, Anne-Helene

A2 - Cunningham, Andrew

A2 - Peng, Evan Yifan

A2 - Grubert, Jens

A2 - Williams, Ian

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 16 October 2023 through 20 October 2023

ER -

Wang Y, Li Y, Liang HN. Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience. In Bruder G, Olivier AH, Cunningham A, Peng EY, Grubert J, Williams I, editors, Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 761-770. (Proceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023). doi: 10.1109/ISMAR59233.2023.00091

Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Virtual Reality Education Technology for Smart Museums

Engaging Spectators in Virtual Reality

Study on Extended Reality Collaboration Technology for Metaverse

Cite this

Comparative Analysis of Artefact Interaction and Manipulation Techniques in VR Museums: A Study of Performance and User Experience

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Projects

Virtual Reality Education Technology for Smart Museums

Engaging Spectators in Virtual Reality

Study on Extended Reality Collaboration Technology for Metaverse

Cite this