TY - GEN
T1 - IText
T2 - 34th Annual ACM Symposium on User Interface Software and Technology, UIST 2021
AU - Lu, Xueshi
AU - Yu, DIfeng
AU - Liang, Hai Ning
AU - Goncalves, Jorge
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/10/10
Y1 - 2021/10/10
N2 - Text entry is an important and frequent task in interactive devices including augmented reality head-mounted displays (AR HMDs). In current AR HMDs, there are still two main open challenges to overcome for efficient and usable text entry: arm fatigue due to mid-air input and visual occlusion because of their small see-through displays. To address these challenges, we present iText, a technique for AR HMDs that is hands-free and is based on an imaginary (invisible) keyboard. We first show that it is feasible and practical to use an imaginary keyboard on AR HMDs. Then, we evaluated its performance and usability with three hands-free selection mechanisms: eye blinks (E-Type), dwell (D-Type), and swipe gestures (G-Type). Our results show that users could achieve an average text entry speed of 11.95, 9.03 and 9.84 words per minutes (WPM) with E-Type, D-Type, and G-Type, respectively. Given that iText with E-Type outperformed the other two selection mechanisms in text entry rate and subjective feedback, we ran a third, 5-day study. Our results show that iText with E-Type can achieve an average text entry rate of 13.76 WPM with a mean word error rate of 1.5%. In short, iText can enable efficient eyes-free text entry and can be useful for various application scenarios in AR HMDs.
AB - Text entry is an important and frequent task in interactive devices including augmented reality head-mounted displays (AR HMDs). In current AR HMDs, there are still two main open challenges to overcome for efficient and usable text entry: arm fatigue due to mid-air input and visual occlusion because of their small see-through displays. To address these challenges, we present iText, a technique for AR HMDs that is hands-free and is based on an imaginary (invisible) keyboard. We first show that it is feasible and practical to use an imaginary keyboard on AR HMDs. Then, we evaluated its performance and usability with three hands-free selection mechanisms: eye blinks (E-Type), dwell (D-Type), and swipe gestures (G-Type). Our results show that users could achieve an average text entry speed of 11.95, 9.03 and 9.84 words per minutes (WPM) with E-Type, D-Type, and G-Type, respectively. Given that iText with E-Type outperformed the other two selection mechanisms in text entry rate and subjective feedback, we ran a third, 5-day study. Our results show that iText with E-Type can achieve an average text entry rate of 13.76 WPM with a mean word error rate of 1.5%. In short, iText can enable efficient eyes-free text entry and can be useful for various application scenarios in AR HMDs.
KW - augmented reality
KW - dwell
KW - eye blink
KW - hands-free
KW - head-mounted displays
KW - text entry
KW - typing
UR - http://www.scopus.com/inward/record.url?scp=85113463625&partnerID=8YFLogxK
U2 - 10.1145/3472749.3474788
DO - 10.1145/3472749.3474788
M3 - Conference Proceeding
AN - SCOPUS:85113463625
T3 - UIST 2021 - Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology
SP - 815
EP - 825
BT - UIST 2021 - Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology
PB - Association for Computing Machinery, Inc
Y2 - 10 October 2021 through 14 October 2021
ER -