TY - GEN
T1 - Design of A Real-Time Motor Imagery BCI-VR System with Sample Segmentation and Soft Voting
AU - Lu, Annan
AU - Huang, Mengjie
AU - Liao, Kai Lun
AU - Sun, Yue
AU - Yang, Rui
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Motor imagery-based brain-computer interface integrated with virtual reality (MIBCI-VR) enables hands-free, intuitive interaction in immersive environments. However, systematic online validation of real-time, closed-loop MIBCI-VR systems, especially those employing advanced ensemble decoding strategies, remains limited. This study introduces a novel online MIBCI-VR system that combines EEG sample segmentation and soft voting within a closed-loop framework. Leveraging a 32channel saline electroencephalogram (EEG) device and a VR headset, the system integrates advanced signal preprocessing, deep learning-based EEG Conformer classification, and probabilistic aggregation of segment-level predictions for robust, low-latency control. In real-time VR tasks, participants achieved an average online classification accuracy of 85%, with both prediction and data transmission times averaging 0.12 seconds. Usability evaluations revealed moderate workload, satisfaction, and a strong sense of agency, indicating that users found the system practical and engaging for neuro-interactive tasks. Qualitative feedback further highlighted the intuitive feedback and positive user experience provided by the system. These findings demonstrate both the technical and usability innovation of real-time MIBCI-VR, providing a strong foundation for the next generation of neuro-interactive systems and offering actionable insights for future system optimization and broader adoption.
AB - Motor imagery-based brain-computer interface integrated with virtual reality (MIBCI-VR) enables hands-free, intuitive interaction in immersive environments. However, systematic online validation of real-time, closed-loop MIBCI-VR systems, especially those employing advanced ensemble decoding strategies, remains limited. This study introduces a novel online MIBCI-VR system that combines EEG sample segmentation and soft voting within a closed-loop framework. Leveraging a 32channel saline electroencephalogram (EEG) device and a VR headset, the system integrates advanced signal preprocessing, deep learning-based EEG Conformer classification, and probabilistic aggregation of segment-level predictions for robust, low-latency control. In real-time VR tasks, participants achieved an average online classification accuracy of 85%, with both prediction and data transmission times averaging 0.12 seconds. Usability evaluations revealed moderate workload, satisfaction, and a strong sense of agency, indicating that users found the system practical and engaging for neuro-interactive tasks. Qualitative feedback further highlighted the intuitive feedback and positive user experience provided by the system. These findings demonstrate both the technical and usability innovation of real-time MIBCI-VR, providing a strong foundation for the next generation of neuro-interactive systems and offering actionable insights for future system optimization and broader adoption.
KW - brain-computer interface
KW - real-time system
KW - usability
KW - virtual reality
UR - https://www.scopus.com/pages/publications/105033339893
U2 - 10.1109/BDAI66031.2025.11325177
DO - 10.1109/BDAI66031.2025.11325177
M3 - Conference Proceeding
AN - SCOPUS:105033339893
T3 - 2025 8th International Conference on Big Data and Artificial Intelligence, BDAI 2025
SP - 47
EP - 52
BT - 2025 8th International Conference on Big Data and Artificial Intelligence, BDAI 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 8th International Conference on Big Data and Artificial Intelligence, BDAI 2025
Y2 - 22 August 2025 through 24 August 2025
ER -