Nataliya Kosmyna and Eugene Hauptmann "Are you still watching? Assessing internal and external attention in AR using wearable brain sensing glasses", Proc. SPIE 12913, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) V, 1291310 (12 March 2024); https://doi.org/10.1117/12.3023316

Abstract

 Very few research works featuring AR and Brain-Computer Interface (BCI) systems considered integrating cognitive state of the user in their applications. Additionally, even fewer projects explored the wearable, everyday solutions to help the user in their everyday tasks beyond the lab setup. In this project, we propose a wearable, wireless pair of glasses with a monocle-like heads-up display by including information about the current attentional state of the wearer by adapting their environment accordingly. We first introduce a our solution for AR-BCI integration. An application was designed, which adapted to the user’s state of attention measured via electroencephalography (EEG) and electrooculography (EOG). The system only responded if the attentional orientation was classified as "internal". Fourteen users tested the attention-aware system; we show that the adaptation of the interface improved the usability of the system. We conclude that more systems would benefit from awareness of the user’s ongoing attentional state as well further efficient integration of AR and BCI headsets.