Publication

AttentivU + XR: Integrating Brain Sensing and HMDs

Copyright

Fluid Interfaces group

Yujie Wang

Nataliya Kosmyna "AttentivU: A Wearable Pair of EEG and EOG Glasses for Real-Time Physiological Processing (Conference Presentation)", Proc. SPIE 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR), 113101P (2 April 2020); https://doi.org/10.1117/12.2566398

Abstract

In this project we propose a prototype which combines an existing AR headset Hololens 2 with a Brain-Computer Interfaces (BCI) system, and we perform several tasks to validate this concept. 

The first application is built around the idea of enhancing the creativity of the user, where a user imagines an object and the object appears in front of him on the screen of their Hololens 2. 

In the second application we investigated the feasibility of using a BCI based on covert visuospatial attention – a process of focusing attention on different regions of the visual field without overt eye movements. We operated without relying on any stimulus- driven responses. 

In the third, final application, we investigated underlying attention changes and response time of the user which could be used as indicators of specific characteristics of brain activity in pre-frontal cortex following the research in hyperscanning and individual differences using BCIs. 

The proposed system is to the best of our knowledge, the first AR-BCI integrated prototype, which uses covert visuospatial attention and visual imagery with a total cost of BCI components under $1000, which is more affordable in comparison to previously published prototypes which use AR headsets and BCIs. 

Related Content