ABSTRACT
Virtual and augmented reality (VR/AR) are immersive and potentially multimodal sensory experiences that augment or completely replace real-world sensory input with artificial content. Outside commercial applications in entertainment, VR and AR can be used to create controlled, yet ecologically valid experimental paradigms for research in cognitive science or related fields. Here, we review how brain–computer interfaces (BCIs) are being integrated with VR/AR to rehabilitate and assist the injured and disabled, improve interaction between human and computer, and provide us more insight into how our brains process and evaluate complex environments and events. We also describe a concrete example architecture for conducting BCI/VR experiments and conclude our review with a discussion on limitations and potential future developments on BCI-based interaction with VR and AR.
