ABSTRACT
Virtual reality (VR) is a continuously evolving field. By understanding the basics of crossmodal perception in virtual environments, a more and more natural percept can be achieved under laboratory conditions. Based on such models, minute research on human behavior and physiology during almost unrestricted behavior can be conducted. Here we will present latest advances in the realization of multimodal environments (Berger, MPI Tubingen, Germany) and discuss spatial frameworks to implement augmented and virtual reality (Biocca, Michigan State University, East Lansing, MI). Then Russo (Fort Rucker, Alabama) will present data on task performance during highly complex behavior in VR and Rani (Vanderbilt University, Nashville, TN). Finally, we will discuss if brain physiology can be monitored in this situation. Computer games simulate social behavior and allow for the observation of cognitive and emotive brain activity during interaction (Mathiak, RWTH Aachen, Germany). Driving simulation can be as well studied by means of functional brain imaging; moreover, Kineses (DaimlerChrysler AG, Stuttgart, Germany) attempted to relate the findings to brain activity during real driving. VR and the observation of human physiology may narrow the gap between highly controlled lab experimentation and free field behavior of the human.
