ABSTRACT

Multimodal interactive simulations (MIS), also known as virtual environments, represent synthetic computer-generated environments that allow interactions by one or more users using multiple sensory modalities, e.g., vision, hearing, touch, and smell. The interaction may be accomplished using specialized interface devices such as the mouse, space balls, robot arms, etc. Such simulations may be used in a variety of applications spanning video games, virtual malls, and psychomotor skill training. One application we are interested in is using MIS to develop interactive medical simulations.