ABSTRACT

Ubiquitous computing, or pervasive computing, is an increasingly popular technique for developing new human-computer interfaces and computer applications. Computers watch what happens in a physical space where people are and serve them with meaningful information. Here, most of the systems rely on a visual media for user navigation, while there are some other interesting interaction media. In this paper we present a collaborative multimodal system toward spatial presence and perceptual realism of sounds. A two-dimensional sound display called Sound Table is its central component, in which 16 speakers are mounted so that all of the users have the sound experience in common. A stick-shaped device is provided as a means for interaction with the system. The system recognizes manipulation of the device in a 3-D space over Sound Table and then gives users feedback through both visual and auditory channels.