chapter  10
26 Pages

- Nonspeech Auditory and Crossmodal Output

Our senses of hearing and touch are very powerful and can convey a wealth of information. Sound gives us a continuous, holistic contact with our environment and what

is going on around us. Nonspeech sounds (such as music, environmental sounds, or sound effects) give us different types of information to those provided by speech; they can be more general and ambient where speech is precise and requires more focus. Nonspeech sounds complement speech in the same way as visual icons complement text. For example, icons can present information in a small amount of space compared with text, whereas nonspeech

10.1 Introduction and a Brief History of Nonspeech Sound and Tactile Feedback in Human-Computer Interaction ...........211 10.2 Why Use Nonspeech Feedback in Human-Computer Interfaces? ................................................................................. 213

10.2.1 Advantages of Nonspeech Feedback ................................................................................................................... 213 10.2.2 Disadvantages of Nonspeech Feedback ................................................................................................................214

10.3 Brief Introduction to Auditory and Tactual Perception ....................................................................................................214 10.3.1 Auditory Perception ..............................................................................................................................................214 10.3.2 Tactual Perception ................................................................................................................................................216

10.4 Technology and Production of Nonspeech Audio Feedback ............................................................................................217 10.4.1 Brief Introduction to Sound Synthesis and MIDI .................................................................................................217