ABSTRACT
This chapter defines audiovisual integration as the influence that visual cues have on the rate and/or accuracy of recognition. It highlights recent developments of a linear dynamic parallel interactive framework that proposes to explain how visual articulatory cues interact with auditory speech cues. The chapter discusses applications to normal-hearing and hearing-impaired listeners. It highlights recent work using a modified capacity approach that takes into account processing speed in addition to accuracy in order to thoroughly assess speech integration ability. The chapter introduces the linear dynamic parallel interactive model as an explanation of the perceptual mechanisms underlying audiovisual speech integration. It illustrates the role that inhibitory cross-channel interactions can have on bringing about multisensory integration phenomena namely, McGurk fusions. The termination rule determines the form of the cumulative distribution function (CDF) of response-times (RTs). Altieri and Townsend used the measure of workload capacity to quantify the amount of interaction that occurs between auditory and visual modalities in speech perception.
