ABSTRACT

Multimodality has long been a key issue in Conversation Analysis (CA). CA transcripts, which are at the heart of any CA analysis, are designed to capture the "large range of vocal, verbal, visual and embodied resources, which are publicly displayed and monitored in situ". The kinesic modality is by no means less diverse than the vocal modality; kinesic variables include gaze, posture, proxemics as well as the vast repertoires of gesture and facial expression. In Corpus linguistics (CL), multimodality has been taken up by recent corpus compilation projects aiming to align "orthographic transcripts of spoken language communication events, the audio and/or video recordings of the original events". Multimodal choices are also (semi-)independent not turn-organized, and therefore often temporally misaligned. A growing body of evidence suggests that multimodality is heightened in storytelling interaction in conversation. Storytelling is a key activity in conversation.