ABSTRACT

In this book I have outlined a qualitative methodology to analyze multimodal interaction. The reason that I developed this framework was my belief that we can only truly understand interaction if we investigate the visual channels of communication as well as the audible channels. Here, I draw on a wide range of examples to illustrate the applicability of the framework and, while it is applicable in all kinds of different situations, we are really only at the very beginning of multimodal interactional analysis. At this point, I outline some of the notions that have been developed, then I describe the affordances and constraints that this framework brings with it and, after that, I outline what the framework cannot do, and where I think we should go from here.