ABSTRACT

This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.

chapter 1|9 pages

Introduction

chapter 2|25 pages

Understanding page-based media

chapter 3|32 pages

An empirical approach to multimodality

chapter 4|21 pages

Genre: perspectives and patterns

chapter 5|24 pages

Working with multimodal corpora

chapter 6|20 pages

The medium and its characteristics

chapter 7|28 pages

The content and its structure

chapter 8|31 pages

The page and its interpretation

chapter 9|19 pages

Multimodal artefacts in digital media

chapter 10|8 pages

Conclusions and outlook