ABSTRACT

This chapter presents a view of research in multimodal information retrieval (henceforth, MIR) from the perspective of the relationship between information and the users’ satisfaction with it. Following a brief introduction to the field of MIR in this section, the mutual influences of the two terms of the relationship are discussed: first, the influence of retrieval techniques on user satisfaction (Section 7.2) and second, the inference from interaction log mining of improved retrieval techniques (Section 7.3). Finally, research in MIR is put in the wider context of interactive multimodal information management, in particular within the smart meeting room framework of the IM2 NCCR and of this book (Section 7.4). This chapter thus relates content-based video and image retrieval with research on information fusion and with progress towards semantic multimedia content understanding.