ABSTRACT

Human-human interaction implies numerous studies to signifi cantly improve the effi ciency, naturalness and persuasiveness in humancomputer interaction (HCI) systems. But there is still inadequate knowledge on what and how cues interact in face-to-face interaction. The complexity of human-human interaction involving the description of verbal and non-verbal modalities still needs theoretical and empirical foundations. To achieve this goal, researchers need to develop resources and tools that enable them to take into account the different modalities. Verbal, vocal and gestural cues have been studied separately for a long time. This favored the precise description of the mechanisms and rules governing each domain. But today the question of how these various cues in the different modalities are connected, has become important for linguists.