ABSTRACT

This chapter discusses bidirectional, human-to-computer and computer-to-human, affective interaction techniques developed by authors, with special attention paid to the human emotion communication based on facial expression, head movement, and eye gaze attributes. It is based on a combination of head movement, eye gaze, and facial expression recognition techniques. Human beings can recognize a wide range of visual, auditory, olfactory, gustatory, and haptic stimuli, and classify these stimuli according to abstract patterns. Human beings are the only animals with a small colored iris embedded in a white sclera, making it possible for other people to detect very small changes in the direction of a person’s gaze. Human face serves to identify a person, reflect an individual’s emotional state, allowing other people to relate to that person. Physically based animation attempts to represent the shape and dynamic changes of a face by modeling the underlying properties of facial tissue and muscle actions.