ABSTRACT

A major source of three-dimensional information about objects in the world is available to the observer in the form of time-varying imagery. Relative motion between textured objects and observer generates a time-varying optic array at the image, from which image motion of contours, edge fragments and feature points can be extracted. These dynamic features serve to sample the underlying “image flow” field. We present an overview of our work on image flow theory and its potential for the recovery of three-dimensional surface structure and space motions of rigid objects. Methods for flow recovery and segmentation stem directly from the analytic structure of image flow Fields. New, closed-form solutions are given for the structure and motion of planar and curved surface patches from monocular image flow. The relationship between instabilities in the computation and visual illusions are also explored. Finally, the fusion of motion analysis and stereo vision is discussed in the context of “binocular image flows.”