ABSTRACT

This chapter presents a novel multimodal sensing system, which integrates the Laser Doppler vibrometers (LDV) with a pair of pan-tilt-zoom (PTZ) cameras to aid the LDV in finding a reflective surface and focusing its laser beam automatically. It also presents the system captures both video and audio signals synchronously for target detection using multimodal information. The chapter explains some background and related work. It describes our vision-aided automated vibrometry system. For obtaining better performance of human tracking in a near to mediate range, M. J. Beal, X. Zou and B. Bhanu have reported the integrations of visual and acoustic sensors. The chapter discusses the calibration issues among the multimodal sensory components. It shows that the algorithms for feature matching and distance measuring using the system. The chapter describes the adaptive and collaborative sensing approach and then provides some experimental results.