Registering real and virtual imagery

摘要

Registering a virtual scene with a real scene captured by a video camera has a number of applications including visually guided robotic navigation, surveillance, military training and operation. The fundamental problem involves several challenging research issues including finding corresponding points between the virtual and the real scene and camera calibration. This paper presents our research in defining and mapping a set of reliable image features for registering the two imageries, extracting and selecting reliable control points for the construction of intrinsic and extrinsic camera parameters. A number of innovative algorithms are presented followed by extensive experimental analysis. An application of registering virtual database image with video image is presented. The algorithms we developed for calculating and matching linear structured features and selecting of reliable control points are applicable to image registration beyond virtual and real imageries.