Integrated segmentation and depth ordering of motion layers in image sequences

作者:

Highlights:

摘要

We describe a method to segment and depth order motion layers simultaneously in an image sequence. Previous approaches to motion segmentation and layering have tended to ignore the depth ordering issue or treat it as a post-processing operation. We argue here that motion estimation and segmentation are crucially dependent on depth order and hence that the latter should form an integral part of any layering scheme. Using an explicit model of boundary ownership allowing simultaneous assignment of motions to regions and extraction of depth order, the method fuses colour region segmentations with motion estimates obtained via block correlation. A novel depth-dependent partial correlation technique then provides improved motion estimates in the vicinity of motion boundaries. The segmentation and layering are implemented within a region-adjacency graph framework—creating moving object graphs—which is both flexible and computationally tractable. Results of experiments on real sequences show the approach to be effective.

论文关键词:Motion segmentation,Layers,Occlusions,Depth

论文评审过程:Received 10 June 2001, Revised 12 February 2002, Accepted 14 March 2002, Available online 12 June 2002.

论文官网地址:https://doi.org/10.1016/S0262-8856(02)00061-6