Structuring low-quality videotaped lectures for cross-reference browsing by video text analysis

作者:

Highlights:

摘要

This paper presents an unified approach in analyzing and structuring the content of videotaped lectures for distance learning applications. By structuring lecture videos, we can support topic indexing and semantic querying of multimedia documents captured in the traditional classrooms. Our goal in this paper is to automatically construct the cross references of lecture videos and textual documents so as to facilitate the synchronized browsing and presentation of multimedia information. The major issues involved in our approach are topical event detection, video text analysis and the matching of slide shots and external documents. In topical event detection, a novel transition detector is proposed to rapidly locate the slide shot boundaries by computing the changes of text and background regions in videos. For each detected topical event, multiple keyframes are extracted for video text detection, super-resolution reconstruction, binarization and recognition. A new approach for the reconstruction of high-resolution textboxes based on linear interpolation and multi-frame integration is also proposed for the effective binarization and recognition. The recognized characters are utilized to match the video slide shots and external documents based on our proposed title and content similarity measures.

论文关键词:Topic detection,Video text analysis,Super-resolution reconstruction,Synchronization of lecture videos and electronic slides

论文评审过程:Received 19 October 2006, Revised 31 December 2007, Accepted 19 March 2008, Available online 3 April 2008.

论文官网地址:https://doi.org/10.1016/j.patcog.2008.03.024