InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval

Xingquan Zhu*, Ahmed K. Elmagarmid, Xiangyang Xue, Lide Wu, Ann Christine Catlin

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

80 Citations (Scopus)

Abstract

Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.

Original languageEnglish
Pages (from-to)648-666
Number of pages19
JournalIEEE Transactions on Multimedia
Volume7
Issue number4
DOIs
Publication statusPublished - Aug 2005
Externally publishedYes

Keywords

  • Video browsing
  • Video content organization
  • Video retrieval
  • Video similarity assessment

Fingerprint

Dive into the research topics of 'InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval'. Together they form a unique fingerprint.

Cite this