TY - JOUR
T1 - InsightVideo
T2 - Toward hierarchical video content organization for efficient browsing, summarization and retrieval
AU - Zhu, Xingquan
AU - Elmagarmid, Ahmed K.
AU - Xue, Xiangyang
AU - Wu, Lide
AU - Catlin, Ann Christine
PY - 2005/8
Y1 - 2005/8
N2 - Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.
AB - Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce Insight Video, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.
KW - Video browsing
KW - Video content organization
KW - Video retrieval
KW - Video similarity assessment
UR - http://www.scopus.com/inward/record.url?scp=24944491051&partnerID=8YFLogxK
U2 - 10.1109/TMM.2005.850977
DO - 10.1109/TMM.2005.850977
M3 - Article
AN - SCOPUS:24944491051
SN - 1520-9210
VL - 7
SP - 648
EP - 666
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
IS - 4
ER -