zbMATH — the first resource for mathematics

Long transition analysis for digital video sequences. (English) Zbl 0986.68895
Summary: Video indexing is a technique used to extract objects within a video sequence and index them so that they can be used for future retrieval. In many video sequences, special effects such as fade and wipe are incorporated, and in some cases, it is desirable to be able to include objects within such effects for indexing. In this paper, we introduce an automatic process that determines the type of transition and extracts information from it, so that this information can be used in object extraction. Such a process consists of four stages: shot boundary refinement, shot type determination, frame reconstruction for soft transitions, and shot classification for hard transitions. In this paper, we give the implementation, timing, and performance analysis for each stage. Long transition analysis bridges the gap between shot boundary detection and object tracking and smoothes the process of automatic video indexing for video databases.
68U99 Computing methodologies and applications
68U10 Computing methodologies for image processing
video indexing
Full Text: DOI
[1] A. M. Alattar, Wipe scene change detector for use with video compression algorithms and MPEG-7,IEEE Trans. Consumer Electronics, 44(1), 43-50, 1998. · doi:10.1109/30.663729
[2] R. Brunelli, O. Mich, and C. M. Modena, A survey on the automatic indexing of video data,J. Visual Commun. Image Represent., 10, 78-112, June 1999. · doi:10.1006/jvci.1997.0404
[3] W. A. C. Fernando and C. N. Canagarajah, Automatic detection of fade-in and fade-out in video sequences,IEEE International Symposium on Circuit and System, IV, 255-258, May 1999.
[4] W. J. Heng, K. N. Ngan, and M. H. Lee, Performance of chromatic barycenter with MPEG elements for low-level shot boundary detection and its improvements, inProceedings, Symposium on Image, Speech, Signal Processing, and Robotics, Hong Kong, pp. 272-276, September 1998.
[5] W. J. Heng and K. N. Ngan, Transition type-independent boundary refinement technique for post shot boundary detection,2nd International Conference on Information, Communications and Signal Processing (ICICS99), Singapore, 1999.
[6] F. Idris and S. Panchanathan, Review of image and video indexing techniques,J. Visual Commun. Image Represent., 8(2), 146-166, June 1997. · doi:10.1006/jvci.1997.0355
[7] M. S. Lee, B. W. Hwang, S. Sull, and S. W. Lee, Automatic video parsing using shot boundary detection and camera operation analysis,Proceedings of the 14th International Conference on Pattern Recognition, August 1998, Vol. 2, 1481-1483.
[8] R. Milanese, F. Deguillaume, and A. Jacot-Descombes, Efficient segmentation and camera motion indexing of compressed video,J. Real-Time Imaging, 5, 231-241, 1999. · doi:10.1006/rtim.1998.0138
[9] N. V. Patel and I. K. Sethi, Video shot detection and characterization for video databases,Pattern Recognition, Special Issue on Multimedia, 1996.
[10] M. Wu, W. Wolf, and B. Liu, An algorithm for wipe detection, inProceedings of International Conference on Image Processing ’98, pp. 893-897, 1998.
[11] W. Xiong, Efficient scene change detection and camera motion annotation for video classification,J. Computer Vision and Image Understanding, 71(2), 166-181, August 1998. · Zbl 05470632 · doi:10.1006/cviu.1998.0711
[12] B.L. Yeo and B. Liu, Rapid scene analysis on compressed video,IEEE Trans. Circuits and Systems for Video Technology 5(6), 533-543, December 1995. · doi:10.1109/76.475896
[13] R. Zabih, J. Miller, and K. Mai, A feature-based algorithm for detecting and classifying production effects.J. Multimedia System, 7(2), 119-128, 1999. · Zbl 05468939 · doi:10.1007/s005300050115
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.