VIDEO SUMMARIZATION USING MOTION AND AUDIO DESCRIPTORS

Dr. Ajay Divakaran

Senior Principal Member of Technical Staff
Mitsubishi Electric Research Laboratories

Abstract:

We present video summarization and indexing techniques using the MPEG-7 motion activity descriptor. The descriptor can be extracted in the compressed domain and is compact, and hence is easy to extract and match.  We establish that the intensity of motion activity of a video shot is a direct indication of its summarizability. We describe video summarization techniques based on sampling in the cumulative motion activity space. We then describe combinations of the motion activity based techniques with generalized sound recognition that enable completely automatic generation of news and sports video summaries. Our summarization is computationally simple and flexible, which allows rapid generation of a summary of any desired length. If time permits, we will describe our recent results with combinations of supervised and unsupervised learning techniques. We will also present a demonstration of our video browsing system.

Biography :

Dr. Ajay Divakaran received the B.E. (with Hons.) degree in Electronics and Communication Engineering from the University of Jodhpur, Jodhpur, India, in 1985, and the M.S. and Ph.D. degrees from Rensselaer Polytechnic Institute, Troy, NY in 1988 and 1993 respectively. He was an Assistant Professor with the Department of Electronics and Communications Engineering, University of Jodhpur,India, in 1985-86. He was a Research Associate at the Department of Electrical Communication Engineering, Indian Institute of Science, in Bangalore, India in 1994-95. He was a Scientist with Iterated Systems Inc., Atlanta, GA from 1995 to 1998. He joined MERL in 1998 and is now a Senior Principal Member of Technical Staff. He has been an active contributor to the MPEG-7 video standard. His current research interests include video analysis, summarization, indexing and compression, and related applications. He has published several journal and conference papers, as well as two invited book chapters on video indexing and summarization. He currently serves on program committees of key conferences in the area of multimedia content analysis.

Host :