Multi-scale video cropping

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Multi-scale video cropping

Full text

Pdf (468 KB)

Source

International Multimedia Conference archive
Proceedings of the 15th international conference on Multimedia table of contents

Augsburg, Germany

SESSION: Applications 1 - enhancing user experiences table of contents

Pages: 97 - 106

Year of Publication: 2007

ISBN:978-1-59593-702-5

Authors

Hazem El-Alfy	University of Maryland, College Park, MD
David Jacobs	University of Maryland, College Park, MD
Larry Davis	University of Maryland, College Park, MD

Sponsors

ACM: Association for Computing Machinery
SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGMULTIMEDIA: ACM Special Interest Group on Multimedia

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 3, Downloads (12 Months): 70, Citation Count: 0

Additional Information:

abstract references index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1291233.1291255 What is a DOI?

ABSTRACT

We consider the problem of cropping surveillance videos. This process chooses a trajectory that a small sub-window can take through the video, selecting the most important parts of the video for display on a smaller monitor. We model the information content of the video simply, by whether the image changes at each pixel. Then we show that we can find the globally optimal trajectory for a cropping window by using a shortest path algorithm. In practice, we can speed up this process without affecting the results, by stitching together trajectories computed over short intervals. This also reduces system latency. We then show that we can use a second shortest path formulation to find good cuts from one trajectory to another, improving coverage of interesting events in the video. We describe additional techniques to improve the quality and efficiency of the algorithm, and show results on surveillance videos.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Ravindra K. Ahuja , Kurt Mehlhorn , James Orlin , Robert E. Tarjan, Faster algorithms for the shortest path problem, Journal of the ACM (JACM), v.37 n.2, p.213-223, April 1990 [doi>10.1145/77600.77615]
	2	L.-Q. Chen, X. Xie, X. Fan, W.-Y. Ma, H.-J. Zhang, and H.-Q. Zhou. A visual attention model for adapting images on small displays. Multimedia Systems, 9(4):353--364, Oct 2003.
	3	Franklin C. Crow, Summed-area tables for texture mapping, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.207-212, January 1984
	4	Robert B. Dial, Algorithm 360: shortest-path forest with topological ordering [H], Communications of the ACM, v.12 n.11, p.632-633, Nov. 1969 [doi>10.1145/363269.363610]
	5	E. W. Dijkstra. A note on two problems in connection with graphs. Numerische Mathematik, 1:269--271, 1959.
	6	Xin Fan , Xing Xie , He-Qin Zhou , Wei-Ying Ma, Looking into video frames on small displays, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957063]
	7	A. Girgensohn, J. Adcock, M. Cooper, J. Foote, and L. Wilcox. Simplifying the management of large photo collections. In Human-computer Interaction (INTERACT'03), pages 196--203, 2003.
	8	Rachel Heck , Michael Wallick , Michael Gleicher, Virtual videography, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.3 n.1, p.4-es, February 2007 [doi>10.1145/1198302.1198306]
	9	H. Hung and S. Gong. Quantifying temporal saliency. British Machine Vision Conference (BMVC '04), pages 727--736, Sept. 2004.
	10	Laurent Itti , Pierre Baldi, A Principled Approach to Detecting Surprising Events in Video, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.631-637, June 20-26, 2005 [doi>10.1109/CVPR.2005.40]
	11	Laurent Itti , Christof Koch , Ernst Niebur, A Model of Saliency-Based Visual Attention for Rapid Scene Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.11, p.1254-1259, November 1998 [doi>10.1109/34.730558]
	12	Timor Kadir , Michael Brady, Saliency, Scale and Image Description, International Journal of Computer Vision, v.45 n.2, p.83-105, November 2001 [doi>10.1023/A:1012460413855]
	13	Hong-Wen Kang , Xue-Quan Chen , Yasuyuki Matsushita , Xiaoou Tang, Space-Time Video Montage, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.1331-1338, June 17-22, 2006 [doi>10.1109/CVPR.2006.284]
	14	Feng Liu , Michael Gleicher, Video retargeting: automating pan and scan, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180702]
	15	Bongwon Suh , Haibin Ling , Benjamin B. Bederson , David W. Jacobs, Automatic thumbnail cropping and its effectiveness, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.95-104, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964707]
	16	Paul Viola , Michael J. Jones, Robust Real-Time Face Detection, International Journal of Computer Vision, v.57 n.2, p.137-154, May 2004 [doi>10.1023/B:VISI.0000013087.49260.fb]
	17	J. Wang, M. J. Reinders, R. L. Lagendijk, J. Lindenberg, and M. S. Kankanhalli. Video content representation on tiny devices. IEEE International Conference on Multimedia and Expo (ICME'04), 3:1711--1714, June 2004.
	18	Xing Xie , Hao Liu , Simon Goumaz , Wei-Ying Ma, Learning user interest for image browsing on small-form-factor devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055065]