|
 ABSTRACT
Many amateur videographers, like home video enthusiasts, may capture videos that are not of a professional quality. Many minor but visually annoying distortions like lighting imbalance and shaking artifacts could be introduced by the unskilled operations of the video camcorder. Since home videos constitute footage of great sentimental value, such videos cannot be summarily discarded. Unlike movies and sitcoms, shot re-takes of important events, such as wedding ceremonies are just not possible. Therefore, such distortions need to be corrected. In this paper, we present a novel method to detect segments of videos that have lighting and shaking artifacts. These segments can then be subjected to a restoration process that can remove these artifacts. We present techniques to correct lighting artifacts by appropriately adjusting the luminance. In order to remove the shaking artifact, image mosaicing is first employed to build a mosaic frame for the segment with the aid of edge blending techniques. Subsequently a Bezier-curve based blending of motion trajectory is employed to perform motion-compensated filtering of the shaking artifact. The restored video is then created by appropriately cropping the mosaic frame based on the compensated motion trajectory. We have implemented the developed techniques and the experimental results on home videos demonstrate the effectiveness of our approach. Detection and removal of artifacts are significant in other videos as well as those obtained from autonomous vehicles, robots and remote sensing.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
1
|
|
| |
2
|
Casares, J., Myers, B. A., and Long, A. C. Bhatnagar, R. Stevens, S. M. Dabbish, L. Corbett, A. Simplifying video editing with intelligent interaction (submitted). http://www-2.cs.cmu.edu/~silver/publications.html.
|
| |
3
|
Chen. T. Video stabilization algorithm using a block-based parameteric motion model. Project report, 2000. http://www-isl.stanford.edu/~tingchen
|
| |
4
|
|
| |
5
|
Filippo V., Alfio C., Massimo M. and Giuseppe M. Robust digital image stabilizing algorithm using block motion vectors, in Proceedings of International Coneference on Consumer Electronics(ICCE'02), (Los Angeles, June, 2002), 234--235.
|
| |
6
|
Girgensohn, A., Bly, S., Shipman, F., Boreczky, J. and Wilcox, L. Home video editing made easy-balancing automation and user control, in Proceedings of INTERACT '01, IOS Press, 464--471, 2001.
|
| |
7
|
Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States
[doi> 10.1145/354401.354415]
|
| |
8
|
Gove R. J., Video stabilization system and method. Texas Instruments. United States Patent 5973733, October 26, 1999.
|
| |
9
|
Hansen; M. W. and McDowell L. K. Apparatus and method for removing blank areas from real-time stabilized images by inserting background information. Sarnoff Corporation, Princeton New Jersey. United States Patent 6211913, April 3, 2001.
|
| |
10
|
|
| |
11
|
|
| |
12
|
Ryan C. Jones , Daniel DeMenthon , David S. Doermann, Building mosaics from video using MPEG motion vectors, Proceedings of the seventh ACM international conference on Multimedia (Part 2), p.29-32, October 30-November 05, 1999, Orlando, Florida, United States
[doi> 10.1145/319878.319886]
|
| |
13
|
Latecki, L. J., Wildt, D. and Hu. J. Extraction of key frames from videos by optimal color composition matching and polygon simplification, in Proceedings of the workshop on multimedia signal processing (Cannes, October 2001).
|
| |
14
|
|
| |
15
|
Lienhart, R. Dynamic video summarization of home video, in Proceedings of SPIE 3972: Storage and Retrieval for Media Databases 2000, 378--389, Jan. 2000.
|
| |
16
|
Ma, W.Y. and Zhang, H. J. An indexing and browsing system for home video, in Proceedings of EUSIPCO'2000, (Tampere, Sept. 2000), 5--8.
|
| |
17
|
|
| |
18
|
|
| |
19
|
|
| |
20
|
Sato T. Camera with a shake detection function. Olympus Optical Co., Ltd., Japan. United States Patent 6067418, May 23, 2000.
|
| |
21
|
Shiomi Y. Image stabilizing device. Canon Kabushiki Kaisha, Japan. United States Patent 6282376, August 28, 2001.
|
| |
22
|
|
| |
23
|
|
| |
24
|
Yamazaki T. and Ishikawa Y. Image-shake preventing apparatus. Canon Kabushiki Kaisha, Japan, United States Patent 6263162, July 17, 2001.
|
| |
25
|
|
| |
26
|
Operating Instructions of Sony Digital Video Camera Recorder. DCR-TRV15E/TRV17E. Sony Corporation, 2001.
|
| |
27
|
Operating Instructions of Sony Digital Video Camera Recorder. DCR-PC101E. Sony Corporation, 2002.
|
| |
28
|
|
CITED BY 11
|
|
|
|
|
Chao-Ming (James) Teng , Chon-In Wu , Yi-Chao Chen , Hao-hua Chu , Jane Yung-jen Hsu, Design and evaluation of mProducer: a mobile authoring tool for personal experience computing, Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, p.141-148, October 27-29, 2004, College Park, Maryland
|
|
|
|
|
|
Chon-In Wu , Chao-Ming James Teng , Yi-Chao Chen , Tung-Yun Lin , Hao-Hua Chu , Jane Yung-Jen Hsu, Point-of-capture archiving and editing of personal experiences from a mobile device, Personal and Ubiquitous Computing, v.11 n.4, p.235-249, April 2007
|
|
|
Jun-Cheng Chen , Wei-Ta Chu , Jin-Hau Kuo , Chung-Yi Weng , Ja-Ling Wu, Tiling slideshow, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA
|
|
|
|
|
|
David Kirk , Abigail Sellen , Richard Harper , Ken Wood, Understanding videowork, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Adobe Acrobat
QuickTime
Windows Media Player
Real Player
Pdf
H.3