Motion picture inpainting on aged films

ABSTRACT

Video inpainting uses spatial-temporal information to repair defects such as spikes and lines on aged films. We propose a series of new algorithms based on adjustable thresholds to repair different varieties of aged films. The main contribution is an automatic spike and dirt detection mechanism. We prove that if appropriate threshold is once decided by the author, most damages in an aged video clip can be detected. In addition, the repairing procedure first estimates temporal information and obtain replacement blocks among several frames. Spatial information is then used to repair damages that can not be fixed by temporal information due to fast motion. The results are visually pleasant with most defects removed.

REFERENCES

• 1: Joyeux, L., Buisson, O., Besserer, B., Boukir, S., "Detection and Removal of Line Scratches in Motion Picture Films," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, pp. 548--553.
• 2: Patwardhan, K. A., Sapiro, G., and Bertalmio, M., "Video Inpainting of Occluding and Occluded Objects," The 2005 IEEE International Conference on Image Processing, Genova, Sep. 11-24, 2005.
• 3: Alberto Machì , Fabio Collura, Accurate Spatio-Temporal Restoration of Compact Single Frame Defects in Aged Motion Pictures, Proceedings of the 12th International Conference on Image Analysis and Processing, p.454, September 17-19, 2003
• 4: Shih, Timothy K., Chang,.R.-C., Lu, L.-C., "Multi-Layer Inpainting on Chinese Artwork," The 2004 IEEE International Conference on Multimedia & Expo, 2004, pp. 33--36.
• 5: Yan, W.-Q., Kankanhalli, Mohan S., "Erasing Video Logos Based on Image Inpainting," The 2002 IEEE International Conference in Multimedia and Expo, 2002, pp. 521--524.
• 6: Yunjun Zhang , Jiangjian Xiao , Mubarak Shah, Motion Layer Based Object Removal in Videos, Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1, p.516-521, January 05-07, 2005 [doi>10.1109/ACVMOT.2005.75]
• 7: Yasuyuki Matsushita , Eyal Ofek , Xiaoou Tang , Heung-Yeung Shum, Full-Frame Video Stabilization, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.50-57, June 20-26, 2005 [doi>10.1109/CVPR.2005.166]
• 8: Criminisi, A., Perez, P., and Toyama, K., "Object Removal by Exemplar-Based Inpainting," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2003, vol. 2, pp. 721--728.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Experimentation

Keywords:
defect detection, image completion, inpainting, motion estimation, software tool, video inpainting