Digital inpainting: a tutorial

ABSTRACT

Digital inpainting is an interesting research topic in multimedia computing and image processing since 2000. This tutorial will cover the most recent contributions in image inpainting / image completion, video inpainting, and 3-D surface completion. In the literature, the first intention of image inpainting was to remove damages portions of an aged photo, by completing the area with surrounding or global information. The techniques used include the analysis and usage of pixel properties in spatial and frequency domains. Furthermore, image inpainting techniques were used in object removal (or image completion) in photos. Several strategic algorithms were developed based on confidence values and priorities of using patches. The techniques used in still images were then extended to video inpainting, which need to consider temporal properties such as motion vectors. With a reasonable combination of object tracking and image completion, objects in video can be removed and possibly replaced. On the other hand, aged films contain two types of defects: spikes and lone vertical lines. These defects need to be precisely detected and removed to restore the original film. In addition, based on image completion techniques, incompleteness of scanning results of a 3-D scanner due to improper location or other reasons of a scanner can be completed.

REFERENCES

• 1: Timothy K. Shih , Nick C. Tang , Wei-Sung Yeh , Ta-Jen Chen , Wonjun Lee, Video inpainting and implant via diversified temporal continuations, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180678]
• 2: Timothy K. Shih, Louis H. Lin, and Wonjun Lee (2006a): "Detection and Removal of Long Scratch Lines in Aged Films," in Proceedings of the 2006 IEEE International Conference on Multimedia & Expo (ICME'2006), Toronto, Canada, July 9-12, 2006.
• 3: Timothy K. Shih , Rong-Chi Chang , Yu-Ping Chen, Motion picture inpainting on aged films, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101215]
• 4: Timothy K. Shih, Rong-Chi Chang, and Liang-Chen Lu (2004): "Multi-Layer Inpainting on Chinese Artwork," in proceedings of the 2004 IEEE International Conference On Multimedia and Expo (ICME 2004), Taipei, June 26-30, 2004.
• 5: T. K. Shih , Liang-Chen Lu , Ying-Hong Wang , Rong-Chi Chang, Multi-resolution image inpainting, Proceedings of the 2003 International Conference on Multimedia and Expo, p.485-488, July 06-09, 2003

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Algorithms, Experimentation

Keywords:
3D surface inpainting, image completion, image inpainting, video inpainting