Soft scissors: an interactive tool for realtime high quality matting

ABSTRACT

We present Soft Scissors, an interactive tool for extracting alpha mattes of foreground objects in realtime. We recently proposed a novel offline matting algorithm capable of extracting high-quality mattes for complex foreground objects such as furry animals [Wang and Cohen 2007]. In this paper we both improve the quality of our offline algorithm and give it the ability to incrementally update the matte in an online interactive setting. Our realtime system efficiently estimates foreground color thereby allowing both the matte and the final composite to be revealed instantly as the user roughly paints along the edge of the foreground object. In addition, our system can dynamically adjust the width and boundary conditions of the scissoring paint brush to approximately capture the boundary of the foreground object that lies ahead on the scissor's path. These advantages in both speed and accuracy create the first interactive tool for high quality image matting and compositing.

REFERENCES

• 1: Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A bayesian approach to digital mating. In Proceedings of IEEE CVPR, 264--271.
• 2: CORPORATION, C. 2002. Knockout user guide.
• 3: Leo Grady, Random Walks for Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.11, p.1768-1783, November 2006 [doi>10.1109/TPAMI.2006.233]
• 4: INCORP., A. S. 2002. Adobe photoshop user guide.
• 5: Anat Levin , Dani Lischinski , Yair Weiss, A Closed Form Solution to Natural Image Matting, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.61-68, June 17-22, 2006 [doi>10.1109/CVPR.2006.18]
• 6: Yin Li , Jian Sun , Chi-Keung Tang , Heung-Yeung Shum, Lazy snapping, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 7: Dani Lischinski , Zeev Farbman , Matt Uyttendaele , Richard Szeliski, Interactive local adjustment of tonal values, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 8: Eric N. Mortensen , William A. Barrett, Intelligent scissors for image composition, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.191-198, September 1995 [doi>10.1145/218380.218442]
• 9: Carsten Rother , Vladimir Kolmogorov , Andrew Blake, "GrabCut": interactive foreground extraction using iterated graph cuts, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 10: Jian Sun , Jiaya Jia , Chi-Keung Tang , Heung-Yeung Shum, Poisson matting, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 11: Jue Wang , Michael F. Cohen, An Iterative Optimization Approach for Unified Image Segmentation and Matting, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.936-943, October 17-20, 2005 [doi>10.1109/ICCV.2005.37]
• 12: Wang, J., and Cohen, M. F. 2007. Optimized color sampling for robust matting. In Proceedings of IEEE CVPR.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.6 Segmentation
          Subjects: Edge and feature detection; Region growing, partitioning

General Terms:
Algorithms, Design