Designing an interactive tool for video object segmentation and annotation

ABSTRACT

An interactive authoring system is proposed for semi-automatic video object segmentation and annotation. This system features a new contour interpolation algorithm, which enables the user to define the contour of a video object on multiple frames while the computer interpolates the missing contours of this object on every frame automatically. Typical active contour (snake) model is adapted and the contour interpolation problem is decomposed into two directional contour tracking problems and a merging problem. In addition, new user interaction models are created for the user to interact with the computer. Experiments indicate that this system offers a good balance between algorithm complexity and user interaction efficiency.

REFERENCES

• 1: M. Kass, etc., "Snakes: Active contour models," Int. Y. Comput. Vision, voh 1, no. 4, 1988.
• 2: Davi Geiger , Alok Gupta , Luiz A. Costa , John Vlontzos, Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.3, p.294-302, March 1995 [doi>10.1109/34.368194]
• 3: Y.T. Lin, etc., "Tra~ing deformable objects with the active contour model," in IEEE Int. Con/. MCS, Ottawa, Canada, June 1997.
• 4: Y. Fu, etc., "Occlusion adaptive motion snake," in ICLP'98, Chicago.
• 5: Tzi-cker Chiueh , Tulika Mitra , Anindya Neogi , Chuan-Kai Yang, Zodiac: a history-based interactive video authoring system, Proceedings of the sixth ACM international conference on Multimedia, p.435-444, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.291138]
• 6: Eric N. Mortensen , William A. Barrett, Interactive segmentation with Intelligent Scissors, Graphical Models and Image Processing, v.60 n.5, p.349-384, Sept. 1998 [doi>10.1006/gmip.1998.0480]
• 7: A. A. Amini , T. E. Weymouth , R. C. Jain, Using Dynamic Programming for Solving Variational Problems in Vision, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.9, p.855-867, September 1990 [doi>10.1109/34.57681]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.6 Programming Environments
          Subjects: Interactive environments

General Terms:
Algorithms, Design, Theory