Exploring video streams using slit-tear visualizations

ABSTRACT

Video slicing---a variant of slit scanning in photography---extracts a scan line from a video frame and successively adds that line to a composite image over time. The composite image becomes a time line, where its visual patterns reflect changes in a particular area of the video stream. We extend this idea of video slicing by allowing users to draw marks anywhere on the source video to capture areas of interest. These marks, which we call slit-tears, are used in place of a scan line, and the resulting composite timeline image provides a much richer visualization of the video data. Depending on how tears are placed, they can accentuate motion, small changes, directional movement, and relational patterns.

REFERENCES

• 1: James Bo Begole , John C. Tang , Randall B. Smith , Nicole Yankelovich, Work rhythms: analyzing visualizations of awareness histories of distributed groups, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587125]
• 2: Chung, M. G., Lee, J., Kim, H., Song, S. M.-H., and Kim, W. M. 1999. Automatic segmentation based on spatio-temporal features. Journal of Korea Telecom, 4 (1), 4--14.
• 3: Davidhazy, A. Slit-scan photography. School of Photographic Arts and Sciences, Rochester Institute of Technology. Accessed Mar, 2007. URL=http://www.rit.edu/~andpph/text-slit-scan.html.
• 4: Del Mar Thoroughbred Club. Accessed Nov, 2007. URL=http://www.dmtc.com/racinginfo/photofinishes/.
• 5: Elliot, E. 1993. Watch, grab, arrange, see: Thinking with motion images via streams and collages. MS Thesis in Visual Studies, January, MIT.
• 6: Sidney Fels , Eric Lee , Kenji Mase, Techniques for interactive video cubism (poster session), Proceedings of the eighth ACM international conference on Multimedia, p.368-370, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354535]
• 7: Silvio Jamil Ferzoli Guimarães , Michel Couprie , Arnaldo de Albuquerque Araújo , Neucimar Jerônimo Leite, Video segmentation based on 2D image analysis, Pattern Recognition Letters, v.24 n.7, p.947-957, April 2003 [doi>10.1016/S0167-8655(02)00218-0]
• 8: Anita Komlodi , Gary Marchionini, Key frame preview techniques for video browsing, Proceedings of the third ACM conference on Digital libraries, p.118-125, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276688]
• 9: Levin, G. An informal catalogue of slit-scan video artworks. Accessed Nov, 2007. URL=http://www.flong.com/writings/lists/list_slit_scan.htm.
• 10: Ngo, C. W., Pong, T. C., and Chin, R. T. 1999. Detection of gradual transitions through temporal slice analysis. Proc IEEE CVPR, 36--41.
• 11: Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. 2007. What did I miss? Visualizing the past through video traces. Proc ECSCW'07 European Conf on Computer Supported Cooperative Work, Springer-Verlag.
• 12: Gonzalo Ramos , Ravin Balakrishnan, Fluid interaction techniques for the control and annotation of digital video, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.105-114, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964708]
• 13: Silk, G. Hammer Thrower. Image reproduced from National Gallery of Australia gallery. Accessed March, 2007. URL=http://www.nga.gov.au/Silk/Gallery.htm.
• 14: Yeung, M. M., and Yeo, B-L. 1997. Video visualization for compact presentation and fast browsing of pictorial content. IEEE Transactions on Circuits and Systems for Video Technology. 7 (5), 771--785, IEEE.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Algorithms, Human Factors

Keywords:
information visualization, timelines, video analysis, video history