Rapid serial visual presentation techniques for consumer digital video devices

ABSTRACT

In this paper we propose a new model for a class of rapid serial visual presentation (RSVP) interfaces [16] in the context of consumer video devices. The basic spatial layout "explodes" a sequence of image frames into a 3D trail in order to provide more context for a spatial/temporal presentation. As the user plays forward or back, the trail advances or recedes while the image in the foreground focus position is replaced. The design is able to incorporate a variety of methods for analyzing or highlighting images in the trail. Our hypotheses are that users can navigate more quickly and precisely to points of interest when compared to conventional consumer-based browsing, channel flipping, or fast-forwarding techniques. We report on an experiment testing our hypotheses in which we found that subjects were more accurate but not faster in browsing to a target of interest in recorded television content with a TV remote.

REFERENCES

• 1: Hisashi Aoki , Shigeyoshi Shimotsuji , Osamu Hori, A shot classification method of selecting effective key-frames for video browsing, Proceedings of the fourth ACM international conference on Multimedia, p.1-10, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244135]
• 2: John Boreczky , Andreas Girgensohn , Gene Golovchinsky , Shingo Uchihashi, An interactive comic book presentation for exploring video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.185-192, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332428]
• 3: Michael G. Christel , David B. Winkler , C. Roy Taylor, Multimedia abstractions for a digital video library, Proceedings of the second ACM international conference on Digital libraries, p.21-29, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263776]
• 4: Michael G. Christel , Alexander G. Hauptmann , Howard D. Wactlar , Tobun D. Ng, Collages as dynamic summaries for news video, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641120]
• 5: 5. Coltheart, V. (Ed.) (1999) Fleeting Memories: Cognition of Brief Visual Stimuli. MIT Press, Cambridge MA, USA.
• 6: Oscar de Bruijn , Robert Spence, Rapid serial visual presentation: a space-time trade-off in information presentation, Proceedings of the working conference on Advanced visual interfaces, p.189-192, May 2000, Palermo, Italy [doi>10.1145/345513.345309]
• 7: 7. De Bruijn, O., & Spence, R. (2002) Patterns of eye gaze during Rapid Serial Visual Presentation. In Proceedings of Advanced Visual Interfaces (AVI 2002) (May, Trento, Italy), ACM, pp. 209-217.
• 8: Wei Ding , Gary Marchionini , Dagobert Soergel, Multimodal surrogates for video browsing, Proceedings of the fourth ACM conference on Digital libraries, p.85-93, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313266]
• 9: Steven M. Drucker , Asta Glatzer , Steven De Mar , Curtis Wong, SmartSkip: consumer level browsing and skipping of digital video content, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503416]
• 10: 10. Elliot, E. (1993) Watch, grab, arrange, see: thinking with motion images via streams and collages. MSVS thesis, Massachusetts Institute of Technology, Cambridge MA, USA.
• 11: Eric Freeman , David Gelernter, Lifestreams: a storage model for personal data, ACM SIGMOD Record, v.25 n.1, p.80-86, March 1996 [doi>10.1145/381854.381893]
• 12: Christopher G. Healey , Kellogg S. Booth , James T. Enns, High-speed visual estimation using preattentive processing, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.2, p.107-135, June 1996 [doi>10.1145/230562.230563]
• 13: Hyowon Lee , Alan F. Smeaton , Catherine Berrut , Noel Murphy , Seán Marlow , Noel E. O'Connor, Implementation and Analysis of Several Keyframe-Based Browsing Interfaces to Digital Video, Proceedings of the 4th European Conference on Research and Advanced Technology for Digital Libraries, p.206-218, September 18-20, 2000
• 14: Francis C. Li , Anoop Gupta , Elizabeth Sanocki , Li-wei He , Yong Rui, Browsing digital video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.169-176, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332425]
• 15: 15. Spence, R. (2001) Information Visualization. ACM Press & Addison-Wesley, Harlow, England.
• 16: Robert Spence, Rapid, serial and visual: a presentation technique with potential, Information Visualization, v.1 n.1, p.13-19, March 2002 [doi>10.1057/palgrave/ivs/9500008]
• 17: Tony Tse , Gary Marchionini , Wei Ding , Laura Slaughter , Anita Komlodi, Dynamic key frame presentation techniques for augmenting video browsing, Proceedings of the working conference on Advanced visual interfaces, May 24-27, 1998, L'Aquila, Italy [doi>10.1145/948496.948522]
• 18: Kent Wittenburg , Wissam Ali-Ahmad , Daniel LaLiberte , Tom Lanning, Rapid-fire image previews for information navigation, Proceedings of the working conference on Advanced visual interfaces, May 24-27, 1998, L'Aquila, Italy [doi>10.1145/948496.948508]
• 19: Kent Wittenburg , John Nicol , Jim Paschetto , Chris Martin, Browsing with Dynamic Key Frame Collages in Web-Based Entertainment Video Services, Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume II-Volume 2, p.913, June 07-11, 1999
• 20: 20. Wittenburg, K., Chiyoda, C., Heinrichs, M., & Lanning, T. (2000) Browsing through rapid-fire imaging: requirements and industry initiatives. In Proceedings of Electronic Imaging '2000: Internet Imaging (January, San Jose CA, USA), SPIE, pp. 48-56.
• 21: 21. Wittenburg, K., Lanning, T., Forlines, C., & Esenther, A. (2003) Rapid serial visual presentation techniques for visualizing a third data dimension. In Proceedings of HCI International 2003 (June, Crete, GREECE), Lawrence Erlbaum, Vol. 4, pp. 810-814.
• 22: 22. Xiong, Z., Radhakrishnan, R., & Divakaran, A. (2003) Generation of sports highlights using motion activity in combination with a common audio feature extraction framework. In Proceedings of IEEE International Conference on Image Processing (ICIP) (September, Barcelona SPAIN), IEEE, to appear.
• 23: HongJiang Zhang , Atreyi Kankanhalli , Stephen W. Smoliar, Automatic partitioning of full-motion video, Multimedia Systems, v.1 n.1, p.10-28, June 1993 [doi>10.1007/BF01210504]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: 3D/stereo scene analysis
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Visual

General Terms:
Design, Experimentation

Keywords:
RSVP, TV interfaces, consumer devices, multimedia interfaces, rapid serial visual presentation, video browsing