Assessing tools for use with webcasts

ABSTRACT

This research assessed the effectiveness of selected interface tools in helping people respond to classic information tasks with webcasts. Rather than focus on a classic search/browse task to locate an appropriate webcast to view, our work takes place at the level of an individual webcast to assess interactivity within the contents of a single webcast. The questions guiding our work are: 1) Which tool(s) are the most effective in achieving the best response? 2) How do users use those tools for task completion? In this study, 16 participants responded to a standard set of information tasks using ePresence, a webcasting system that handles both live and stored video, and provides multiple techniques for accessing content. Using questionnaires, screen capture and interviews, we evaluated the interaction, assessed the tools, and based on our results, make suggestions for improving access to the content of stored webcasts.

REFERENCES

• 1: Ron Baecker, A principled design for scalable internet visual communications with rich media, interactivity, and structured archives, Proceedings of the 2003 conference of the Centre for Advanced Studies on Collaborative research, p.16-29, October 06-09, 2003, Toronto, Ontario, Canada
• 2: Michael G. Christel , Michael A. Smith , C. Roy Taylor , David B. Winkler, Evolving video skims into useful multimedia abstractions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.171-178, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274670]
• 3: Wei Ding , Gary Marchionini , Dagobert Soergel, Multimodal surrogates for video browsing, Proceedings of the fourth ACM conference on Digital libraries, p.85-93, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313266]
• 4: Wei Ding , Gary Marchionini, A study on video browsing strategies, University of Maryland at College Park, College Park, MD, 1997
• 5: Christine Dufour , Elaine G. Toms , Jonathan Lewis , Ron Baecker, User strategies for handling information tasks in webcasts, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056912]
• 6: Geisler, G. et al. Interface concepts for the open video project. In Proceedings of the 64th ASIST Annual Meeting (ASIST2001) (Washington, DC, USA, November 3-8, 2001). Information Today Inc., Medford, 2001, 58--75.
• 7: Alexander G. Hauptmann , Michael G. Christel , Norman D. Papernick, Video retrieval with multiple image search strategies, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544323]
• 8: Liwei He , Elizabeth Sanocki , Anoop Gupta , Jonathan Grudin, Comparing presentation summaries: slides vs. reading vs. listening, Proceedings of the SIGCHI conference on Human factors in computing systems, p.177-184, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332427]
• 9: Lee, H. & Smeaton, A. Designing the user interface for the Fííschlár Digital Video Library. Journal of Digital Information, 2, 4 (2002). http://jodi.ecs.soton.ac.uk/Articles/v02/i04/Lee/
• 10: Li, F. et al. Browsing digital video. CHI Letters: Human Factors in Computing Systems, 2, 1 (2000), 169--176.
• 11: Neema Moraveji, Improving video browsing with an eye-tracking evaluation of feature-based color bars, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996363]
• 12: Rowe, L.A., Harley, D., and Pletcher P. BIBS: a lecture webcasting system. (2001) http://bmrc.berkeley.edu/ research/ publications/2001/160/bibs-report.pdf
• 13: Slaughter, L., Marchionini, G. and Geisler, G. Open Video: a framework for a test collection. Journal of Network and Computer Applications, 23, 3 (2000), 219--245.
• 14: A. F. Smeaton , N. Murphy , N. E. O'Connor , S. Marlow , H. Lee , K. McDonald , P. Browne , J. Ye, The físchlár digital video system: a digital library of broadcast TV programmes, Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, p.312-313, January 2001, Roanoke, Virginia, United States [doi>10.1145/379437.379696]
• 15: Tanveer Syeda-Mahmood , Dulce Ponceleon, Learning video browsing behavior and its application in the generation of video previews, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500161]
• 16: Elaine G. Toms , Luanne Freund , Cara Li, WiIRE: the web interactive information retrieval experimentation system prototype, Information Processing and Management: an International Journal, v.40 n.4, p.655-675, May 2004 [doi>10.1016/j.ipm.2003.08.006]
• 17: Howard D. Wactlar , Michael G. Christel , Yihong Gong , Alexander G. Hauptmann, Lessons Learned from Building a Terabyte Digital Video Library, Computer, v.32 n.2, p.66-73, February 1999 [doi>10.1109/2.745722]
• 18: Webopedia. http://isp.webopedia.com/TERM/W/Webcast.htm
• 19: Steve Whittaker , Julia Hirschberg , John Choi , Don Hindle , Fernando Pereira , Amit Singhal, SCAN: designing and evaluating user interfaces to support retrieval from speech archives, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.26-33, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312639]
• 20: Barbara M. Wildemuth , Gary Marchionini , Meng Yang , Gary Geisler , Todd Wilkens , Anthony Hughes , Richard Gruss, How fast is too fast?: evaluating fast forward surrogates for digital video, Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries, May 27-31, 2003, Houston, Texas
• 21: Yang, M. et al. Measuring user performance during interactions with digital video. In Proceedings of 66th ASIST Annual Meeting (ASIST2003) (Long Beach, CA, USA, October 19-22, 2003). Information Today Inc., Medford, 2003, 221--230.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

General Terms:
Design, Human Factors, Performance

Keywords:
ePresence, evaluation, information tasks, interface tools, webcasting systems