Comparing MMVIS to a timeline for temporal trend analysis of video data

ABSTRACT

Our MultiMedia Visual Information Seeking (MMVIS) environment provides an exploratory visual paradigm for temporal trend analysis. In this paper, we present the results of a user interface study evaluating the utility of MMVIS. We compare MMVIS to a timeline-based approach for analyzing temporal trends in real video data. We evaluate the quantity, complexity and accuracy of temporal trend observations made within each interface, compare the number of positive versus negative trends found, and collect feedback on user satisfaction. Our results show that subjects made interesting and complex observations of temporal trends using either interface. The results also indicate some advantages and biases of each interface, such as 1) timeline subjects make more errors during analysis and 2) timeline subjects are biased against identifying negative trends such as exceptions. At the same time, however, subjects appreciate the familiarity of timelines. Because we designed the MMVIS architecture to provide users with a library of visualizations, we thus include a discussion on enhancing the utility of MMVIS through incorporating a timeline into it in the future.

REFERENCES

• 1: Christopher Ahlberg , Ben Shneiderman, Visual information seeking: tight coupling of dynamic query filters with starfield displays, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.313-317, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191775]
• 2: Christopher Ahlberg , Christopher Williamson , Ben Shneiderman, Dynamic queries for information exploration: an implementation and evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems, p.619-626, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143054]
• 3: Richard Catrambone , John M. Carroll, Learning a word processing system with training wheels and guided exploration, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.169-174, April 05-09, 1987, Toronto, Ontario, Canada
• 4: John P. Chin , Virginia A. Diehl , Kent L. Norman, Development of an instrument measuring user satisfaction of the human-computer interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.213-218, May 15-19, 1988, Washington, D.C., United States [doi>10.1145/57167.57203]
• 5: Davis, M. (1993). Media Streams: An Iconic Lang. for Video Annotation. Telektronikk 4.93:Cyberspace 89(4), 59--71.
• 6: Stephen G. Eick , Paul J. Lucas, Displaying trace files, Software—Practice & Experience, v.26 n.4, p.399-409, April 1996 [doi>10.1002/(SICI)1097-024X(199604)26:4<399::AID-SPE8>3.3.CO;2-A]
• 7: Harrison, B. L., Owen, R. and Baecker, R. M. (1994). Timelines: An Interactive System for the Collection of Visualization of Temporal Data. In Proc. of Graphics Interface'94. Toronto: Canadian Info. Proc. Society, 141--148.
• 8: Stacie Lynn Hibino, Multimedia visual information seeking, University of Michigan, Ann Arbor, MI, 1997
• 9: Stacie Hibino , Elke A. Rundensteiner, User interface evaluation of a direct manipulation temporal visual query language, Proceedings of the fifth ACM international conference on Multimedia, p.99-107, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266342]
• 10: Stacie Hibino , Elke A. Rundensteiner, Interactive visualizations for temporal analysis: application to CSCW multimedia data, Intelligent multimedia information retrieval, MIT Press, Cambridge, MA, 1997
• 11: Stacie Hibino , Elke A. Rundensteiner, MMVIS: design and implementation of a multimedia visual information seeking environment, Proceedings of the fourth ACM international conference on Multimedia, p.75-86, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244149]
• 12: Hibino, S. and Rundensteiner, E. (1996b). A Visual Multimedia Query Language for Temporal Analysis of Video Data. In Multimedia Database Systems: Design and Implementation Strategies (K. Nwosu, B. Thuraisingham and P. B. Berra, Eds.), 123--159. Norwell, MA: Kluwer Acad. Publ.
• 13: Dean F. Jerding , John T. Stasko , Thomas Ball, Visualizing interactions in program executions, Proceedings of the 19th international conference on Software engineering, p.360-370, May 17-23, 1997, Boston, Massachusetts, United States [doi>10.1145/253228.253356]
• 14: North, C., Shneiderman, B. and Plaisant, C. (1997). Visual Information Seeking in Digital Image Libraries: The Visible Human Explorer. In Information in Images (G. Becker, Ed.), Thomson Technology Labs (http://www.thomtech.com/mmedia/tmr97/chap4.htm).
• 15: Catherine Plaisant , Brett Milash , Anne Rose , Seth Widoff , Ben Shneiderman, LifeLines: visualizing personal histories, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.221-ff., April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238493]
• 16: Christopher Williamson , Ben Shneiderman, The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.338-346, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133216]

INDEX TERMS

Keywords:
dynamic queries, multimedia visual information seeking, temporal analysis, user interface evaluation, video analysis