Visual digests for news video libraries

ABSTRACT

The Informedia Digital Video Library contains over 2000 hours of video, growing at a rate of 15 hours per week. A good query engine is not sufficient for information retrieval because often the candidate result sets grow in number as the library grows. Video digests summarize sets of stories from the library, providing users with a visual mechanism for interactive browsing and query refinement. These digests are generated dynamically under the direction of the user based on automatically derived metadata from the video library. Three types of digests are discussed: VIBE digests emphasizing word relationships, timelines showing trends against time, and maps showing geographic correlations. Multiple digests can be combined into a single view or animated into a temporal presentation.

REFERENCES

• 1: Christopher Ahlberg , Ben Shneiderman, Visual information seeking: tight coupling of dynamic query filters with starfield displays, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.313-317, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191775]
• 2: Allan, J., Carbonell, J., Doddington, G., Yamron, I., and Yang, Y. Topic Detection and Tracking Pilot Study: Final Report. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998), 194-218.
• 3: Michael Christel , David Martin, Information Visualization Within a Digital Video Library, Journal of Intelligent Information Systems, v.11 n.3, p.235-257, Nov./Dec. 1998 [doi>10.1023/A:1008638024786]
• 4: Christel, M.G., and Olligschlaeger, A.M. Interactive Maps for a Digital Video Library. In Proc. Int'l Conf. on Multimedia Computing and Systems (Florence, Italy, June 1999), IEEE Press, 381-387.
• 5: Michael G. Christel , David B. Winkler , C. Roy Taylor, Multimedia abstractions for a digital video library, Proceedings of the second ACM international conference on Digital libraries, p.21-29, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263776]
• 6: Environmental Systems Research Institute, Inc., home page, httv://www.esri.com/
• 7: Hauptmann, A.G., Jones, R.E., Seymore, K., Siegler, M.A., Slattery, S.T., and Witbrock, M.J. Experiments in Information Retrieval from Spoken Documents. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998), 175-181.
• 8: Alexander G. Haupmann , Michael J. Witbrock, Story Segmentation and Detection of Commercials in Broadcast News Video, Proceedings of the Advances in Digital Libraries Conference, p.168, April 22-24, 1998
• 9: Houghton, R. Automatic Accumulation of a Scalable Named Face Database. iEEE Intelligent Systems, 1999, in press.
• 10: Kubala, F., Schwartz, R., Stone, R., and Weischedel, R. Named Entity Extraction from Speech. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998).
• 11: Inderjeet Mani , David House , Mark Maybury, Towards content-based browsing of broadcast news video, Intelligent multimedia information retrieval, MIT Press, Cambridge, MA, 1997
• 12: Kai A. Olsen , Robert R. Korfhage , Kenneth M. Sochats , Michael B. Spring , James G. Williams, Visualization of a document collection: the vibe system, Information Processing and Management: an International Journal, v.29 n.1, p.69-81, Jan.–Feb. 1993 [doi>10.1016/0306-4573(93)90024-8]
• 13: Toshio Sato , Takeo Kanade , Ellen K. Hughes , Michael A. Smith, Video OCR for Digital News Archive, Proceedings of the 1998 International Workshop on Content-Based Access of Image and Video Databases (CAIVD '98), p.52, January 03-03, 1998
• 14: Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. HCI Lab, Inst. Systems Research, Inst. Advanced Computer Studies, Dept. of Computer Science Tech. Report CS-TR-3665, Univ. of Maryland, (July 1996).
• 15: Howard D. Wactlar , Michael G. Christel , Yihong Gong , Alexander G. Hauptmann, Lessons Learned from Building a Terabyte Digital Video Library, Computer, v.32 n.2, p.66-73, February 1999 [doi>10.1109/2.745722]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Experimentation, Theory

Keywords:
digital video library, information visualization, multimedia abstraction