The VuSystem: a programming system for visual processing of digital video

ABSTRACT

In computer-participative multimedia applications, the computer not only manipulates media, but also digests it and performs independent actions based on media content. We present a design approach that applies the programming techniques of visualization systems to the development of computer-participative multimedia applications. We describe an implementation based on this approach, and report performance measurements that demonstrate it is practical. We conclude by describing three applications written with the system, and suggest future directions for research in the area.

REFERENCES

• 1: C. J. Lindblad, D. J. Wetherall, W. F. Stasior, J. F. Adam, H. H. Houh, M. Ismert, D. R. Bather, B. M. Phillips, D. L. Tennenhouse, "ViewStation Applications: Intelligent Video Processing Over a Broadband Local Area Network," Proceedings of the 1994 USENIX Symposium on High Speed Networking, August 1994.
• 2: D. L. Tennenhouse, J. Adam, D. Carver, H. Houh, M. Ismert, C. Lindblad, W. St~ior, D. Wetherall, D. Bacher, and T. Chang, "A Software-Oriented Approach to the Design of Media Processing Environments," Proceedings of the International Conference on Multimedia Computing and Systems, May 199j.
• 3: J. F. Adam, H. H. Houh, M. Ismert, and D. L. Tennenhouse, "A Network Architecture for Distributed Multimedia Systems," Proceedings of the International Conference on Multimedia Computing and Systems, May 1994.
• 4: Apple Computer Inc Staff , Apple Computer Inc., Inside MacIntosh: QuickTime Components, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1993
• 5: T. M. Levergood, A. C. Payne, J. Gettys, G. W. Treese, and L. C. Stewart, "AudioFile: A Network-Transparent System for Distributed Audio Applications," Proceed. ings of the USENIX Summer Conference, June, 1993
• 6: Joel F. Adam , David L. Tennenhouse, The Vidboard: a video capture and processing peripheral for a distributed multimedia system, Proceedings of the first ACM international conference on Multimedia, p.113-120, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166279]
• 7: Microsoft Corporation, "Microsoft Video For Windows Users Guide," Microsoft Corporation, Redmond, WA, 1992.
• 8: J. K. Ousterhout, "Tk: An Xll Toolkit Based on the Tel Language," Computer Science Division (EECS), University of California, Berkeley, CA, January, 1991.
• 9: John K. Ousterhout, Tcl: An Embeddable Command Language, University of California at Berkeley, Berkeley, CA, 1989
• 10: D. P. Anderson, P. Chan, "Comet: A Toolkit for Multiuser Audio/Video Applications," Computer Science Division (EECS), University of California, Berkeley, CA, October, 1991.
• 11: David P. Anderson , Ramesh Govindan , George Homsy, Abstractions for Continuous Media in a Network Window System, University of California at Berkeley, Berkeley, CA, 1990
• 12: C. Williams and J. Rasure, "A visual l~nguage for iraage processing," in IEEE Computer Society Workzhop on Visual Languages, Skokie, Illinois, 1990.
• 13: Paul J. Asente , Ralph R. Swick, X Window system toolkit: the complete programmer's guide and specification, Digital Press, Newton, MA, 1990
• 14: Craig Upson , Thomas Faulhaber, Jr. , David Kamins , David H. Laidlaw , David Schlegel , Jefrey Vroom , Robert Gurwitz , Andries van Dam, The Application Visualization System: A Computational Environment for Scientific Visualization, IEEE Computer Graphics and Applications, v.9 n.4, p.30-42, July 1989 [doi>10.1109/38.31462]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques

          Nouns: Windows
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: C++

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

General Terms:
Algorithms, Design, Measurement, Performance, Verification