Multipoint audio and video control for packet-based multimedia conferencing

ABSTRACT

With the advent of broadband integrated services data network (B-ISDN) technologies such as Asynchronous Transfer Mode (ATM) networks, packet-based multimedia (e.g., live audio and video, animation, and text) conferencing is becoming a viable means for achieving virtual proximity, which enables us to overcome the physical separation in space and time and to interact more effectively in our science and engineering endeavors. To bring about the reality of virtual proximity, many technical issues need to be addressed. One important issue is to develop an efficient multipoint audio and video control scheme. This paper discusses the related issues and outlines a solution.

REFERENCES

• 1: Alvarez-Cuevas, Felipe, et al., "Voice Synchronization in Packet Switching Networks," IEEE Network September 1993, pp. 20-25.
• 2: Bobsin, John H., Mohamed A. Marouf, and Paul J. Rutkowski, "Network Services Audio Bridge," IEEE International Conference on Communications. ICC '82. The Digital Revolution, 13-17 June 1982, Philadelphia, PA, USA, Vol. 2, pp. 4E.3/1-5.
• 3: Casner, Steve, "Minutes of Audio/Video Transport Working Group (AVT)," USC/iSI, available by ftp from ftp.isi.edu:/ietf/avt/avt-minutes- 94mar.txt, May 1994.
• 4: CCIR Recommendation 717, "Tolerances for transmission time differences between the vision and the sound components of a television signal," Dusseldorf, 1990.
• 5: Chang, Yee-Hsiang and Jon Whaley, "Remote Conferencing Architecture," MCNC Center for Communications Packet Video document, June 1992.
• 6: Chang, Shih-Fu et al., "Video Compositing in the DCT Domain," IEEE Intern. Workshop on Visual Signal Processing and Communications, Raleigh, North Carolina, Sept. 1992.
• 7: Chang, Shih-Fu and David G. Messerschmitt, "A New Approach to Decoding and Compositing Motion-Compensated DCT-Based Images," ICASSP '93, Minneapolis, MN, April 1993.
• 8: Cooper, J. Carl, "Video-to-Audio Synchrony Monitoring and Correction", Society of Motion Picture and Television Engineers (SSMPTE) Journal, September 1988.
• 9: Cohen, Danny, A Network Voice Protocol NVP-II, USC/ISI, April 1981.
• 10: Cole, Randy, PVP- A Packet Video Protocol, USC/ISI, August 1981.
• 11: Decina, Maurizio, "High Speed Switching for Broadband Communications," IEEE Lecture Series, 1992.
• 12: Frederick, Ron, "Network Video", a video conferencing tool.
• 13: Gray, Joe, CONCERT Video Network experience, private communication, May 1993.
• 14: "Video codec for audiovisual services at p x 64 kbit/s," CCITT Recommendation H. 261, CDM XV-R37-E Recommendations of the H series, International Telegraph and Telephone Consultative Committee (CCITT), August 1990.
• 15: Ellen A. Isaacs , John C. Tang, What video can and can't do for collaboration: a case study, Proceedings of the first ACM international conference on Multimedia, p.199-206, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166289]
• 16: Jacobson. Van, "Visual Audio Tool", an audio teleconferencing tool, 1992.
• 17: Jolley, Steve, "Echo Control in Today's Digital Networks," COHERENTq'M, Feature Article, Coherent Communications Systems Corp., 1992
• 18: Kandlur, Dilip, "Workstation Technology," presented at the MCNC Second Packet Video Workshop, Research Triangle Park, North Carolina, December 9-10, 1992.
• 19: Karlsson, Gunnar and Martin Vetterli, "Packet Video and its Integration into the Network Architecture,'' IEEE J. Selected Areas in Comm., Vol. 7, No. 5, June 1989, pp. 739-751.
• 20: Didier Le Gall, MPEG: a video compression standard for multimedia applications, Communications of the ACM, v.34 n.4, p.46-58, April 1991 [doi>10.1145/103085.103090]
• 21: Mankin, Allison, et al., "Videoconferencing Experience on the Internet," unpublished draft, 1993.
• 22: Michael R. Macedonia , Donald P. Brutzman, MBone Provides Audio and Video Across the Internet, Computer, v.27 n.4, p.30-36, April 1994 [doi>10.1109/2.274996]
• 23: Montgomery, W., "Techniques for Packet Voice Synchronization," IEEE J. on Selected Areas in Communications, Sol. SAC-6, No. 1, December 1983, pp. 1022-1028.
• 24: Ramjee, Ramachandran, et al., "Adaptive Playout Mechanisms for Packetized Audio Applications in Wide-Area Networks," Proceedings of IEEE IN- FOCOM '9~, Vol. 2, June 12-16 1994, Toronto, Canada, pp. 680-688.
• 25: P. Venkat Rangan , Harrick M. Vin , Srinivas Ramanathan, Communication architectures and algorithms for media mixing in multimedia conferences, IEEE/ACM Transactions on Networking (TON), v.1 n.1, p.20-30, Feb. 1993 [doi>10.1109/90.222904]
• 26: Russell, James D., "Multimedia Networking Performance Requirements", in Asynchronous Transfer Mode Networks, edited by Y. Viniotis and R. O. Onvural, Plenum Press, New York 1993, pp. 187- 197.
• 27: Schooler, Eve, The Impact of Scaling on a Multimedia Connection Architecture, USC/ISI, 1992.
• 28: Schooler, Eve and Abel Weinrib, Charter for the Multiparty Multimedia Session Control Working Group, March 1993.
• 29: Schulzrinne, H., "Voice Communication Across the Internet: A Network Voice Terminal", obtained from gaia.umass, edu by tip, July 26, 1992.
• 30: Schulzrinne, H. and Stephen Casner, RTP: A Transport Protocol for Real-Time Applications, IgTr Internet Draft, October 20, 1993.
• 31: Zhang, L., et al., "RSVP: A New Resource ReSer- Vation Protocol," IEEE Network, September 1993, pp. 8-18.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.1 Network Architecture and Design
          Subjects: Packet-switching networks

  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Computer conferencing, teleconferencing, and videoconferencing
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Windowing systems

General Terms:
Algorithms, Design