Scalable multimedia delivery for pervasive computing

ABSTRACT

Growing numbers of pervasive devices are gaining access to the Internet and other information sources. However, much of the rich multimedia content cannot be easily handled by the client devices with limited communication, processing, storage and display capabilities. In order to improve access, we are developing a system for scalable delivery of multimedia. The system uses an InfoPyramid for managing and manipulating multimedia content composed of video, images, audio and text. The InfoPyramid manages the different variations of media objects with different fidelities and modalities and generates and selects among the alternatives in order to adapt the delivery to different client devices. We describe a system for scalable multimedia delivery for a variety of client devices, including PDAs, HHCs, smart phones, TV browsers and color PCs.

REFERENCES

• 1: Timothy W. Bickmore , Bill N. Schilit, Digestor: device-independent access to the World Wide Web, Selected papers from the sixth international conference on World Wide Web, p.1075-1082, September 1997, Santa Clara, California, United States
• 2: Gregg C. Vanderheiden, Anywhere, anytime(+ anyone) access to the next-generation WWW, Selected papers from the sixth international conference on World Wide Web, p.1439-1446, September 1997, Santa Clara, California, United States
• 3: Harini Bharadvaj , Anupam Joshi , Sansanee Auephanwiriyakul, An Active Transcoding Proxy to Support Mobile Web Access, Proceedings of the The 17th IEEE Symposium on Reliable Distributed Systems, p.118, October 20-23, 1998
• 4: A. Fox, S. D. Gribble, Y. Chawathe, and E. A. Brewer. Adapting to network and client variation using active proxies: Lessions and perspectives, iEEE Personal Comrnun., 40, 1998.
• 5: Armando Fox , Steven D. Gribble , Eric A. Brewer , Elan Amir, Adapting to network and client variability via on-demand dynamic distillation, Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, p.160-170, October 01-04, 1996, Cambridge, Massachusetts, United States
• 6: A. Ortega, F. Carignano, S. Ayer, and M. Vetterli. Soft caching: Web cache management techniques for images. In Workshop on Multimedia Signal Processing, pages 475- 480, Princeton, NJ, June 1997. IEEE.
• 7: J. R. Smith, R. Mohan, and C.-S. Li. Content-based transcoding of images in the Internet. In {EEE Proc. Int. Conf. Image Processing (ICIP), Chicago, I1, October 1998.
• 8: J. R. Smith, R. Mohan, and C.-S. Li. Transcoding Internet content for heterogenous client devices. In Proc. IEEE Inter. Syrup. on Circuits and Syst. ({SEAS), June 1998. Special session on Next Generation Internet.
• 9: Intel Quick Web. http://www.intel.com/quickweb.
• 10: Spyglass-Prism. http://www.spyglass/products/prism.
• 11: Unwired Planet. Handheld device markup language specification. Technical Report Version 2.0, Unwired Planet, Inc., April 1997.
• 12: L. Bouthillier. Synchronized multimedia on the Web. Web Techniques Magazine, 3(9), September 1998.
• 13: O. Avaro, P. Chou, A. Eleftheriadis, C. Herpel, and C. Reader. The MPEG-4 systems and description languages- A way ahead in audio visual information representation. Signal Processing: Image Communication, Special Issue on MPEG-4, 4(9):385-431, May 1997.
• 14: K. Selçuk Candan , B. Prabhakaran , V. S. Subrahmanian, CHIMP: a framework for supporting distributed multimedia document authoring and presentation, Proceedings of the fourth ACM international conference on Multimedia, p.329-340, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244234]
• 15: Andreas Vogel , Brigitte Kerhervé , Gregor von Bochmann , Jan Gecsei, Distributed Multimedia and QOS: A Survey, IEEE MultiMedia, v.2 n.2, p.10-19, June 1995 [doi>10.1109/93.388195]
• 16: R. Mohan, J. R. Smith, and C.-S. Li. Adapting multimedia internet content for universal access, iEEE Trans. Multimedia, 1(1):104 - 114, March 1999.
• 17: L. Weitzman , Kent Wittenburg, Automatic presentation of multimedia documents using relational grammars, Proceedings of the second ACM international conference on Multimedia, p.443-451, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192718]
• 18: J. R. Smith. Digital video libraries and the Internet. IEEE Communications Mag., 37(1):92 - 99, January 1999. Special issue on the Next Generation }nternet.
• 19: R. Kling and M. Elliott. Digital library design for usability. In Proc. Conf. Theory and Practice of Digital Libraries, College Station, TX, June 1994.
• 20: J. R. Smith, C.-S. Li, and R. Mohan. Infopyramid description scheme for multimedia content. In MPEG-7 proposal, number MPEG99/P473 in ISO/IEC JTC1/SC29/WG11, Lancaster, UK, February 1999.
• 21: C. Christopoulos, T. Ebrahimi, V.V. Vinod, J. R. Smith, R. Mohan, and C.-S. Li. Universal access and media conversion. In MPEG-7 applications proposal, number MPEG99/M4433 in ISO/iEC JTC1/SC29/WG11, Seoul, Korea, March 1999.
• 22: J. R. Smith, C.-S. Li, R. Mohan, A. Puri, C. Christopoulos, A. B. Benitez, P. Bocheck, S.-F. Chang, T. Ebrahimi, and V. V. Vinod. MPEG-7 content description scheme for universal multimedia access. In MPEG. 7 proposal, number MPEG99/M4949 in ISO/IEC JTC1/SC29/WGll, Vancouver, BC, July 1999.
• 23: C.-S. Li, R. Mohan, and J. R. Smith. Multimedia content description in the InfoPyramid. In IEEE Proc. Int. Conf. Acoust., Speech, Signal Processing ({CASSP), Seattle, WA, May 1998. Special session on Signal Processing in Modem Multimedia Standards.
• 24: Y. Shoham and A. Gersho. Efficient bit allocation for an arbitrary set of quantizers. IEEE Trans. Acoust., Speech, Signal Processing, 36(9), September 1988.
• 25: S. Paek and J. Ft. Smith. Detecting image purpose in World-Wide Web documents. In ISSIT/SPIE Symposium on Electronic Imaging: Science and Technology- Document Recognition, San Jose, CA, January 1998.
• 26: N. C. Rowe and B. Frew. Finding photograph captions multimodally on the World Wide Web. Technical Report Code CS/Rp, Dept. of Computer Science, Naval Postgraduate School, 1997.
• 27: John R. Smith , Shih-Fu Chang, Visually Searching the Web for Content, IEEE MultiMedia, v.4 n.3, p.12-20, July 1997 [doi>10.1109/93.621578]
• 28: F. Reynolds, J. Hjelm, S. Dawkins, and S. Singhal. A user side framework for content negotiation: Composite capability/preference profiles (CC/PP). Technical Report http://www.w3.org/TR/NOTE-CCPP, W3C, November 1998.
• 29: M. Hori, R. Mohan, H. Maruyama, and S. Singhal. Annotation of web content for transcoding. Technical Report NOTE-annot-19990524, W3C, July 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Design, Management, Theory