MobiUS: enable together-viewing video experience across two mobile devices

ABSTRACT

We envision a new better-together mobile application paradigm where multiple mobile devices are placed in a close proximity and study a specific together-viewing video application in which a higher resolution video isplayed back across screens of two mobile devices placed side by side. This new scenario imposes real-time, synchronous decoding and rendering requirements which are difficult to achieve because of the intrinsic complexity of video andthe resource constraints such as processing power and battery life of mobile devices. We develop a novel efficient collaborative half-frame decoding schemeand design a tightly coupled collaborative system architecture that aggregates resources of both devices to achieve the task. We have implemented the system and conducted experimental evaluation. Results confirm that our proposed collaborative and resource aggregation techniques can achieve our vision of better-together mobile experiences.

REFERENCES

• 1: {Online}. Available: http://www.networkmultimedia.org/
• 2: Generic Coding of Moving Pictures and Associated Audio Information - Part 2: Video. ITU-T and ISO/IEC JTC 1, ITU-T Recommendation H.262 and ISO/IEC 13818-2 (MPEG-2), 1994.
• 3: T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the h.264/avc video coding standard," IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp. 560--576, July 2003.
• 4: B. Zeng, R. Li, and M. L. Liou, "Optimization of fast block motion estimation algorithms," IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, pp. 833--844, Dec. 1997.
• 5: Trevor Pering , Yuvraj Agarwal , Rajesh Gupta , Roy Want, CoolSpots: reducing the power consumption of wireless mobile devices with multiple radio interfaces, Proceedings of the 4th international conference on Mobile systems, applications and services, June 19-22, 2006, Uppsala, Sweden [doi>10.1145/1134680.1134704]
• 6: {Online}. Available: http://www.upnp.org/
• 7: {Online}. Available: http://www.apple.com/macosx/features/bonjour/
• 8: F. Wu, G. Shen, K. Tan, F. Yang, and S. Li, "Next generation mobile multimedia communications: Media codec and media transport perspectives," China Communications, vol. 3, pp. 30--44, Oct. 2006.
• 9: J. Hightower, R. Want, and G. Borriello, "SpotON: An indoor 3D location sensing technology based on RF signal strength," University of Washington, UW CSE 00-02-02, 2000.
• 10: Nissanka B. Priyantha , Anit Chakraborty , Hari Balakrishnan, The Cricket location-support system, Proceedings of the 6th annual international conference on Mobile computing and networking, p.32-43, August 06-11, 2000, Boston, Massachusetts, United States [doi>10.1145/345910.345917]
• 11: Gaetano Borriello , Alan Liu , Tony Offer , Christopher Palistrant , Richard Sharp, WALRUS: wireless acoustic location with room-level resolution using ultrasound, Proceedings of the 3rd international conference on Mobile systems, applications, and services, June 06-08, 2005, Seattle, Washington [doi>10.1145/1067170.1067191]
• 12: {Online}. Available: http://www.eecis.udel.edu/ mills/ntp.html
• 13: Jeremy Elson , Lewis Girod , Deborah Estrin, Fine-grained network time synchronization using reference broadcasts, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060304]
• 14: G. Shen, Y. He, W. Cao, and S. Li, "Mpeg-2 to wmv transcoder with adaptive error compensation and dynamic switches," IEEE Trans. on Circuits and Systems for Video Technology, vol. 16, pp. 1460--1476, 2006.
• 15: Sudeep Pasricha , Manev Luthra , Shivajit Mohapatra , Nikil Dutt , Nalini Venkatasubramanian, Dynamic Backlight Adaptation for Low-Power Handheld Devices, IEEE Design & Test, v.21 n.5, p.398-405, September 2004 [doi>10.1109/MDT.2004.57]
• 16: Padmanabhan Pillai , Kang G. Shin, Real-time dynamic voltage scaling for low-power embedded operating systems, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 17: Wanghong Yuan , Klara Nahrstedt, Practical voltage scaling for mobile multimedia devices, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027737]
• 18: {Online}. Available: http://www.pcmag.com/article2/0,1895,2080442,00.asp
• 19: Mauro Caporuscio , Paola Inverardi, Yet Another Framework for Supporting Mobile and Collaborative Work, Proceedings of the Twelfth International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, p.81, June 09-11, 2003
• 20: M. Caporuscio, A. Carzaniga, and A. L. Wolf, "Design and evaluation of a support service for mobile, wireless publish/subscribe applications." IEEE Trans. Software Eng., vol. 29, no. 12, pp. 1059--1071, 2003.
• 21: Dominik Buszko , Wei-Hsing (Dan) Lee , Abdelsalam (Sumi) Helal, Decentralized ad-hoc groupware API and framework for mobile collaboration, Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work, September 30-October 03, 2001, Boulder, Colorado, USA [doi>10.1145/500286.500291]
• 22: Engin Kirda , Pascal Fenkam , Gerald Reif , Harald Gall, A service architecture for mobile teamwork, Proceedings of the 14th international conference on Software engineering and knowledge engineering, July 15-19, 2002, Ischia, Italy [doi>10.1145/568760.568850]
• 23: Vagner Sacramento , Markus Endler , Hana K. Rubinsztejn , Luciana S. Lima , Kleder Goncalves , Fernando N. Nascimento , Giulliano A. Bueno, MoCA: A Middleware for Developing Collaborative Applications for Mobile Users, IEEE Distributed Systems Online, v.5 n.10, p.2, October 2004 [doi>10.1109/MDSO.2004.26]
• 24: Eyal de Lara , Rajnish Kumar , Dan S. Wallach , Willy Zwaenepoel, Collaboration and multimedia authoring on mobile devices, Proceedings of the 1st international conference on Mobile systems, applications and services, p.287-301, May 05-08, 2003, San Francisco, California [doi>10.1145/1066116.1066126]
• 25: Neil J. McCurdy , William G. Griswold, A systems architecture for ubiquitous video, Proceedings of the 3rd international conference on Mobile systems, applications, and services, June 06-08, 2005, Seattle, Washington [doi>10.1145/1067170.1067172]
• 26: Puneet Sharma , Sung-Ju Lee , Jack Brassil , Kang G. Shin, Handheld Routers: Intelligent Bandwidth Aggregation for Mobile Collaborative Communities, Proceedings of the First International Conference on Broadband Networks (BROADNETS'04), p.537-547, October 25-29, 2004 [doi>10.1109/BROADNETS.2004.43]
• 27: J. Karlsson, H. Li, and J. Eriksson, "P2p video multicast for wireless mobile clients," in The Fourth Intl. Conf. on MobiSys (poster), Uppsala, Sweden, June 2006.
• 28: J. Wang and J. C. L. Liu, "Parallel mpeg-2 decoding with high speed network: Part ii," in Proc. of the IEEE Intl. Conf. on Multimedia and Expo (ICME), 2001., Aug. 2001, pp. 333--336.
• 29: Angelos Bilas , Jason Fritts , Jaswinder Pal Singh, Real-Time Parallel MPEG-2 Decoding in Software, Proceedings of the 11th International Symposium on Parallel Processing, p.197-203, April 01-05, 1997
• 30: Ricardo A. Baratto , Leonard N. Kim , Jason Nieh, THINC: a virtual display architecture for thin-client computing, Proceedings of the twentieth ACM symposium on Operating systems principles, October 23-26, 2005, Brighton, United Kingdom

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS
      Subjects: Real-time and embedded systems

Additional Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.3 Microcomputers
          Subjects: Portable devices (e.g., laptops, personal digital assistants)

  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers

General Terms:
Algorithms, Design, Performance

Keywords:
better-together, collaborative decoding, energy efficiency, mobile computing, proximity detection, resource aggregation, screen aggregation, together-viewing