How to reuse exisiting interactive applications in ubiquitous computing environments?

ABSTRACT

In ubiquitous computing environments, we will access various devices and appliances from a variety of mobile devices such as mobile phones, PDAs and wearable devices.However, we need to reuse existing interactive applications that adopt traditional GUI toolkits that assume to use mouses and keyboards, and these applications should be operated from the mobile interaction devices.Our approach enables us to use existing GUI-based interactive applications although a variety of interaction devices can be adopted to control the applications. Therefore, the approach allows us to use traditional GUI toolkits to build ubiquitous computing applications that choose appropriate interaction devices dynamically. The paper describes the design and implementation of our middleware to realize the approach. We also present some examples to show the effectiveness of our approach.

REFERENCES

• 1: J. Bacon, J Bates, and D. Halls, "Location-Oriented Multimedia", IEEE Personal Communications, Vol.4, No.5, 1997.
• 2: A. K. Dey, D. Salber, and G. D. Abowd, "A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications", Human-Computer Interactions, 16, 2001.
• 3: T. Hodes, and R. H. Katz, "A Document-based Framework for Internet Application Control", In Proceedings of the Second USENIX Symposium on Internet Technologies and Systems, 1999.
• 4: Andy Harter , Andy Hopper , Pete Steggles , Andy Ward , Paul Webster, The anatomy of a context-aware application, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.59-68, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313476]
• 5: D. L. de Ipina, "Building Components for a Distributed Sentient Framework with Python and CORBA", In Proceedings of the 8th International Python Conference, 2000.
• 6: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 7: Kari Kangas , Juha Röning, Using code mobility to create ubiquitous and active augmented reality in mobile computing, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.48-58, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313467]
• 8: Naohiko Kohtake , Jun Rekimoto , Yuichiro Anzai, InfoStick: An Interaction Device for Inter-Appliance Computing, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, p.246-258, September 27-29, 1999, Karlsruhe, Germany
• 9: Brad A. Myers , Herb Stiel , Robert Gargiulo, Collaboration using multiple PDAs connected to a PC, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.285-294, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289503]
• 10: Tatsuo Nakajima, A framework for building adaptive continuous media applications using service proxies, Handbook of Internet and multimedia: systems and applications, CRC Press, Inc., Boca Raton, FL, 1999
• 11: Shankar Ponnekanti , Brian Lee , Armando Fox , Pat Hanrahan , Terry Winograd, ICrafter: A Service Framework for Ubiquitous Computing Environments, Proceedings of the 3rd international conference on Ubiquitous Computing, p.56-75, September 30-October 02, 2001, Atlanta, Georgia, USA
• 12: Tristan Richardson , Quentin Stafford-Fraser , Kenneth R. Wood , Andy Hopper, Virtual Network Computing, IEEE Internet Computing, v.2 n.1, p.33-38, January 1998 [doi>10.1109/4236.656066]
• 13: B. N. Schilit, N. Adames, and R. Want, "Context-Aware Computing Applications", In Proceedings of the Workshop on Mobile Computing Systems and Applications, IEEE, 1994.
• 14: Itiro Siio , Toshiyuki Masui , Kentaro Fukuchi, Real-world interaction using the FieldMouse, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.113-119, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322592]
• 15: K. Soejima, et. al., "Building Audio and Visual Home Applications on Commodity Software", IEEE Transactions on Consumer Electronics, Vol.47, No.3, 2001.
• 16: Peter Tandler, The BEACH application model and software framework for synchronous collaboration in ubiquitous computing environments, Journal of Systems and Software, v.69 n.3, p.267-296, 15 January 2004 [doi>10.1016/S0164-1212(03)00055-4]
• 17: D. Therenin and J. Coutaz, "Plasticity of User Interface: Framework and Research Agenda", Interact'99, 1999.
• 18: User Interface Markup Language, http://www.uiml.org/

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.10 Design**

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.13 Reusable Software

Keywords:
interaction, middleware, ubiquitous computing