The physical user interface profile (PUIP): modelling mobile interactions with the real world

ABSTRACT

So far the field of model based user interface development has focused mostly on the usage of one device, such as a Personal Computer, by one person. New interaction techniques emerge in which the user interacts with the surrounding world while using the mobile phone as a mediator for physical interactions and as communication tool to interact with services and other users. Here several devices or physical elements are used for input and output, and more than one user might be involved. These new settings require description models to support the analysis, design and implementation of systems that take such interaction techniques into account. We present the new UML 2.0 Physical User Interface Profile (PUIP) that is based on the UML 2.0 Profile for Context-Sensitive User Interface (CUP, [24]) to support the modelling of this kind of interactions. We show the feasibility of our approach through the modelling of an existing physical mobile interaction and discuss its suitability.

REFERENCES

• 1: Anderson, J.: Developing a UI Design from a UML Color Model, white paper. http://www.uidesign.net/1999/papers/UML_UI.html
• 2: Da Silva, P. P.: Paton, N. W. 2000. UMLi: The Unified Modeling Language for Interactive Applications. In Evans, A., Kent, S., Selic, B., eds.: UML 2000 - The Unified Modeling Language. Advancing the Standard. Third International Conference, York, UK, October 2000, Proceedings. Volume 1939. 117--132.
• 3: Emmanuel Dubois , Philip D. Gray , Laurence Nigay, ASUR++: A Design Notation for Mobile Mixed Systems, Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction, p.123-139, September 18-20, 2002
• 4: Dubois, E.; Gray, P. D.; Nigay, L. 2003, ASUR++: Supporting the design of mobile mixed systems. In: Interacting with Computers 15(4): 497--520 (2003).
• 5: Ferscha, A.; Kathan, G.; Vogl, S. 2002. WebWall - An Architecture for Public Display WWW Services. In: Proceedings of Eleventh International World Wide Web Conference (2002).
• 6: Fluidum Project, http://www.fluidum.org.
• 7: Hans W. Gellersen , Albercht Schmidt , Michael Beigl, Multi-sensor context-awareness in mobile devices and smart artifacts, Mobile Networks and Applications, v.7 n.5, p.341-351, October 2002 [doi>10.1023/A:1016587515822]
• 8: Greenberg, S., Boyle, M., Laberge, J. 1999. PDAs and Shared Public Displays. In: Making Personal Information Public, and Public Information Personal. Personal and Ubiquitous Computing 3 (1999).
• 9: Hansen, Y. 200. Visualization for Thinking, Planning, and Problem Solving. In Information Design, Ed. Robert Jacobson, 2000.
• 10: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 11: Tim Kindberg , John Barton , Jeff Morgan , Gene Becker , Debbie Caswell , Philippe Debaty , Gita Gopal , Marcos Frid , Venky Krishnan , Howard Morris , John Schettino , Bill Serra , Mirjana Spasojevic, People, places, things: web presence for the real world, Mobile Networks and Applications, v.7 n.5, p.365-376, October 2002 [doi>10.1023/A:1016591616731]
• 12: Brad A. Myers, Mobile Devices for Control, Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction, p.1-8, September 18-20, 2002
• 13: Nunes, N. J.; E Cunha, J. F. 2000. Towards a UML profile for interaction design: the Wisdom approach. In Evans, A., Kent, S., Selic, B. A., eds.: UML 2000 - The Unified Modeling Language. Advancing the Standard. Third International Conference, York, UK, October 2000, Proceedings. Volume 1939. 101--116.
• 14: Object Management Group: UML 2.0 Superstructure Specification.
• 15: Fabio Paternò , Cristiano Mancini , Silvia Meniconi, ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models, Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.362-369, July 14-18, 1997
• 16: Paternò, F. 2004. Multimodality and Multi-device interfaces. In: W3C Workshop on Multimodal Interaction. Sophia Antipolis, France. 2004.
• 17: Pleuß, A. 2005. Modeling the User Interface of Multimedia Applications. In L. Briand, C. Williams: Proceedings of dMoDELS/UML 2005. Springer, 2005
• 18: Rohs, M.; Gfeller, B. 2004. Using Camera-Equipped Mobile Phones for Interacting with Real-World Objects. In: Alois Ferscha, Horst Hoertner, Gabriele Kotsis (Eds.): Advances in Pervasive Computing, Austrian Computer Society (OCG), ISBN 3-85403-176-9, pp. 265--271, Vienna, Austria, April 2004.
• 19: Enrico Rukzio , Albrecht Schmidt , Heinrich Hussmann, Physical Posters as Gateways to Context-Aware Services for Mobile Devices, Proceedings of the Sixth IEEE Workshop on Mobile Computing Systems and Applications (WMCSA'04), p.10-19, December 02-03, 2004 [doi>10.1109/MCSA.2004.20]
• 20: Simplicity Project, http://www.ist-simplicity.org.
• 21: Smith, M.; Davenport, D.; Hwa, H. and Mui, L. 2003., The annotated planet: A mobile platform for object and location annotation. In 1st Int. Workshop on Ubiquitous Systems for Supporting Social Interaction and Face-to-Face Communication in Public Spaces at UbiComp 2003, October 2003.
• 22: Szekely, P. 1996. Retrospective and Challenges for Model-Based Interface Development. In Vanderdonckt, J., ed.: Computer-Aided Design of User Interfaces. Presses Universitaires de Namur, Namur, Belgium (1996).
• 23: Trætteberg, H. 2002. Model-based User Interface Design. PhD thesis, Norwegian University of Science and Technology, Oslo (2002).
• 24: Jan Van den Bergh , Karin Coninx, Towards modeling context-sensitive interactive applications: the context-sensitive user interface profile (CUP), Proceedings of the 2005 ACM symposium on Software visualization, May 14-15, 2005, St. Louis, Missouri [doi>10.1145/1056018.1056030]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Keywords:
UML 2.0 profile, interface, modelling, physical mobile interaction, physical user interface profile