Designing mediation for context-aware applications

ABSTRACT

Many context-aware services make the assumption that the context they use is completely accurate. However, in reality, both sensed and interpreted context is often ambiguous. A challenge facing the development of realistic and deployable context-aware services, therefore, is the ability to handle ambiguous context. Although some of this ambiguity may be resolved using automatic techniques, we argue that correct handling of ambiguous context will often need to involve the user. We use the term mediation to refer to the dialogue that ensues between the user and the system. In this article, we describe an architecture that supports the building of context-aware services that assume context is ambiguous and allows for mediation of ambiguity by mobile users in aware environments. We present design guidelines that arise from supporting mediation over space and time, issues not present in the graphical user interface domain where mediation has typically been used in the past. We illustrate the use of our architecture and evaluate it through an example context-aware application, a word predictor system.

REFERENCES

• 1: G. D. Abowd, Classroom 2000: an experiment with the instrumentation of a living educational environment, IBM Systems Journal, v.38 n.4, p.508-530, Dec. 1999
• 2: Gregory D. Abowd , Christopher G. Atkeson , Jason Hong , Sue Long , Rob Kooper , Mike Pinkerton, Cyberguide: a mobile context-aware tour guide, Wireless Networks, v.3 n.5, p.421-433, Oct. 1997 [doi>10.1023/A:1019194325861]
• 3: Victoria Bellotti , Maribeth Back , W. Keith Edwards , Rebecca E. Grinter , Austin Henderson , Cristina Lopes, Making sense of sensing systems: five questions for designers and researchers, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503450]
• 4: Bobick, A. F., Intille, S. S., Davis, J. W., Baird F., Pinhanez, C. S., Campbell, L. W., Ivanov, Y. A., Schutte, A., and Wilson, A. 1999. The KidsRoom: A perceptually-based interactive and immersive story environment. Presence 8, 4, 367--391.
• 5: Brown, M. 1996a. Supporting user mobility. In Proceedings of IFIP World Conference on Mobile Communications, 69--77.
• 6: Brown, P. J. 1996b. The stick-e document: A framework for creating context-aware applications. In Proceedings of Electronic Publishing '96, 259--272.
• 7: Brown, P. J., Bovey, J. D., and Chen, X. 1997. Context-aware applications: From the laboratory to the marketplace. IEEE Pers. Comm. 4, 5, 58--64.
• 8: Keith Cheverst , Nigel Davies , Keith Mitchell , Adrian Friday , Christos Efstratiou, Developing a context-aware electronic tourist guide: some issues and experiences, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-24, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332047]
• 9: Clark, H. and Brennan, S. E. 1991. Grounding in communication. Perspectives on Socially Shared Cognition. Resnick, L., Levine, J., and Teasley, S. Eds. American Psychological Society. 127--149.
• 10: Philip R. Cohen , Michael Johnston , David McGee , Sharon Oviatt , Jay Pittman , Ira Smith , Liang Chen , Josh Clow, QuickSet: multimodal interaction for distributed applications, Proceedings of the fifth ACM international conference on Multimedia, p.31-40, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266328]
• 11: Jeremy R. Cooperstock , Sidney S. Fels , William Buxton , Kenneth C. Smith, Reactive environments, Communications of the ACM, v.40 n.9, p.65-73, Sept. 1997 [doi>10.1145/260750.260774]
• 12: N. Davies , S. P. Wade , A. Friday , G. S. Blair, Limbo: a tuple space based platform for adaptive mobile applications, Proceedings of the IFIP/IEEE international conference on Open distributed processing and distributed platforms, p.291-302, May 1997, Toronto, Ontario, Canada
• 13: Anind Dey , Jennifer Mankoff , Gregory Abowd , Scott Carter, Distributed mediation of ambiguous context in aware environments, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572003]
• 14: Dey, A. K., Salber, D., and Abowd, G. D. 2001. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum.-Comput. Interac. J. 16, 24, 97--166.
• 15: Dey, A. K. and Abowd, G. D. 2000. Towards a better understanding of context and context-awareness. In Computer Human Intraction 2000 Workshop on the What, Who, Where, When, Why and How of Context-Awareness.
• 16: Dey, A. K., Abowd, G. D., and Wood, A. 1999. CyberDesk: A framework for providing self-integrating context-aware services. Knowledge-Based Syst. 11, 3--13.
• 17: Scott Elrod , Gene Hall , Rick Costanza , Michael Dixon , Jim Des Rivières, Responsive office environments, Communications of the ACM, v.36 n.7, p.84-85, July 1993 [doi>10.1145/159544.159626]
• 18: George Ferguson , James F. Allen, TRIPs: an integrated intelligent problem-solving assistant, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.567-572, July 1998, Madison, Wisconsin, United States
• 19: Andy Harter , Andy Hopper , Pete Steggles , Andy Ward , Paul Webster, The anatomy of a context-aware application, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.59-68, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313476]
• 20: Jeffrey Heer , Nathaniel S. Good , Ana Ramirez , Marc Davis , Jennifer Mankoff, Presiding over accidents: system direction of human action, Proceedings of the SIGCHI conference on Human factors in computing systems, p.463-470, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985751]
• 21: Eric Horvitz , Carl Kadie , Tim Paek , David Hovel, Models of attention in computing and communication: from principles to applications, Communications of the ACM, v.46 n.3, March 2003 [doi>10.1145/636772.636798]
• 22: Eric Horvitz, Principles of mixed-initiative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.159-166, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303030]
• 23: Richard Hull , Philip Neaves , James Bedford-Roberts, Towards Situated Computing, Proceedings of the 1st IEEE International Symposium on Wearable Computers, p.146, October 13-14, 1997
• 24: Gerd Kortuem , Zary Segall , Martin Bauer, Context-Aware, Adaptive Wearable Computers as Remote Interfaces to 'Intelligent' Environments, Proceedings of the 2nd IEEE International Symposium on Wearable Computers, p.58, October 19-20, 1998
• 25: Lesher, G. W., Moulton, B. J., and Higginbotham, J. 1998. Techniques for augmenting scanning communication. Augment. Altern. Comm. 14, 81--101.
• 26: Tim Paek , Eric Horvitz, Conversation as Action Under Uncertainty, Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence, p.455-464, June 30-July 03, 2000
• 27: Mankoff, J., Abowd, G. D., and Hudson, S. E. 2000. OOPS: A Toolkit Supporting Mediation Techniques for Resolving Ambiguity in Recognition-Based Interfaces. Comput. Graph. 24, 6, 819--834.
• 28: McKinlay, A., Beattie, W., Arnott, J. L., and Hine, N. A. 1995. Augmentative and alternative communication: The role of broadband telecommunications. IEEE Trans. Rehabil. Eng. 3, 3, 254--260.
• 29: Moran, T. P. and DOurish, P. 2001. Eds. Special Issue on Context-Aware Computing. Hum.-Comput. Interact. J. 16, 2--4, 87--420.
• 30: Brad A. Myers , David S. Kosbie, Reusable hierarchical command objects, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.260-267, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238526]
• 31: Pascoe, J., Ryan, N. S., and Morse, D. R. 1998. Human-Computer-Giraffe Interaction -- HCI in the Field. In Proceedings of the Workshop on Human Computer Interaction with Mobile Devices.
• 32: J. Rekimoto , Y. Ayatsuka , K. Hayashi, Augment-able Reality: Situated Communication through Physical and Digital Spaces, Proceedings of the 2nd IEEE International Symposium on Wearable Computers, p.68, October 19-20, 1998
• 33: Rhodes, B. 1997. The Wearable Remembrance Agent: A system for augmented memory. Pers. Technol. 1, 1, 218--224.
• 34: Eric Saund , Edward Lank, Stylus input and editing without prior selection of mode, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.213-216, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964720]
• 35: William Noah Schilit, A system architecture for context-aware mobile computing, Columbia University, New York, NY, 1995
• 36: Roy Want , Andy Hopper , Veronica Falcão , Jonathan Gibbons, The active badge location system, ACM Transactions on Information Systems (TOIS), v.10 n.1, p.91-102, Jan. 1992 [doi>10.1145/128756.128759]
• 37: Weiser, M. 1991. The computer for the 21st century. Scient. Amer. 265, 3, 66--75.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
            Subjects: Domain-specific architectures

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Keywords:
Context-aware computing, ambiguity, aware environments, error handling, mediation, ubiquitous computing