Making sense of sensing systems: five questions for designers and researchers

ABSTRACT

This paper borrows ideas from social science to inform the design of novel "sensing" user-interfaces for computing technology. Specifically, we present five design challenges inspired by analysis of human-human communication that are mundanely addressed by traditional graphical user interface designs (GUIs). Although classic GUI conventions allow us to finesse these questions, recent research into innovative interaction techniques such as 'Ubiquitous Computing' and 'Tangible Interfaces' has begun to expose the interaction challenges and problems they pose. By making them explicit we open a discourse on how an approach similar to that used by social scientists in studying human-human interaction might inform the design of novel interaction mechanisms that can be used to handle human-computer communication accomplishments

REFERENCES

• 1: Gregory D. Abowd , Elizabeth D. Mynatt, Charting past, present, and future research in ubiquitous computing, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.29-58, March 2000 [doi>10.1145/344949.344988]
• 2: Apple Computer Inc., MacIntosh Human Interface Guidelines, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 3: Maribeth Back , Jonathan Cohen , Rich Gold , Steve Harrison , Scott Minneman, Listen reader: an electronically augmented paper-based book, Proceedings of the SIGCHI conference on Human factors in computing systems, p.23-29, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365031]
• 4: Barfield, L. The Real World: Powerful Functions. SIGCHI Bulletin, 29, 2, April, 1997.
• 5: Victoria Bellotti, Design for privacy in multimedia computing and communications environments, Technology and privacy: the new landscape, MIT Press, Cambridge, MA, 1997
• 6: Bellotti, V & Rodden T. The Perils of Physical Interaction. In Proceedings of W. Mackay (ed.) DARE 2000, Designing Augmented Reality Environments, (Elsinore, Denmark, April 2000) ACM Press.
• 7: Button, G. (ed.). Technology in Working Order. Routledge, London, UK (1993).
• 8: Button, G., & Casey, N. Generating topic: The use of topic initial elicitors. In J. Atkinson & J. Heritage (eds.) Structures of Social Action. Studies in Conversation Analysis. Cambridge University Press, (1984) 167--189.
• 9: Dey, A., Salber, D, & Abowd, G. A Conceptual Framework and a Toolkit for Supporting the Design of Context Aware Applications. HCI Journal, Special Issue on Context Aware Computing, (in press).
• 10: Edwards, W.K., Newman, M.W., Sedivy, J.Z. The Case for Recombinant Computing. Xerox PARC Technical Report CSL-01-1. April 2001.
• 11: William Gaver , Thomas Moran , Allan MacLean , Lennart Lövstrand , Paul Dourish , Kathleen Carter , William Buxton, Realizing a video environment: EuroPARC's RAVE system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-35, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142754]
• 12: Goffman, E. The Presentation of Self in Everyday Life. Anchor, Doubleday, New York, (1959).
• 13: Goffman, E. Behavior in Public Places. Free Press, Macmillan, Boston, (1963).
• 14: Goffman, E. Frame Analysis: An essay on the organization of experience. Northeastern University Press, New York, (1974).
• 15: Goffman, E. Forms of Talk. Oxford: Basil Blackwell, (1981).
• 16: John Hughes , Val King , Tom Rodden , Hans Andersen, The role of ethnography in interactive systems design, interactions, v.2 n.2, p.56-65, April 1995 [doi>10.1145/205350.205358]
• 17: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 18: Sue Long , Dietmar Aust , Gregory Abowd , Chris Atkeson, Cyberguide: prototyping context-aware mobile applications, Conference companion on Human factors in computing systems: common ground, p.293-294, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/257089.257328]
• 19: Lopes, C. & Aguiar, P. Aerial Acoustic Communications. Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (Mohonk Moutain Resort, New York. October 2001).
• 20: Newman, M., Sedivy, J., Edwards, W.K., Hong, J., Izadi, S., Marcelo, K., Neuwirth, C., & Smith, T. Designing for Radical Interoperability: User Experience Issues in Recombinant Computing. (Submitted for publication).
• 21: William M. Newman , Michael G. Lamming , Mik Lamming, Interactive System Design, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 22: Norman, D. A. The Design of Everyday Things. Doubleday: New York, New York, (1990).
• 23: Paradiso, Joseph. The Brain Opera Technology: New Instruments and Gestural Sensors for Musical Interaction and Performance. Journal of New Music Research, 28, 2, (1999), 130--149.
• 24: James Patten , Hiroshi Ishii , Jim Hines , Gian Pangaro, Sensetable: a wireless object tracking platform for tangible user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.253-260, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365112]
• 25: Sacks, H., Schegloff, E. & Jefferson G. A simplest systematics for the organisation of turn-taking for conversation", Language 50, (1974) 696--735.
• 26: Sacks, H., Schegloff, E. & Jefferson G. Lectures on conversation. Oxford: Basil Blackwell (1992).
• 27: Schegloff, E., Jefferson, G., & Sacks, H. The preference for self-correction in the organization of repair in conversation. Language, 53, (1977), 361--382.
• 28: Schmandt, C. Conversational Computing Systems. New York, Van Nostrand Reinhold, 1993.
• 29: Roy Want , Kenneth P. Fishkin , Anuj Gujar , Beverly L. Harrison, Bridging physical and virtual worlds with electronic tags, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.370-377, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303111]
• 30: Weiser, M. The Computer for the Twenty-First Century. Scientific American, 265, 3 (September 1991), 94--104.
• 31: Thomas G. Zimmerman , Joshua R. Smith , Joseph A. Paradiso , David Allport , Neil Gershenfeld, Applying electric field sensing to human-computer interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.280-287, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223940]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
design framework, human-machine communication, sensing input, social science, ubiquitous computing