TeleNotes: managing lightweight interactions in the desktop

ABSTRACT

Communication theories and technology have tended to focus on extended, formal meetings and have neglected a prevalent and vital form of workplace communication—namely, lightweight communication. Unlike formal, extended meetings, lightweight interaction is brief, informal, unplanned, and intermittent. We analyze naturalistic data from a study of work-place communication and derive five design criteria for lightweight interaction systems. These criteria require that systems for lightweight interaction support conversational tracking, rapid connection, the ability to leave a message, context management, and shared real-time objects. Using these criteria, we evaluate existing interpersonal communications technologies. We then describe an implementation of a system (TeleNotes) that is designed to support lightweight interaction by meeting these criteria. The interface metaphor allows communications to be based around desktop objects, resembling “sticky notes.” These objects are also organized into “desktop piles” to support conversational threads and provide mechanisms for initiating real-time audio, video, and application sharing. We conducted informal user testing of several system prototypes. Based on our findings, outstanding issues concerning theory and systems design for communication systems are outlined—in particular, with regard to the issue of managing conversations over time.

REFERENCES

• 1: Kenneth R. Abbott , Sunil K. Sarin, Experiences with workflow management: issues for the next generation, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.113-120, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192886]
• 2: Deborah Barreau , Bonnie A. Nardi, Finding and reminding: file organization from the desktop, ACM SIGCHI Bulletin, v.27 n.3, p.39-43, July 1995 [doi>10.1145/221296.221307]
• 3: R. Bentley , J. A. Hughes , D. Randall , T. Rodden , P. Sawyer , D. Shapiro , I. Sommerville, Ethnographically-informed systems design for air traffic control, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.123-129, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143470]
• 4: Sara A. Bly , Steve R. Harrison , Susan Irwin, Media spaces: bringing people together in a video, audio, and computing environment, Communications of the ACM, v.36 n.1, p.28-46, Jan. 1993 [doi>10.1145/151233.151235]
• 5: John Bowers, The work to make a network work: studying CSCW in action, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.287-298, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193030]
• 6: Tom Brinck , Louis M. Gomez, A collaborative medium for the support of conversational props, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.171-178, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143476]
• 7: CLARK, H. AND BRENNAN, S. 1991. Grounding in communication. In Perspectives on Socially Shared Cognition, L. B. Resnick, J. Levine, and S. Teasley, Eds. APA Press, Washington, D.C.
• 8: CLARK, H. AND SCHAEFER, E. 1989. Contributing to discourse. Cog. Sci. 13, 3, 259-292.
• 9: Paul Dourish , Sara Bly, Portholes: supporting awareness in a distributed work group, Proceedings of the SIGCHI conference on Human factors in computing systems, p.541-547, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142982]
• 10: Carmen Egido, Video conferencing as a technology to support group work: a review of its failures, Proceedings of the 1988 ACM conference on Computer-supported cooperative work, p.13-24, September 26-28, 1988, Portland, Oregon, United States [doi>10.1145/62266.62268]
• 11: EGIDO, C. 1990. Teleconferencing as a technology to support co-operative work: A review of its failures. In Intellectual Teamwork, J. Galegher, R. Kraut, and C. Egido, Eds. Lawrence Erlbaum, Hillsdale, N.J.
• 12: Tom Finholt , Lee Sproull , Sara Kiesler, Communication and performance in ad hoc task groups, Intellectual teamwork: social and technological foundations of cooperative work, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1990
• 13: Robert S. Fish , Robert E. Kraut , Robert W. Root , Ronald E. Rice, Evaluating video as a technology for informal communication, Proceedings of the SIGCHI conference on Human factors in computing systems, p.37-48, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142755]
• 14: Robert S. Fish , Robert E. Kraut , Robert W. Root , Ronald E. Rice, Video as a technology for informal communication, Communications of the ACM, v.36 n.1, p.48-61, Jan. 1993 [doi>10.1145/151233.151237]
• 15: FROHLICH, D. 1995. Requirements for interpersonal information management. In Mobile Personal Communications and Co-operative Working, P. J. Thomas, Ed. Alfred Waller and Unicom Seminars.
• 16: William Gaver , Thomas Moran , Allan MacLean , Lennart Lövstrand , Paul Dourish , Kathleen Carter , William Buxton, Realizing a video environment: EuroPARC's RAVE system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-35, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142754]
• 17: William W. Gaver , Abigail Sellen , Christian Heath , Paul Luff, One is not enough: multiple views in a media space, Proceedings of the SIGCHI conference on Human factors in computing systems, p.335-341, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169268]
• 18: Barbara J. Grosz , Candace L. Sidner, Attention, intentions, and the structure of discourse, Computational Linguistics, v.12 n.3, p.175-204, July-September 1986
• 19: Beverly Harrison , Marilyn Mantei , Garry Beime , Tracy Narine, Communicating about communicating: cross-disciplinary design of a media space interface, Conference companion on Human factors in computing systems, p.208, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260327]
• 20: Christian Heath , Paul Luff, Disembodied conduct: communication through video in a multi-media office environment, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.99-103, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108859]
• 21: D. Austin Henderson, Jr. , Stuart Card, Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface, ACM Transactions on Graphics (TOG), v.5 n.3, p.211-243, July 1986 [doi>10.1145/24054.24056]
• 22: ISAACS, E. 1989. Mutual memory for conversation. Ph.D. thesis, Stanford Univ., Stanford, Calif.
• 23: Ellen A. Isaacs , John C. Tang , Trevor Morris, Piazza: a desktop environment supporting impromptu and planned interactions, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.315-324, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240316]
• 24: ISAACS, E., WHITTAKER, S., FROHLICH, D., AND O'CONAILL, B. 1997. Information communication re-examined: New functions of video in supporting opportunistic encounters. In Video- Mediated Communication, K. Finn, A. Sellen, and S. Wilbur, Eds. Lawrence Erlbaum Press, Hillsdale, N.J.
• 25: Robert Johansen, Teleconferencing and beyond: communications in the office of the future, McGraw-Hill, Inc., New York, NY, 1984
• 26: Walter Johnson , Herbert Jellinek , Leigh Klotz, Jr. , Ramana Rao , Stuart K. Card, Bridging the paper and electronic worlds: the paper user interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.507-512, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169445]
• 27: Alison Kidd, The marks are on the knowledge worker, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.186-191, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191740]
• 28: Robert E. Kraut , Lynn A. Streeter, Coordination in software development, Communications of the ACM, v.38 n.3, p.69-81, March 1995 [doi>10.1145/203330.203345]
• 29: Robert E. Kraut , Carmen Egido , Jolene Galegher, Patterns of contact and communication in scientific research collaborations, Intellectual teamwork: social and technological foundations of cooperative work, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1990
• 30: KRAUT, R., FISH, R., ROOT, B., AND CHALFONTE, B. 1993. Informal communication in organizations. In Groupware and Computer Supported Co-operative Work, R. Baecker, Ed. Morgan Kaufman, San Mateo, Calif.
• 31: LEVINE, S. AND EHRLICH, S. 1991. The Freestyle Systems: A design perspective. In Human Machine Interactive Systems, A Klinger, Ed. Plenum Press, New York.
• 32: Julia Hirschberg , Diane Litman, Now let's talk about now: identifying cue phrases intonationally, Proceedings of the 25th annual meeting on Association for Computational Linguistics, p.163-171, July 06-09, 1987, Stanford, California [doi>10.3115/981175.981198]
• 33: Paul Luff , Christian Heath , David Greatbatch, Tasks-in-interaction: paper and screen based documentation in collaborative activity, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.163-170, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143475]
• 34: W. Mackay , D. Pagani, Video mosaic: laying out time in a physical space, Proceedings of the second ACM international conference on Multimedia, p.165-172, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192646]
• 35: Thomas W. Malone, How do people organize their desks?: Implications for the design of office information systems, ACM Transactions on Information Systems (TOIS), v.1 n.1, p.99-112, Jan. 1983 [doi>10.1145/357423.357430]
• 36: Richard Mander , Gitta Salomon , Yin Yin Wong, A “pile” metaphor for supporting casual organization of information, Proceedings of the SIGCHI conference on Human factors in computing systems, p.627-634, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143055]
• 37: Marilyn M. Mantei , Ronald M. Baecker , Abigail J. Sellen , William A. S. Buxton , Thomas Milligan , Barry Wellman, Experiences in the use of a media space, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.203-208, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108888]
• 38: Scott L. Minneman , Sara A. Bly, Managing a trois: a study of a multi-user drawing tool in distributed design work, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.217-224, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108893]
• 39: Bonnie A. Nardi , Allan Kuchinsky , Steve Whittaker , Robert Leichner , Heinrich Schwarz, Video-as-data: technical and social aspects of a collaborative multimedia application, Computer Supported Cooperative Work, v.4 n.1, p.73-100, 1995 [doi>10.1007/BF00823364]
• 40: Bonnie A. Nardi , Heinrich Schwarz , Allan Kuchinsky , Robert Leichner , Steve Whittaker , Robert Sclabassi, Turning away from talking heads: the use of video-as-data in neurosurgery, Proceedings of the SIGCHI conference on Human factors in computing systems, p.327-334, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169261]
• 41: William Newman , Pierre Wellner, A desk supporting computer-based interaction with paper documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.587-592, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143007]
• 42: NUNAMAKER, J., DENNIS, A., VALACICH, J., VOGEL, D., AND GEORGE, J. 1993. Electronic meeting systems to support group work. In Groupware and Computer Supported Cooperative Work, R. Baecker, Ed. Morgan Kaufman, San Mateo, Calif.
• 43: Brid O'Conaill , David Frohlich, Timespace in the workplace: dealing with interruptions, Conference companion on Human factors in computing systems, p.262-263, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223665]
• 44: Brid O'Conaill , Erik Geelhoed , Peter Toft, Deskslate: a shared workspace for telephone partners, Conference companion on Human factors in computing systems, p.303-304, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260510]
• 45: O'CONAILL, B., WHITTAKER, S., AND WmBUR, S. 1993. Conversations over videoconferences: An evaluation of the spoken aspects of video mediated interaction. Human Comput. Inter. 8, 389-428.
• 46: OLSON, G. M., OLSON, J. R., CARTER, M., AND STORROSON, M. 1992. Small group design meetings: An analysis of collaboration. Human Comput. Inter. 7, 347-374.
• 47: PANKO, R. 1992. Managerial communication patterns. J. Organ. Comput. 2, 95-122.
• 48: Rachel Reichman, Getting computers to talk like you and me, MIT Press, Cambridge, MA, 1985
• 49: Ronald E. Rice , Douglas E. Shook, Voice messaging, coordination, and communication, Intellectual teamwork: social and technological foundations of cooperative work, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1990
• 50: Mark Rouncefield , John A. Hughes , Tom Rodden , Stephen Viller, Working with “constant interruption”: CSCW and the small office, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.275-286, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193028]
• 51: SACKS, H., SCHEGLOFF, E., AND JEFFERSON, G. 1974. A simplest systematics for the organization of turn-taking in conversation. Language 50, 696-735.
• 52: Mark Stefik , Gregg Foster , Daniel G. Bobrow , Kenneth Kahn , Stan Lanning , Lucy Suchman, Beyond the chalkboard: computer support for collaboration and problem solving in meetings, Communications of the ACM, v.30 n.1, p.32-47, Jan. 1987 [doi>10.1145/7885.7887]
• 53: SUCHMAN, L. AND WYNN, E. 1984. Procedures and problems in the office. Office: Tech. People 2, 133-154.
• 54: John C. Tang, Findings from observational studies of collaborative work, International Journal of Man-Machine Studies, v.34 n.2, p.143-160, Feb. 1991 [doi>10.1016/0020-7373(91)90039-A]
• 55: TANG, J. AND ISAACS, E. 1993. Why do users like video: Studies of multimedia-supported collaboration. Comput. Supp. Coop. Work 1, 163-196.
• 56: John C. Tang , Monica Rua, Montage: providing teleproximity for distributed groups, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.37-43, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191688]
• 57: John C. Tang , Ellen A. Isaacs , Monica Rua, Supporting distributed groups with a Montage of lightweight interactions, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.23-34, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.192861]
• 58: Marilyn A. Walker, Redundancy in collaborative dialogue, Proceedings of the 14th conference on Computational linguistics, August 23-28, 1992, Nantes, France [doi>10.3115/992066.992122]
• 59: WALKER, M. 1993. Information redundancy in dialogue. Ph.D. thesis. Univ. of Pennsylvania.
• 60: Marilyn A. Walker, Limited attention and discourse structure, Computational Linguistics, v.22 n.2, June 1996
• 61: Marilyn Walker , Steve Whittaker, Mixed initiative in dialogue: an investigation into discourse segmentation, Proceedings of the 28th annual meeting on Association for Computational Linguistics, p.70-78, June 06-09, 1990, Pittsburgh, Pennsylvania [doi>10.3115/981823.981833]
• 62: WHITTAKER, S. 1995a. Video as a technology for interpersonal communication: A new perspective. In IS and T/SPIE Symposium on Electronic Imaging Science and Technology: Multimedia Computing and Networks. Vol. 2417. SPIE Press, San Jose, Calif., 294-304.
• 63: Steve Whittaker, Rethinking video as a technology for interpersonal communications: theory and design implications, International Journal of Human-Computer Studies, v.42 n.5, p.501-529, May 1995 [doi>10.1006/ijhc.1995.1022]
• 64: Steve Whittaker, Talking to strangers: an evaluation of the factors affecting electronic collaboration, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.409-418, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240352]
• 65: WHITTAKER, S. AND O'CONAILL, B. 1993. Evaluating videoconferencing. In Companion Proceedings of CHI'93 Human Factors in Computing Systems. ACM Press, New York.
• 66: Steve Whittaker , Phil Stenton, Cues and control in expert-client dialogues, Proceedings of the 26th annual meeting on Association for Computational Linguistics, p.123-130, June 07-10, 1988, Buffalo, New York [doi>10.3115/982023.982038]
• 67: Steve Whittaker , Heinrich Schwarz, Back to the future: pen and paper technology supports complex group coordination, Proceedings of the SIGCHI conference on Human factors in computing systems, p.495-502, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223971]
• 68: Steve Whittaker , Candace Sidner, Email overload: exploring personal information management of email, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.276-283, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238530]
• 69: Steve Whittaker , Susan E. Brennan , Herbert H. Clark, Co-ordinating activity: an analysis of interaction in computer-supported co-operative work, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.361-367, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108944]
• 70: Steve Whittaker , David Frohlich , Owen Daly-Jones, Informal workplace communication: what is it like and how might we support it?, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.131-137, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191726]
• 71: Steve Whittaker , Erik Geelhoed , Elizabeth Robinson, Shared workspaces: how do they work and when are they useful?, International Journal of Man-Machine Studies, v.39 n.5, p.813-842, Nov. 1993 [doi>10.1006/imms.1993.1085]
• 72: Terry Winograd , Fernando Flores, Understanding computers and cognition, Ablex Publishing Corp., Norwood, NJ, 1986
• 73: Catherine G. Wolf , James R. Rhyne , Hamed A. Ellozy, The paper-like interface, Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.), p.494-501, September 1989, Boston, Massachusetts, United States

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.3 Group and Organization Interfaces
          Subjects: Asynchronous interaction; Synchronous interaction

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Human Factors

Keywords:
audio, awareness, computer-media spaces, conversation management, impromptu communication, informal communication, interpersonal communications, lightweight interaction, mediated communication, remote collaboration, task management, video