Keepin' it real: pushing the desktop metaphor with physics, piles and the pen

ABSTRACT

We explore making virtual desktops behave in a more physically realistic manner by adding physics simulation and using piling instead of filing as the fundamental organizational structure. Objects can be casually dragged and tossed around, influenced by physical characteristics such as friction and mass, much like we would manipulate lightweight objects in the real world. We present a prototype, called BumpTop, that coherently integrates a variety of interaction and visualization techniques optimized for pen input we have developed to support this new style of desktop organization.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, More than dotting the i's --- foundations for crossing-based interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503390]
• 2: Georg Apitz , François Guimbretière, CrossY: a crossing-based drawing application, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029635]
• 3: Baraff, D., Witkin, A., & Kass, M. (1997). An introduction to physically based modeling: particle system dynamics. SIGGRAPH Course Notes.
• 4: Bartram, L. (1997). Can motion increase user interface bandwidth. IEEE Systems, Man and Cybernetics. p. 1686--1692.
• 5: Dan Bauer , Pierre Fastrez , Jim Hollan, Computationally-Enriched 'Piles' for Managing Digital Photo Collections, Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC'04), p.193-195, September 26-29, 2004 [doi>10.1109/VLHCC.2004.13]
• 6: Michel Beaudouin-Lafon, Novel interaction techniques for overlapping windows, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502371]
• 7: Benjamin B. Bederson , James D. Hollan, Pad++: a zooming graphical interface for exploring alternate interface physics, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.17-26, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192435]
• 8: Blaine Bell , Steven Feiner , Tobias Höllerer, View management for virtual and augmented reality, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502363]
• 9: M. S. T. Carpendale , Catherine Montagnese, A framework for unifying presentation space, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502358]
• 10: Carpendale, S., Cowperthwaite, D., Tigges, M., Fall, A., & Fracchia, D. (1999). The Tardis: A visual exploration environment for landscape dynamics. SPIE Conf. on Visual Data Exploration & Analysis VI. p. 110--119.
• 11: Bay-Wei Chang , David Ungar, Animation: from cartoons to the user interface, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.45-55, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168647]
• 12: Czerwinski, M., van Dantzich, M., Robertson, G., & Hoffmann, H. (1999). The contribution of thumbnail image, mouse-over text, and spatial location memory to web page retrival in 3D. Interact. p. 163--170.
• 13: Laurent Denoue , Les Nelson , Elizabeth Churchill, A fast, interactive 3D paper-flier metaphor for digital bulletin boards, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.169-172, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964715]
• 14: Paul DiGioia , Paul Dourish, Social navigation as a model for usable security, Proceedings of the 2005 symposium on Usable privacy and security, p.101-108, July 06-08, 2005, Pittsburgh, Pennsylvania [doi>10.1145/1073001.1073011]
• 15: Pierre Dragicevic, Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029667]
• 16: George Fitzmaurice , Azam Khan , Robert Pieké , Bill Buxton , Gordon Kurtenbach, Tracking menus, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.71-79, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964704]
• 17: Clifton Forlines , Chia Shen , Bill Buxton, Glimpse: a novel input model for multi-level devices, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056920]
• 18: Cleotilde Gonzalez, Does animation in user interfaces improve decision making?, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.27-34, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238396]
• 19: Tovi Grossman , Ravin Balakrishnan , Gordon Kurtenbach , George Fitzmaurice , Azam Khan , Bill Buxton, Interaction techniques for 3D modeling on large displays, Proceedings of the 2001 symposium on Interactive 3D graphics, p.17-23, March 2001 [doi>10.1145/364338.364341]
• 20: Kenneth P. Herndon , Robert C. Zeleznik , Daniel C. Robbins , D. Brookshire Conner , Scott S. Snibbe , Andries van Dam, Interactive shadows, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.1-6, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142622]
• 21: Ken Hinckley , Patrick Baudisch , Gonzalo Ramos , Francois Guimbretiere, Design and analysis of delimiters for selection-action pen gesture phrases in scriboli, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055035]
• 22: Gordon Kurtenbach , William Buxton, Issues in combining marking and direct manipulation techniques, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.137-144, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120797]
• 23: Kurtenbach, G. & Buxton, W. (1993). The limits of expert performance using hierarchical marking menus. CHI. p. 35--42.
• 24: Thomas W. Malone, How do people organize their desks?: Implications for the design of office information systems, ACM Transactions on Information Systems (TOIS), v.1 n.1, p.99-112, Jan. 1983 [doi>10.1145/357423.357430]
• 25: Richard Mander , Gitta Salomon , Yin Yin Wong, A “pile” metaphor for supporting casual organization of information, Proceedings of the SIGCHI conference on Human factors in computing systems, p.627-634, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143055]
• 26: McGuffin, M., Burtnyk, N., & Kurtenbach, G. (2002). FaST Sliders: Integrating marking menus and the adjustment of continuous values. Graphics Interface. p. 35--42.
• 27: McGuffin, M., Tancau, L., & Balakrishnan, R. (2003). Using deformations for browsing volumetric data. IEEE Visualization. p. 401--408.
• 28: Lynn Miller, Case Study of Customer Input For a Successful Product, Proceedings of the Agile Development Conference, p.225-234, July 24-29, 2005 [doi>10.1109/ADC.2005.16]
• 29: Stuart Pook , Eric Lecolinet , Guy Vaysseix , Emmanuel Barillot, Control menus: excecution and control in a single interactor, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633446]
• 30: Gonzalo Ramos , Matthew Boulos , Ravin Balakrishnan, Pressure widgets, Proceedings of the SIGCHI conference on Human factors in computing systems, p.487-494, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985754]
• 31: George Robertson , Mary Czerwinski , Kevin Larson , Daniel C. Robbins , David Thiel , Maarten van Dantzich, Data mountain: using spatial memory for document management, Proceedings of the 11th annual ACM symposium on User interface software and technology, p.153-162, November 01-04, 1998, San Francisco, California, United States [doi>10.1145/288392.288596]
• 32: George Robertson , Maarten van Dantzich , Daniel Robbins , Mary Czerwinski , Ken Hinckley , Kirsten Risden , David Thiel , Vadim Gorokhovsky, The Task Gallery: a 3D window manager, Proceedings of the SIGCHI conference on Human factors in computing systems, p.494-501, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332482]
• 33: George G. Robertson , Jock D. Mackinlay , Stuart K. Card, Cone Trees: animated 3D visualizations of hierarchical information, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.189-194, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108883]
• 34: Abigail J. Sellen , Richard H.R. Harper, The Myth of the Paperless Office, MIT Press, Cambridge, MA, 2003
• 35: Henry Sonnet , Sheelagh Carpendale , Thomas Strothotte, Integrating expanding annotations with a 3D explosion probe, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989871]
• 36: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 37: Matthew Thorne , David Burke , Michiel van de Panne, Motion doodles: an interface for sketching character motion, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 38: Tristram, C. (2001). The next computer interface. MIT Technology Review, December.
• 39: Steve Whittaker , Julia Hirschberg, The character, value, and management of personal paper archives, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.2, p.150-170, June 2001 [doi>10.1145/376929.376932]
• 40: David D. Woods, Visual momentum: a concept to improve the cognitive coupling of person and computer, International Journal of Man-Machine Studies, v.21 n.3, p.229-244, Sept. 1984 [doi>10.1016/S0020-7373(84)80043-7]
• 41: Koji Yatani , Koiti Tamura , Keiichi Hiroki , Masanori Sugimoto , Hiromichi Hashizume, Toss-it: intuitive information transfer techniques for mobile devices, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057046]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
Lasso'n'Cross, LassoMenu, bumptop, crumple, desktop metaphor, fanout, pen-based interfaces, physical interaction, physics based desktop, pile widgets, piles, piling metaphor