ButterflyNet: a mobile capture and access system for field biology research

ABSTRACT

Through a study of field biology practices, we observed that biology fieldwork generates a wealth of heterogeneous information, requiring substantial labor to coordinate and distill. To manage this data, biologists leverage a diverse set of tools, organizing their effort in paper notebooks. These observations motivated ButterflyNet, a mobile capture and access system that integrates paper notes with digital photographs captured during field research. Through ButterflyNet, the activity of leafing through a notebook expands to browsing all associated digital photos. ButterflyNet also facilitates the transfer of captured content to spreadsheets, enabling biologists to share their work. A first-use study with 14 biologists found this system to offer rich data capture and transformation, in a manner felicitous with current practice.

REFERENCES

• 1: Gregory D. Abowd , Elizabeth D. Mynatt, Charting past, present, and future research in ubiquitous computing, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.29-58, March 2000 [doi>10.1145/344949.344988]
• 2: Anoto AB, Anoto Technology. http://www.anoto.com
• 3: Larry Arnstein , Chia-Yang Hung , Robert Franza , Qing Hong Zhou , Gaetano Borriello , Sunny Consolvo , Jing Su, Labscape: A Smart Environment for the Cell Biology Laboratory, IEEE Pervasive Computing, v.1 n.3, p.13-21, July 2002 [doi>10.1109/MPRV.2002.1037717]
• 4: Daniel Avrahami , Scott E. Hudson , Thomas P. Moran , Brian D. Williams, Guided gesture support in the paper PDA, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502385]
• 5: Maribeth Back , Jonathan Cohen , Rich Gold , Steve Harrison , Scott Minneman, Listen reader: an electronically augmented paper-based book, Proceedings of the SIGCHI conference on Human factors in computing systems, p.23-29, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365031]
• 6: Benjamin B. Bederson , Jesse Grosjean , Jon Meyer, Toolkit Design for Interactive Structured Graphics, IEEE Transactions on Software Engineering, v.30 n.8, p.535-546, August 2004 [doi>10.1109/TSE.2004.44]
• 7: Butler, D. A new leaf. Nature 436: Nature Publishing Group. pp. 20--21, 2005.
• 8: Philip R. Cohen , David R. McGee, Tangible multimodal interfaces for safety-critical applications, Communications of the ACM, v.47 n.1, January 2004 [doi>10.1145/962081.962103]
• 9: Culler, D. E. and H. Mulder. Smart Sensors to Network the World. Scientific American 290(6). pp. 84--91, 2004.
• 10: CyberTracker, CyberTracker. http://www.cybertracker.co.za
• 11: Marc Dymetman , Max Copperman, Intelligent Paper, Proceedings of the 7th International Conference on Electronic Publishing, Held Jointly with the 4th International Conference on Raster Imaging and Digital Typography: Electronic Publishing, Artistic Imaging, and Digital Typography, p.392-406, March 30-April 03, 1998
• 12: Embedded Data Systems, LLC., iButton. http://embeddeddatasystems.com
• 13: François Guimbretière, Paper augmented digital documents, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.51-60, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964702]
• 14: Jeremy M. Heiner , Scott E. Hudson , Kenichiro Tanaka, Linking and messaging from real paper in the Paper PDA, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.179-186, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322600]
• 15: HSQLDB, HSQL Database Engine, 2005. http://www.hsqldb.org
• 16: Inlite Research, Inc., ClearImage SDK, 2005. http://www.inliteresearch.com
• 17: Walter Johnson , Herbert Jellinek , Leigh Klotz, Jr. , Ramana Rao , Stuart K. Card, Bridging the paper and electronic worlds: the paper user interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.507-512, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169445]
• 18: Matthew Kam , Jingtao Wang , Alastair Iles , Eric Tse , Jane Chiu , Daniel Glaser , Orna Tarshish , John Canny, Livenotes: a system for cooperative and augmented note-taking in lectures, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055046]
• 19: Scott R. Klemmer , Jamey Graham , Gregory J. Wolff , James A. Landay, Books with voices: paper transcripts as a physical interface to oral histories, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642628]
• 20: Scott R. Klemmer , Jack Li , James Lin , James A. Landay, Papier-Mache: toolkit support for tangible input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.399-406, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985743]
• 21: Lamming, M. and M. Flynn. Forget-me-not: Intimate Computing in Support of Human Memory. FRIEND21: International Symposium on Next Generation Human Interface, 1994.
• 22: Chunyuan Liao , François Guimbretière , Ken Hinckley, PapierCraft: a command system for interactive paper, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095074]
• 23: Paul Luff , Christian Heath , Moira Norrie , Beat Signer , Peter Herdman, Only touching the surface: creating affinities between digital content and paper, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031695]
• 24: Wendy E. Mackay , Anne-Laure Fayard , Laurent Frobert , Lionel Médini, Reinventing the familiar: exploring an augmented reality design space for air traffic control, Proceedings of the SIGCHI conference on Human factors in computing systems, p.558-565, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274719]
• 25: Wendy E. Mackay , Guillaume Pothier , Catherine Letondal , Kaare Bøegh , Hans Erik Sørensen, The missing link: augmenting biology laboratory notebooks, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571992]
• 26: Thomas P. Moran , Leysia Palen , Steve Harrison , Patrick Chiu , Don Kimber , Scott Minneman , William van Melle , Polle Zellweger, “I'll get that off the audio”: a case study of salvaging multimedia meeting records, Proceedings of the SIGCHI conference on Human factors in computing systems, p.202-209, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258704]
• 27: MVZ, The Grinnell Method. University of California: Berkeley. http://mvz.berkeley.edu/Grinnell_Method.html
• 28: Brad Myers , Scott E. Hudson , Randy Pausch, Past, present, and future of user interface software tools, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.3-28, March 2000 [doi>10.1145/344949.344959]
• 29: Les Nelson , Satoshi Ichimura , Elin Rønby Pedersen , Lia Adams, Palette: a paper interface for giving presentations, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.354-361, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303109]
• 30: Nokia, Nokia SU-1B Digital Pen. http://www.nokia.com
• 31: OQO, model 01, 2005. http://www.oqo.com
• 32: Tapan S. Parikh, Using Mobile Phones for Secure, Distributed Document Processing in the Developing World, IEEE Pervasive Computing, v.4 n.2, p.74-81, April 2005 [doi>10.1109/MPRV.2005.43]
• 33: Abigail J. Sellen , Richard H.R. Harper, The Myth of the Paperless Office, MIT Press, Cambridge, MA, 2003
• 34: Lisa Stifelman , Barry Arons , Chris Schmandt, The audio notebook: paper and pen interaction with structured speech, Proceedings of the SIGCHI conference on Human factors in computing systems, p.182-189, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365096]
• 35: Truong, K. N. and G. D. Abowd. INCA: A Software Infrastructure to Facilitate the Construction and Evolution of Ubiquitous Capture & Access Applications. Pervasive: The International Conference on Pervasive Computing: Springer-Verlag. pp. 140--57, 2004.
• 36: Khai N. Truong , Gregory D. Abowd , Jason A. Brotherton, Personalizing the capture of public experiences, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.121-130, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322593]
• 37: Steve Whittaker , Patrick Hyland , Myrtle Wiley, FILOCHAT: handwritten notes provide access to recorded conversations, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.271-277, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191763]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
augmented paper notebook, mobile capture and access