CA3: collaborative annotation of audio in academia

ABSTRACT

We present a collaborative tagging tool for audio streams. We discuss two case studies using this tool: The first case study demonstrates the usefulness of simple tags as metadata. The second case study elaborates issues discovered while allowing students to tag events during a classroom lecture, and methods for aggregating and displaying the collected tags. We conclude with insights into collaborative tagging for data retrieval in content streams.

REFERENCES

• 1: G. D. Abowd, Classroom 2000: an experiment with the instrumentation of a living educational environment, IBM Systems Journal, v.38 n.4, p.508-530, Dec. 1999
• 2: Gregory D. Abowd , Christopher G. Atkeson , Ami Feinstein , Cindy Hmelo , Rob Kooper , Sue Long , Nitin Sawhney , Mikiya Tani, Teaching and learning as multimedia authoring: the classroom 2000 project, Proceedings of the fourth ACM international conference on Multimedia, p.187-198, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244191]
• 3: Preetha Appan , Bageshree Shevade , Hari Sundaram , David Birchfield, Interfaces for networked media exploration and collaborative annotation, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040860]
• 4: David Bargeron , Anoop Gupta , Jonathan Grudin , Elizabeth Sanocki, Annotations for streaming video on the Web: system design and usage studies, Proceeding of the eighth international conference on World Wide Web, p.1139-1153, May 1999, Toronto, Canada
• 5: Wen-Huang Cheng , Wei-Ta Chu , Ja-Ling Wu, Semantic context detection based on hierarchical audio models, Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, November 07-07, 2003, Berkeley, California [doi>10.1145/973264.973282]
• 6: Patrick Chiu , Ashutosh Kapuskar , Sarah Reitmeier , Lynn Wilcox, NoteLook: taking notes in meetings with digital video and ink, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.149-158, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319483]
• 7: Ellis, D. P., Features for segmenting and classifying long-duration recordings of "personal" audio. In Proc. ISCA Tutorial and Research Workshop on Statistical and Perceptual Audio Processing SAPA-04 Jeju, Korea, 2004.
• 8: Daniel P.W. Ellis , Keansub Lee, Minimal-impact audio-based personal archives, Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences, October 15-15, 2004, New York, New York, USA [doi>10.1145/1026653.1026659]
• 9: Jonathan Foote, An overview of audio information retrieval, Multimedia Systems, v.7 n.1, p.2-10, Jan. 1999 [doi>10.1007/s005300050106]
• 10: Golder, S. and B. Huberman, The Structure of Collaborative Tagging Systems. 2005.
• 11: Grabe, M. and K. Christopherson, Evaluating the advantages and disadvantages of providing lecture notes: The role of internet technology as a delivery system and research tool. The Internet and Higher Education, 2005. <b>8</b>(4): p. 291--298.
• 12: Nicky Kern , Bernt Schiele , Holger Junker , Paul Lukowicz , Gerhard Tröster, Wearable sensing to annotate meeting recordings, Personal and Ubiquitous Computing, v.7 n.5, p.263-274, October 2003 [doi>10.1007/s00779-003-0242-y]
• 13: Jochen Lienhard , Tobias Lauer, Multi-layer recording as a new concept of combining lecture recording and students' handwritten notes, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641078]
• 14: Lie Lu , Hong-Jiang Zhang, Speaker change detection and tracking in real-time news broadcasting analysis, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641127]
• 15: Lu, L. and H. Zhang, Content analysis for audio classification and segmentation. IEEE Transactions on Speech and Audio Processing, 2002. <b>10</b>(7).
• 16: Scott Minneman , Steve Harrison , Bill Janssen , Gordon Kurtenbach , Thomas Moran , Ian Smith , Bill van Melle, A confederation of tools for capturing and accessing collaborative activity, Proceedings of the third ACM international conference on Multimedia, p.523-534, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215316]
• 17: Thomas P. Moran , Leysia Palen , Steve Harrison , Patrick Chiu , Don Kimber , Scott Minneman , William van Melle , Polle Zellweger, “I'll get that off the audio”: a case study of salvaging multimedia meeting records, Proceedings of the SIGCHI conference on Human factors in computing systems, p.202-209, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258704]
• 18: Lisa Stifelman , Barry Arons , Chris Schmandt, The audio notebook: paper and pen interaction with structured speech, Proceedings of the SIGCHI conference on Human factors in computing systems, p.182-189, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365096]
• 19: Khai N. Truong , Gregory D. Abowd , Jason A. Brotherton, Personalizing the capture of public experiences, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.121-130, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322593]
• 20: Vemuri, S., et al., An audio-based personal memory aid. Proceedings of Ubicomp 2004: Ubiquitous Computing., 2004: p. 400--417.
• 21: Lynn D. Wilcox , Bill N. Schilit , Nitin Sawhney, Dynomite: a dynamically organized ink and audio notebook, Proceedings of the SIGCHI conference on Human factors in computing systems, p.186-193, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258700]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

Keywords:
audio indexing, collaborative annotation, note taking, personal information management, social metadata