Generating semantic contexts from spoken conversation in meetings

ABSTRACT

SemanticTalk is a tool for supporting face-to-face meetings and discussions by automatically generating a semantic context from spoken conversations. We use speech recognition and topic extraction from a large terminological database to create a network of discussion topics in real-time. This network includes concepts explicitly addressed in the discussion as well as semantically associated terms, and is visualized to increase conversational awareness and creativity in the group.

REFERENCES

• 1: Uwe M. Borghoff , J. H. Schlichter, Computer-Supported Cooperative Work: Introduction to Distributed Applications, Springer-Verlag New York, Inc., Secaucus, NJ, 2000
• 2: Jeff Conklin , Michael L. Begeman, gIBIS: a hypertext tool for team design deliberation, Proceeding of the ACM conference on Hypertext, p.247-251, November 1987, Chapel Hill, North Carolina, United States [doi>10.1145/317426.317444]
• 3: Anind K. Dey , Daniel Salber , Gregory D. Abowd , Masayasu Futakawa, The Conference Assistant: Combining Context-Awareness with Wearable Computing, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.21, October 18-19, 1999
• 4: Joan Morris DiMicco , Walter Bender, Second messenger: increasing the visibility of minority viewpoints with a face-to-face collaboration tool, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964489]
• 5: Michel Galley , Kathleen McKeown , Eric Fosler-Lussier , Hongyan Jing, Discourse segmentation of multi-party conversation, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.562-569, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075096.1075167]
• 6: Gerhard Heyer , Uwe Quasthoff , Christian Wolff, Automatic Analysis of Large Text Corpora - A Contribution to Structuring WEB Communities, Proceedings of the Second International Workshop on Innovative Internet Computing Systems, p.15-26, June 20-22, 2002
• 7: Jebara, T., Ivanov, Y., Rahimi, A., and Pentland, A. Tracking conversational context for machine mediation of human discourse. In AAAI Fall 2000 Symposium - Socially Intelligent Agents - The Human in the Loop, AAAI Press, Massachusetts, 2004.
• 8: Kazman, R., Hunt, W. and Mantei M. Dynamic Meeting Annotation and Indexing. In Proceedings of the 1995, Pacific Workshop on Distributed Multimedia Systems, (Honolulu, HI, March 1995), Idea Group Publishing. Honolulu, 1995, 11--18.
• 9: Streitz, N., Geißler, J., Haake, J. and Hoi, J. Dolphin: Integrated meeting support across Liveboards, local and remote desktop environments. In Integrated publication and information systems. GMD IPSI, Darmstadt, 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Computer-supported cooperative work

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Synchronous interaction; Theory and models

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
conversational awareness, intelligent assistance, real-time speech-recognition, semantic context