QuickSet

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

QuickSet: multimodal interaction for distributed applications

Full text

Pdf (1.65 MB)

Source

International Multimedia Conference archive
Proceedings of the fifth ACM international conference on Multimedia table of contents

Seattle, Washington, United States

Pages: 31 - 40

Year of Publication: 1997

ISBN:0-89791-991-2

Authors

Philip R. Cohen	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Michael Johnston	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
David McGee	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Sharon Oviatt	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Jay Pittman	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Ira Smith	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Liang Chen	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
Josh Clow	Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGGROUP: ACM Special Interest Group on Supporting Group Work
SIGMIS: ACM Special Interest Group on Management Information Systems
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
SIGCOMM: ACM Special Interest Group on Data Communication
SIGIR: ACM Special Interest Group on Information Retrieval
SIGLINK: Hypertext, Hypermedia, and Web
SIGMULTIMEDIA: ACM Special Interest Group on Multimedia
SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 17, Downloads (12 Months): 119, Citation Count: 106

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/266180.266328 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
	2	Baker, M. P., and Wickens, C. D. Human factors in virtual environments for the visual analysis of scientific data. Unpublished ms., University of Illinois.
	3	Brooks, Frederic. 3-D user interfaces: When results matter, Invited presentation (unpublished), UIST'96, Seattle, 1996.
	4	Brison, E. and Vigouroux, N. (unpublished ms.). Multimodal references: A generic fusion process. UR1T-URA CNRS. Universit~ Paul Sabatier, Toulouse, France.
	5	Calder, J. 1987. Typed unification for natural language processing. In E. Klein and J. van Benthem (Eds.), Categories, Polymorphisms, and Unification. Centre for Cognitive Science, University of Edinburgh, Edinburgh, pp. 65-72.
	6	Cheyer, A., and Julia L. 1995. Multimodal maps: An agentbased approach. International Conference on Cooperative Mult#nodal Communication (CMC/95), May I995. Eindhoven, Tile Netherlands. pp. 24-26.
	7	Carpenter, R. 1990. Typed feature structures: Inheritance, (In)equality, and Extensionality. In W. Daelemans and O. Gazdar (Eds.), Proceedings of the 1TK Workshop: Inheritance in Natural Language Processing, Tilburg University, pp. 9-18.
	8	Bob Carpenter, The logic of typed feature structures, Cambridge University Press, New York, NY, 1992
	9	Jon Christensen , Joe Marks , Stuart Shieber, Placing text labels on maps and diagrams, Graphics gems IV, Academic Press Professional, Inc., San Diego, CA, 1994
	10	Clarkson, J. D., and Yi, J. LeatherNet: A synthetic forces tactical training system for the USMC commander. Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation. Orlando, Florida, 1996 275-281.
	11	Philip R. Cohen, The role of natural language in a multimodal interface, Proceedings of the 5th annual ACM symposium on User interface software and technology, p.143-149, November 15-18, 1992, Monteray, California, United States [doi>10.1145/142621.142641]
	12	P. R. Cohen , M. Dalrymple , D. B. Moran , F. C. Pereira , J. W. Sullivan, Synergistic use of direct manipulation and natural language, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.227-233, March 1989
	13	Cohen, P. R., Cheyer, A., Wang, M., and Baeg, S.C. An Open Agent Architecture. Proceedings of the AAAI Spring Symposium Series on Software Agents (March 21-22, Stanford), Stanford Univ., CA, 1994, 1-8.
	14	Courtemanche, A.J. and Ceranowicz, A. ModSAF Development Status. Proceedings of the Fifth Conference on Computer Generated Forces and Behavioral Representation, Univ. Central Florida, Orlando, 1995, 3-13.
	15	Carolina Cruz-Neira , Daniel J. Sandin , Thomas A. DeFanti, Surround-screen projection-based virtual reality: the design and implementation of the CAVE, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.135-142, September 1993 [doi>10.1145/166117.166134]
	16	Michael Johnston , Philip R. Cohen , David McGee , Sharon L. Oviatt , James A. Pittman , Ira Smith, Unification-based multimodal integration, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.281-288, July 07-12, 1997, Madrid, Spain
	17	David B. Koons , Carlton J. Sparrell , Kristinn R. Thorisson, Integrating simultaneous input from speech, gaze, and hand gestures, Intelligent multimedia interfaces, American Association for Artificial Intelligence, Menlo Park, CA, 1993
	18	Manke, S., Finke, M., and Waibel, A., The use of dynamic writing information in a connectionist on-line cursive handwriting recognition system, Advances in Neural Information processing Systems 7 (~IIPS), 1994.
	19	R. C. Moore , J. Dowding , H. Bratt , J. M. Gawron , Y. Gorfu , A. Cheyer, CommandTalk: a spoken-language interface for battlefield simulations, Proceedings of the fifth conference on Applied natural language processing, p.1-7, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974558]
	20	Jeannette G. Neal , Stuart C. Shapiro, Intelligent multi-media interface technology, Intelligent user interfaces, ACM Press, New York, NY, 1991 [doi>10.1145/107215.128690]
	21	Oviatt, S. L. Pen/Voice: Complementary multimodal communication, Proceedings of SpeechTech'92, New York, February, 1992, 238-241.
	22	Sharon Oviatt, Multimodal interfaces for dynamic interactive maps, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.95-102, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238438]
	23	Oviatt, S.L. Multimodal interactive maps: Designing for human performance, Human Computer Interaction, in press.
	24	Sharon Oviatt , Antonella DeAngeli , Karen Kuhn, Integration and synchronization of input modes during multimodal human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258821]
	25	Oviatt, S. L., and Olsen, E., Integration themes in multimodal human-computer interaction, Proceedings of the International Conference on Spoken Language Processing, Acoustical Society of Japan, Yokohama, Japan, 1994, 551-554.
	26	James A. Pittman, Recognizing handwritten text, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.271-275, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108914]
	27	Richard Stoakley , Matthew J. Conway , Randy Pausch, Virtual reality on a WIM: interactive worlds in miniature, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223938]
	28	Thorpe, J..4.. The new technology of large scale simulator networking: Implications for mastering the art of warfighting, 9a Interservice Training Systems Conference, 1987, 492-501,
	29	Vo, M. T. and Wood, C. Building an appUeation framework for speech and pen input integration in multimodal learning interfaces. International Conference on Acoustics, Speech, and Signal Processing, Atlanta, GA. 1996.
	30	Alex Waibel , Minh Tue Vo , Paul Duchnowski , Stefan Manke, Multimodal interfaces, Artificial Intelligence Review, v.10 n.3-4, p.299-319, Aug. 1996 [doi>10.1007/BF00127684]
	31	Wauchope, K. 1994. Eucalyptus: Integrating natural language input with a graphical user interface. Naval Research Laboratory, Report NRL/FR/$510--94-9711,
	32	Michael J. Zyda , David R. Pratt , James G. Monahan , Kalin P. Wilson, NPSNET: constructing a 3D virtual world, Proceedings of the 1992 symposium on Interactive 3D graphics, p.147-156, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147186]

CITED BY 106

	Robert Rasch , Alexander Kott , Kenneth D. Forbus, AI on the battlefield: an experimental exploration, Eighteenth national conference on Artificial intelligence, p.906-912, July 28-August 01, 2002, Edmonton, Alberta, Canada
	Sharon Oviatt, Ten myths of multimodal interaction, Communications of the ACM, v.42 n.11, p.74-81, Nov. 1999
	Sharon Oviatt , Philip Cohen, Perceptual user interfaces: multimodal interfaces that process what comes naturally, Communications of the ACM, v.43 n.3, p.45-53, March 2000
	Zouheir Trabelsi , Sung-Hyuk Cha , Darshan Desai , Charles Tappert, A voice and ink XML multimodal architecture for mobile e-commerce systems, Proceedings of the 2nd international workshop on Mobile commerce, September 28-28, 2002, Atlanta, Georgia, USA
	David M. Krum , Olugbenga Omoteso , William Ribarsky , Thad Starner , Larry F. Hodges, Speech and gesture multimodal control of a whole Earth 3D visualization environment, Proceedings of the symposium on Data Visualisation 2002, May 27-29, 2002, Barcelona, Spain
	Kenneth D. Forbus , Ronald W. Ferguson , Jeffery M. Usher, Towards a computational model of sketching, Proceedings of the 6th international conference on Intelligent user interfaces, p.77-83, January 14-17, 2001, Santa Fe, New Mexico, United States
	David R. McGee , Philip R. Cohen, Creating tangible interfaces by augmenting physical objects with multimodal language, Proceedings of the 6th international conference on Intelligent user interfaces, p.113-119, January 14-17, 2001, Santa Fe, New Mexico, United States
	Sharon Oviatt, Multimodal system processing in mobile environments, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.21-30, November 06-08, 2000, San Diego, California, United States
	Katsumi Tanaka, A robust selection system using real-time multi-modal user-agent interactions, Proceedings of the 4th international conference on Intelligent user interfaces, p.105-108, January 05-08, 1999, Los Angeles, California, United States
	Sharon Oviatt, Multimodal interfaces, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Sharon Oviatt, Mutual disambiguation of recognition errors in a multimodel architecture, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.576-583, May 15-20, 1999, Pittsburgh, Pennsylvania, United States
	Gal A. Kaminka , David V. Pynadath , Milind Tambe, Monitoring deployed agent teams, Proceedings of the fifth international conference on Autonomous agents, p.308-315, May 2001, Montreal, Quebec, Canada
	Anind Dey , Jennifer Mankoff , Gregory Abowd , Scott Carter, Distributed mediation of ambiguous context in aware environments, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France
	Jakub Segen , Senthil Kumar, Gesture VR: vision-based 3D hand interace for spatial interaction, Proceedings of the sixth ACM international conference on Multimedia, p.455-464, September 13-16, 1998, Bristol, United Kingdom
	Paolo Busetta , Antonia Donà , Michele Nori, Channeled multicast for group communications, Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 3, July 15-19, 2002, Bologna, Italy
	Andries van Dam , Andrew S. Forsberg , David H. Laidlaw , Joseph J. LaViola , Rosemary M. Simpson, Immersive VR for Scientific Visualization: A Progress Report, IEEE Computer Graphics and Applications, v.20 n.6, p.26-52, November 2000
	David R. McGee , Philip R. Cohen , Lizhong Wu, Something from nothing: augmenting a paper-based work practice via multimodal interaction, Proceedings of DARE 2000 on Designing augmented reality environments, p.71-80, April 2000, Elsinore, Denmark
	Sharon Oviatt, Taming recognition errors with a multimodal interface, Communications of the ACM, v.43 n.9, p.45-51, Sept. 2000
	Dan R. Olsen, Jr. , S. Travis Nielsen , David Parslow, Join and capture: a model for nomadic interaction, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida
	Kenneth D. Forbus , Jeffrey Usher, Sketching for knowledge capture: a progress report, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA
	Ingmar Rauschert , Pyush Agrawal , Rajeev Sharma , Sven Fuhrmann , Isaac Brewer , Alan MacEachren, Designing a human-centered, multimodal GIS interface to support emergency management, Proceedings of the 10th ACM international symposium on Advances in geographic information systems, November 08-09, 2002, McLean, Virginia, USA
	Joyce Y. Chai , Zahar Prasov , Joseph Blaim , Rong Jin, Linguistic theories in efficient multimodal reference resolution: an empirical investigation, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
	Kenneth D. Forbus , Jeffrey Usher , Vernell Chapman, Sketching for military courses of action diagrams, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA
	Anurag Gupta, A reference model for multimodal input interpretation, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA
	Philip Cohen , David McGee , Josh Clow, The efficiency of multimodal interaction for a map-based task, Proceedings of the sixth conference on Applied natural language processing, p.331-338, April 29-May 04, 2000, Seattle, Washington
	Fang Chen , Eric Choi , Julien Epps , Serge Lichman , Natalie Ruiz , Yu Shi , Ronnie Taib , Mike Wu, A study of manual gesture-based selection for the PEMMI multimodal transport management interface, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy
	Antonio Krüger , Andreas Butz , Christian Müller , Christoph Stahl , Rainer Wasinger , Karl-Ernst Steinberg , Andreas Dirschl, The connected user interface: realizing a personal situated navigation service, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal
	Philip R. Cohen , David R. McGee, Tangible multimodal interfaces for safety-critical applications, Communications of the ACM, v.47 n.1, January 2004
	Frans Flippo , Allen Krebs , Ivan Marsic, A framework for rapid development of multimodal interfaces, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Anoop K. Sinha , James A. Landay, Capturing user tests in a multimodal, multidevice informal prototyping tool, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Robert Rasch , Alexander Kott , Kenneth D. Forbus, Incorporating AI into Military Decision Making: An Experiment, IEEE Intelligent Systems, v.18 n.4, p.18-26, July/August 2003
	Joyce Y. Chai , Pengyu Hong , Michelle X. Zhou, A probabilistic approach to reference resolution in multimodal user interfaces, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal
	Sharon Oviatt, Advances in Robust Multimodal Interface Design, IEEE Computer Graphics and Applications, v.23 n.5, p.62-68, September 2003
	Anoop K. Sinha , James A. Landay, Visually prototyping perceptual user interfaces through multimodal storyboarding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida
	Michael Johnston, Unification-based multimodal parsing, Proceedings of the 36th annual meeting on Association for Computational Linguistics, August 10-14, 1998, Montreal, Quebec, Canada
	Joseph J. LaViola, Jr. , Daniel Acevedo Feliz , Daniel F. Keefe , Robert C. Zeleznik, Hands-free multi-scale navigation in virtual environments, Proceedings of the 2001 symposium on Interactive 3D graphics, p.9-15, March 2001
	Sanjeev Kumar , Philip R. Cohen, Towards a fault-tolerant multi-agent system architecture, Proceedings of the fourth international conference on Autonomous agents, p.459-466, June 03-07, 2000, Barcelona, Spain
	Milind Tambe , David V. Pynadath, Towards heterogeneous agent teams, Mutli-agents systems and applications, Springer-Verlag New York, Inc., New York, NY, 2001
	Ed Kaiser , Alex Olwal , David McGee , Hrvoje Benko , Andrea Corradini , Xiaoguang Li , Phil Cohen , Steven Feiner, Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Ed Kaiser , David Demirdjian , Alexander Gruenstein , Xiaoguang Li , John Niekrasz , Matt Wesson , Sanjeev Kumar, A multimodal learning interface for sketch, speak and point creation of a schedule chart, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Kenneth D. Forbus , Jeffrey Usher , Vernell Chapman, Qualitative spatial reasoning about sketch maps, AI Magazine, v.25 n.3, p.61-72, Fall 2004
	Anind K. Dey , Jennifer Mankoff, Designing mediation for context-aware applications, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.53-80, March 2005
	David R. McGee , Philip R. Cohen , R. Matthews Wesson , Sheilah Horman, Comparing paper and tangible, multimodal tools, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA
	Rémi Bastide , David Navarre , Philippe Palanque , Amélie Schyn , Pierre Dragicevic, A model-based approach for real-time embedded multimodal systems in military aircrafts, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Jacob Eisenstein , Randall Davis, Visual and linguistic information in gesture classification, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Benfang Xiao , Rebecca Lunsford , Rachel Coulston , Matt Wesson , Sharon Oviatt, Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Norbert Pfleger, Context based multimodal fusion, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Matthias Jöst , Jochen Häußler , Matthias Merdes , Rainer Malaka, Multimodal interaction for pedestrians: an evaluation study, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
	Rainer Wasinger , Antonio Krüger, Modality preferences in mobile and instrumented environments, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia
	Rainer Wasinger , Antonio Krüger, Modality preferences in mobile and instrumented environments, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia
	Rajeev Sharma , Michael Zeller , Vladimir I. Pavlovic , Thomas S. Huang , Zion Lo , Stephen Chu , Yunxin Zhao , James C. Phillips , Klaus Schulten, Speech/Gesture Interface to a Visual-Computing Environment, IEEE Computer Graphics and Applications, v.20 n.2, p.29-37, March 2000
	Nadjet Kamel, Utilisation de SMV pour la vérification de propriétés d'IHM multimodales, Proceedings of the 16th conference on Association Francophone d'Interaction Homme-Machine, p.219-222, August 30-September 03, 2004, Namur, Belgium
	Joyce Chai, Semantics-based representation for multimodal interpretation in conversational systems, Proceedings of the 19th international conference on Computational linguistics, p.1-7, August 24-September 01, 2002, Taipei, Taiwan
	Joyce Y. Chai , Pengyu Hong , Michelle X. Zhou, Combining semantic and temporal constraints for multimodal integration in conversation systems, Proceedings of the HLT-NAACL 2003 workshop on Research directions in dialogue processing, p.1-3, May 31, 2003, Edmonton, Alberta, Canada
	Jullien Bouchet , Laurence Nigay , Didier Balzagette, ICARE: a component-based approach for multimodal interaction, Proceedings of the 1st French-speaking conference on Mobility and ubiquity computing, June 01-03, 2004, Nice, France
	R. Y. Fu , H. Su , J. C. Fletcher , W. Li , X. X. Liu , S. W. Zhao , C. Y. Chi, A framework for device capability on demand and virtual device user experience, IBM Journal of Research and Development, v.48 n.5/6, p.635-648, September/November 2004
	Sharon Oviatt, Advances in the robust processing of multimodal speech and pen systems, Multimodal interface for human-machine communication, World Scientific Publishing Co., Inc., River Edge, NJ, 2002
	Paulo Barthelmess , Ed Kaiser , Xiao Huang , David Demirdjian, Distributed pointing for multimodal collaboration over sketched diagrams, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy
	Jayakumar S. Kandhasamy , Ming Xie, From text to images through meanings, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.222-227, June 03-05, 2005, Singapore
	Andrea Corradini , Manish Mehta , Niels-Ole Bernsen , Marcela Charfuelan, Animating an interactive conversational character for an educational game system, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
	Sharon Oviatt, Designing robust multimodal systems for universal access, Proceedings of the 2001 EC/NSF workshop on Universal accessibility of ubiquitous computing: providing for the elderly, May 22-25, 2001, Alcácer do Sal, Portugal
	Amanda Stent , John Dowding , Jean Mark Gawron , Elizabeth Owen Bratt , Robert Moore, The CommandTalk spoken dialogue system, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.183-190, June 20-26, 1999, College Park, Maryland
	David M. Krum , Olugbenga Omoteso , William Ribarsky , Thad Starner , Larry F. Hodges, Evaluation of a multimodal interface for 3D terrain visualization, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
	Ronnie Taib , Yu Shi , Eric Choi , Fang Chen , Matthew Sladescu , Nhan Phung, Multimodal user interface facilitating critical data entry for traffic incident management, Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop, p.55-59, September 13, 2005, Sydney, Australia
	Oliver Kaufmann , Andreas Lorenz , Reinhard Oppermann , Alex Schneider , Markus Eisenhauer , Andreas Zimmermann, Implicit interaction for pro-active assistance in a context-adaptive warehouse application, Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology, September 10-12, 2007, Singapore
	Paulo Barthelmess , Edward Kaiser , Rebecca Lunsford , David McGee , Philip Cohen , Sharon Oviatt, Human-centered collaborative interaction, Proceedings of the 1st ACM international workshop on Human-centered multimedia, October 27-27, 2006, Santa Barbara, California, USA
	Joyce Y. Chai , Shaolin Qu, A salience driven approach to robust input interpretation in multimodal conversational systems, Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, p.217-224, October 06-08, 2005, Vancouver, British Columbia, Canada
	Edward Tse , Chia Shen , Saul Greenberg , Clifton Forlines, Enabling interaction with single user applications through speech and gestures on a multi-user tabletop, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy
	Robert Zeleznik , Timothy Miller, Fluid inking: augmenting the medium of free-form inking with gestures, Proceedings of the 2006 conference on Graphics interface, June 07-09, 2006, Quebec, Canada
	Jacob Eisenstein , Randall Davis, Visual and linguistic information in gesture classification, ACM SIGGRAPH 2006 Courses, July 30-August 03, 2006, Boston, Massachusetts
	Paulo Barthelmess , Edward Kaiser , Xiao Huang , David McGee , Philip Cohen, Collaborative multimodal photo annotation over digital paper, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Edward Tse , Saul Greenberg , Chia Shen, GSI demo: multiuser gesture/speech interaction over digital tables by wrapping single user applications, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Edward C. Kaiser, Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Joyce Y. Chai , Pengyu Hong , Michelle X. Zhou , Zahar Prasov, Optimization in multimodal interpretation, Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p.1-es, July 21-26, 2004, Barcelona, Spain
	Andreas J. Schmid , Martin Hoffmann , Heinz Woern, A tactile language for intuitive human-robot communication, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan
	Jacob Eisenstein , Randall Davis, Visual and linguistic information in gesture classification, ACM SIGGRAPH 2007 courses, August 05-09, 2007, San Diego, California
	Li Li , Wu Chou, Towards a minimalist multimodal dialogue framework using recursive MVC pattern, Proceedings of the 10th international conference on Multimodal interfaces, October 20-22, 2008, Chania, Crete, Greece
	Shaolin Qu , Joyce Y. Chai, Beyond attention: the role of deictic gesture in intention recognition in multimodal conversational interfaces, Proceedings of the 13th international conference on Intelligent user interfaces, January 13-16, 2008, Gran Canaria, Spain
	A. Adler , R. Davis, Speech and sketching: an empirical study of multimodal interaction, Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling, August 02-03, 2007, Riverside, California
	Edward Tse , Saul Greenberg , Chia Shen , Clifton Forlines , Ryo Kodama, Exploring true multi-user multimodal interaction over a digital table, Proceedings of the 7th ACM conference on Designing interactive systems, p.109-118, February 25-27, 2008, Cape Town, South Africa
	Bruno Dumas , Denis Lalanne , Dominique Guinard , Reto Koenig , Rolf Ingold, Strengths and weaknesses of software architectures for the rapid creation of tangible and multimodal interfaces, Proceedings of the 2nd international conference on Tangible and embedded interaction, February 18-20, 2008, Bonn, Germany
	Emiliano Castellina , Fulvio Corno , Paolo Pellegrino, Integrated speech and gaze control for realistic desktop environments, Proceedings of the 2008 symposium on Eye tracking research & applications, March 26-28, 2008, Savannah, Georgia
	Jan Kleindienst , Tomáš Macek , Ladislav Serédi , Jan Šedivý, Interaction framework for home environment using speech and vision, Image and Vision Computing, v.25 n.12, p.1836-1847, December, 2007
	Susumu Harada , T. Scott Saponas , James A. Landay, Voicepen: augmenting pen input with simultaneous non-linguisitic vocalization, Proceedings of the 9th international conference on Multimodal interfaces, November 12-15, 2007, Nagoya, Aichi, Japan
	Alejandro Jaimes , Nicu Sebe, Multimodal human-computer interaction: A survey, Computer Vision and Image Understanding, v.108 n.1-2, p.116-134, October, 2007
	EDWARD TSE , SAUL GREENBERG , CHIA SHEN , CLIFTON FORLINES, Multimodal multiplayer tabletop gaming, Computers in Entertainment (CIE), v.5 n.2, April/June 2007
	D. Wilson , J. Doyle , J. Weakliam , M. Bertolotto , D. Lynch, Personalised maps in multimodal mobile GIS, International Journal of Web Engineering and Technology, v.3 n.2, p.196-216, January 2007
	Maria Chiara Caschera , Fernando Ferri , Patrizia Grifoni, Multimodal interaction systems: information and time features, International Journal of Web and Grid Services, v.3 n.1, p.82-99, March 2007
	Minkyung Lee , Mark Billinghurst, A Wizard of Oz study for an AR multimodal interface, Proceedings of the 10th international conference on Multimodal interfaces, October 20-22, 2008, Chania, Crete, Greece
	Sharon Oviatt , Phil Cohen , Lizhong Wu , John Vergo , Lisbeth Duncan , Bernhard Suhm , Josh Bers , Thomas Holzman , Terry Winograd , James Landay , Jim Larson , David Ferro, Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions, Human-Computer Interaction, v.15 n.4, p.263-322, December 2000
	T. M. Sezgin , R. Davis, Sketch recognition in interspersed drawings using time-based graphical models, Computers and Graphics, v.32 n.5, p.500-510, October, 2008
	Augmented reality bibliography, ACM SIGGRAPH ASIA 2008 courses, p.1-17, December 10-13, 2008, Singapore
	Mohammad M. Alsuraihi , Dimitris I. Rigas, How effective is it to design by voice?, Proceedings of the 21st British HCI Group Annual Conference on HCI 2008: People and Computers XXI: HCI...but not as we know it, September 03-07, 2007, University of Lancaster, United Kingdom
	Kenneth D. Forbus , Jeffrey Usher , Emmett Tomai, Analogical learning of visual/conceptual relationships in sketches, Proceedings of the 20th national conference on Artificial intelligence, p.202-208, July 09-13, 2005, Pittsburgh, Pennsylvania
	Sylvia Irawati , Scott Green , Mark Billinghurst , Andreas Duenser , Heedong Ko, "Move the couch where?": developing an augmented reality multimodal interface, Proceedings of the 2006 Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'06), p.183-186, October 22-25, 2006
	Joyce Y. Chai , Zahar Prasov , Shaolin Qu, Cognitive principles in robust multimodal interpretation, Journal of Artificial Intelligence Research, v.27 n.1, p.55-83, September 2006
	Jacob Eisenstein , Regina Barzilay , Randall Davis, Gesture salience as a hidden variable for coreference resolution and keyframe extraction, Journal of Artificial Intelligence Research, v.31 n.1, p.353-398, January 2008
	Gal A. Kaminka , David V. Pynadath , Milind Tambe, Monitoring teams by overhearing: a multi-agent plan-recognition approach, Journal of Artificial Intelligence Research, v.17 n.1, p.83-135, July 2002
	Don Willems , Ralph Niels , Marcel van Gerven , Louis Vuurpijl, Iconic and multi-stroke gesture recognition, Pattern Recognition, v.42 n.12, p.3303-3312, December, 2009
	Ben Bostwick , Edgar Seemann, Flexi-Modal and Multi-Machine User Interfaces, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.343, October 14-16, 2002
	Joyce Chai , Shimei Pan , Michelle X. Zhou , Keith Houck, Context-Based Multimodal Input Understanding in Conversational Systems, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.87, October 14-16, 2002
	Philip R. Cohen, Multimodal interaction: a new focal area for AI, Proceedings of the 17th international joint conference on Artificial intelligence, p.1467-1473, August 04-10, 2001, Seattle, WA, USA
	Andrea Corradini , Richard M. Wesson , Philip R. Cohen, A Map-Based System Using Speech and 3D Gestures for Pervasive Computing, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.191, October 14-16, 2002
	Philip R. Cohen , Rachel Coulston , Kelly Krout, Multimodal Interaction During Multiparty Dialogues: Initial Results, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.448, October 14-16, 2002
	Jean-Yves Lionel Lawson , Ahmad-Amr Al-Akkad , Jean Vanderdonckt , Benoit Macq, An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components, Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, July 15-17, 2009, Pittsburgh, PA, USA
	Robert Rasch , Alexander Kott , Kenneth D. Forbus, AI on the battlefield: an experimental exploration, Proceedings of the 14th conference on Innovative applications of artificial intelligence, p.906-912, July 28-August 01, 2002, Edmonton, Alberta, Canada