Perceptual user interfaces: multimodal interfaces that process what comes naturally

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Perceptual user interfaces: multimodal interfaces that process what comes naturally

Full text

Html (38 KB), Pdf

Pdf (256 KB)

Source

Communications of the ACM archive
Volume 43 , Issue 3 (March 2000) table of contents

Pages: 45 - 53

Year of Publication: 2000

ISSN:0001-0782

Authors

Sharon Oviatt	Oregon Graduate Institute of Science and Technology
Philip Cohen	Oregon Graduate Institute of Science and Technology

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 21, Downloads (12 Months): 249, Citation Count: 27

Additional Information:

references cited by index terms collaborative colleagues peer to peer

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/330534.330538 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
	2	Cohen, P.R., Johnston, M., McGee, D., Oviatt, S.L., Clow, J., and Smith, I. The efficiency of multimodal interaction: A case study. In Proceedings of the International Conference on Spoken Language Processing. (Sydney, 1998), 249-252.
	3	Philip R. Cohen , Michael Johnston , David McGee , Sharon Oviatt , Jay Pittman , Ira Smith , Liang Chen , Josh Clow, QuickSet: multimodal interaction for distributed applications, Proceedings of the fifth ACM international conference on Multimedia, p.31-40, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266328]
	4	Philip R. Cohen , Adam Cheyer , Michelle Wang , Soon Cheol Baeg, An open agent architecture, Readings in agents, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
	5	Michael Johnston , Philip R. Cohen , David McGee , Sharon L. Oviatt , James A. Pittman , Ira Smith, Unification-based multimodal integration, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.281-288, July 07-12, 1997, Madrid, Spain
	6	Sharon Oviatt, Mutual disambiguation of recognition errors in a multimodel architecture, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.576-583, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303163]
	7	Sharon Oviatt, Ten myths of multimodal interaction, Communications of the ACM, v.42 n.11, p.74-81, Nov. 1999 [doi>10.1145/319382.319398]
	8	Oviatt, S.L. Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12, (1997), 93-129.
	9	Oviatt, S.L., Cohen, P.R., Wu, L.,Vergo, J., Duncan, L., Suhm, B., Bets, J., Holzman, T., Winograd, T., Landay, J., Larson, J. and Ferro, D. Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions for 2000 and beyond. Human-Computer Interaction in the New Millennium. J. Carroll, Ed., Addison-Wesley, Boston (in press).
	10	Rubin, P., Vatikiotis-Bateson, E., and Benoit, C., Eds. Audio-visual speech processing. Speech Communication 26, (1998), 1-2.
	11	Wu, L., Oviatt, S., and Cohen, P. Multimodal integration: A statistical view. IEEE Transactions on Multimedia 1, 4 (1999), 334-342.
	12	Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

CITED BY 27

	Henry Lieberman, Out of many, one: reliable results from unreliable recognition, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA
	Dharani Perera , R. T. Jim Eales , Kathy Blashki, Voice art: investigating paralinguistic voice as a mode of interaction to create visual art, Proceedings of the 21st British HCI Group Annual Conference on HCI 2008: People and Computers XXI: HCI...but not as we know it, September 03-07, 2007, University of Lancaster, United Kingdom
	H. Ishii , C. Ratti , B. Piper , Y. Wang , A. Biderman , E. Ben-Joseph, Bringing Clay and Sand into Digital Design — Continuous Tangible user Interfaces, BT Technology Journal, v.22 n.4, p.287-299, October 2004
	Hua Jiang , G. Drew Kessler , Jean Nonnemaker, DEMIS: a dynamic event model for interactive systems, Proceedings of the ACM symposium on Virtual reality software and technology, November 11-13, 2002, Hong Kong, China
	Ernesto Arroyo , Ted Selker, Self-adaptive multimodal-interruption interfaces, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA
	Yong Sun , Fang Chen , Vera Chung, QuickFusion: multimodal fusion without time thresholds, Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop, p.51-54, September 13, 2005, Sydney, Australia
	Philip R. Cohen , David R. McGee, Tangible multimodal interfaces for safety-critical applications, Communications of the ACM, v.47 n.1, January 2004
	Jullien Bouchet , Laurence Nigay, ICARE: a component-based approach for the design and development of multimodal interfaces, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria
	Chadwick A. Wingrave , Doug A. Bowman , Naren Ramakrishnan, Towards preferences in virtual environment interfaces, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
	Alejandro Jaimes , Nicu Sebe, Human-centered multimedia systems: tutorial overview, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany
	Michael Johnston , Srinivas Bangalore, MATCHKiosk: a multimodal interactive city guide, Proceedings of the ACL 2004 on Interactive poster and demonstration sessions, p.33-es, July 21-26, 2004, Barcelona, Spain
	Norbert Reithinger , Jan Alexandersson , Tilman Becker , Anselm Blocher , Ralf Engel , Markus Löckelt , Jochen Müller , Norbert Pfleger , Peter Poller , Michael Streit , Valentin Tschernomas, SmartKom: adaptive and flexible multimodal access to multiple applications, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Brad A. Myers , Robert C. Miller , Benjamin Bostwick , Carl Evankovich, Extending the windows desktop interface with connected handheld computers, Proceedings of the 4th conference on USENIX Windows Systems Symposium, p.8-8, August 03-04, 2000, Seattle, Washington
	Ingmar Rauschert , Pyush Agrawal , Rajeev Sharma , Sven Fuhrmann , Isaac Brewer , Alan MacEachren, Designing a human-centered, multimodal GIS interface to support emergency management, Proceedings of the 10th ACM international symposium on Advances in geographic information systems, November 08-09, 2002, McLean, Virginia, USA
	Dharani Priyahansika Perera , Jim R. T. Eales , Kathy Blashki, The drive to create: an investigation of tools to support disabled artists, Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition, June 13-15, 2007, Washington, DC, USA
	Thomas Käster , Michael Pfeiffer , Christian Bauckhage, Combining speech and haptics for intuitive and efficient navigation through image databases, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Gunther Heidemann , Ingo Bax , Holger Bekel, Multimodal interaction in an augmented reality scenario, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Joaquim A Jorge, Adaptive tools for the elderly: new devices to cope with age-induced cognitive disabilities, Proceedings of the 2001 EC/NSF workshop on Universal accessibility of ubiquitous computing: providing for the elderly, May 22-25, 2001, Alcácer do Sal, Portugal
	Stephen Boyd Davis , Huw Jones, Screen space: depiction and the space of interactive media, Proceedings of the sixth Eurographics workshop on Multimedia 2001, p.165-176, September 08-09, 2001, Manchester, UK
	Jullien Bouchet , Laurence Nigay , Didier Balzagette, ICARE: a component-based approach for multimodal interaction, Proceedings of the 1st French-speaking conference on Mobility and ubiquity computing, June 01-03, 2004, Nice, France
	Francis Quek , David McNeill , Robert Bryll , Susan Duncan , Xin-Feng Ma , Cemil Kirbas , Karl E. McCullough , Rashid Ansari, Multimodal human discourse: gesture and speech, ACM Transactions on Computer-Human Interaction (TOCHI), v.9 n.3, p.171-193, September 2002
	Helen Meng , P. C. Ching , Shuk Fong Chan , Yee Fong Wong , Cheong Chat Chan, ISIS: an adaptive, trilingual conversational system with interleaving interaction and delegation dialogs, ACM Transactions on Computer-Human Interaction (TOCHI), v.11 n.3, p.268-299, September 2004
	Julie A. Jacko , Holly S. Vitense , Ingrid U. Scott, Perceptual impairments and computing technologies, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Sharon Oviatt, Multimodal interfaces, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Francis Quek, The catchment feature model: a device for multimodal fusion and a bridge between signal and sense, EURASIP Journal on Applied Signal Processing, v.2004 n.1, p.1619-1636, 1 January 2004
	Sharon Oviatt , Phil Cohen , Lizhong Wu , John Vergo , Lisbeth Duncan , Bernhard Suhm , Josh Bers , Thomas Holzman , Terry Winograd , James Landay , Jim Larson , David Ferro, Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions, Human-Computer Interaction, v.15 n.4, p.263-322, December 2000
	Alejandro Jaimes , Nicu Sebe, Multimodal human-computer interaction: A survey, Computer Vision and Image Understanding, v.108 n.1-2, p.116-134, October, 2007