Wizard of Oz studies

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Wizard of Oz studies: why and how

Full text

Pdf (1.07 MB)

Source

International Conference on Intelligent User Interfaces archive
Proceedings of the 1st international conference on Intelligent user interfaces table of contents

Orlando, Florida, United States

Pages: 193 - 200

Year of Publication: 1993

ISBN:0-89791-556-9

Authors

Nils Dahlbäck	Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden
Arne Jönsson	Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden
Lars Ahrenberg	Natural Language Processing Laboratory, Department of Computer and Information Science, S-581 83 LINKÖPING, Sweden

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction
BCS-HCI Group : BCS/Human Computer Interaction Group
AAAI : Am Assoc for Artifical Intelligence
SIGART: ACM Special Interest Group on Artificial Intelligence

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 41, Downloads (12 Months): 226, Citation Count: 62

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/169891.169968 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Ahrenberg, Lars, Ame JOnsson & Nils Dahlb~ick (1990) Discourse Representation and Discourse Management for Natural Language Interfaces, Proceedings of the Second Nordic Conference on Text Comprehension in Man and Machine, T~iby, Stockholm.
	2	Clark, Herbert H. & Catherine Marshall (1981) Definite Reference and Mutual Knowledge. In Josh, Aravind, Webber, Bonnie, and Sag, Ivan (eds.) Elements of Discourse Understanding. Cambridge, Mass.: Cambridge University Press.
	3	Philip R. Cohen, The pragmatics of referring and the modality of communication, Computational Linguistics, v.10 n.2, p.97-146, April-June 1984
	4	Dahlb~tck, Nils (1991a) Empirical Analysis of a Discourse Model for Natural Language Interfaces, Proceedings of the Thirteenth Annual Meeting of The Cognitive Science SocieO~, Chicago, Illinois.
	5	Dahlb~ick, Nils, (199 lb) Representations of Discourse, Cognitive and Computational Aspects, PhD-thesis, Link6ping University.
	6	Dahlb~ick, Nils (1992) Pronoun usage in NLI-dialogues: A Wizard of Oz study. To appear in Papers from the Third Nordic Conference on Text Comprehension in Man and Machine, Link0ping April, 21-23, 1992.
	7	Nils Dahlbäck , Arne Jönsson, Empirical studies of discourse representations for natural language interfaces, Proceedings of the fourth conference on European chapter of the Association for Computational Linguistics, p.291-298, April 10-12, 1989, Manchester, England [doi>10.3115/976815.976854]
	8	Dahlback, Nils & Ame JOnsson (1992) An empirically based computationally tractable dialogue model, Proceedings of the Fourteenth Annual Meeting of The Cognitive Science Society, Bloomington, Indiana.
	9	Fraser, Norman & Nigel S. Gilbert (1991) Simulating speech systems, Computer Speech and Language, 5, pp 81-99.
	10	Gal, Annie (1988) Cooperative responses in Deductive Databases. Phi) Thesis, Department of Computer Science, University of Maryland, College Park.
	11	Barbara Jean Grosz, The representation and use of focus in dialogue understanding., 1977
	12	Barbara J. Grosz , Martha E. Pollack , Candace L. Sidner, Discourse, Foundations of cognitive science, MIT Press, Cambridge, MA, 1989
	13	Guindon, Raymonde (1988) A multidisciplin~ perspective on dialogue structure in user-advisor dialogues. in Guindon, Raymoned (ed.) Cognitive Science and its Applications for Human-Computer Interaction. Hillsdale, N.J.: Erlbaum.
	14	Jarke, M., Krause, J., Vassiliou, Y., Stohr, E., Turner, J. & White, N. (1985) Evaluation and assessment of domain-independent natural language query systems, IEEE quarterly bulletin on Database Engineering, Vol. 8, No. 3, Sept.
	15	Arne Jönsson, A dialogue manager using initiative-response units and distributed control, Proceedings of the fifth conference on European chapter of the Association for Computational Linguistics, p.233-238, April 09-11, 1991, Berlin, Germany [doi>10.3115/977180.977221]
	16	JOnsson, Ame & Nils Dahlbltck (1988) Talking to a Computer is not Like Talking to Your Best Friend. Proceedings of The first Scandinivian Conference on Artificial Intelligence, Tromso, Norway.
	17	Kennedy, A., Wilkes, A., Elder, L. & Murray, W. (1988) Dialogue with machines. Cognition, 30, 73-105.
	18	Lakoff, R.T. (1973) The Logic of Politeness; or minding your p's and q's. Papers from the Ninth Regional Meeting, Chicago Linguistic Society, pp 292-305.
	19	Pylyshyn, Zenon (1984) Computation and Cognition, Cambridge MA: The M1T Press
	20	Rachel Reichman, Getting computers to talk like you and me, MIT Press, Cambridge, MA, 1985
	21	Shatz, M. & Gelman, R. The development of communication skills' Modifications in the speech of young children as a function of listener. Monographs of the Society for research in child development.38, No 152.
	22	Harry Ralph Tennant, Evaluation of natural language processors, 1981

CITED BY 62

	Scott R. Klemmer , Anoop K. Sinha , Jack Chen , James A. Landay , Nadeem Aboobaker , Annie Wang, Suede: a Wizard of Oz prototyping tool for speech user interfaces, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.1-10, November 06-08, 2000, San Diego, California, United States
	Ivan Bretan , Anna-Lena Ereback , Catriona MacDermid , Annika Waern, Simulation-based dialogue design for speech-controlled telephone services, Conference companion on Human factors in computing systems, p.145-146, May 07-11, 1995, Denver, Colorado, United States
	Michael Ericsson , Magnus Baurén , Jonas Löwgren , Yvonne Wærn, A study of commenting agents as design support, CHI 98 conference summary on Human factors in computing systems, p.225-226, April 18-23, 1998, Los Angeles, California, United States
	David Maulsby , Saul Greenberg , Richard Mander, Prototyping an intelligent agent through Wizard of Oz, Proceedings of the SIGCHI conference on Human factors in computing systems, p.277-284, April 24-29, 1993, Amsterdam, The Netherlands
	Jennifer Lai , Nicole Yankelovich, Conversational speech interfaces, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Benoît Lemaire , Johanna Moore, An improved interface for tutorial dialogues: browsing a visual dialogue history, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.16-22, April 24-28, 1994, Boston, Massachusetts, United States
	Sharon Oviatt, Multimodal interfaces, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
	Yvonne Wærn , Sture Hägglund, Communication and cognitive science research in Linköping, Conference companion on Human factors in computing systems, p.167-168, April 24-28, 1994, Boston, Massachusetts, United States
	Gerd Andersson , Kristina Höök , Dário Mourão , Ana Paiva , Marco Costa, Using a Wizard of Oz study to inform the design of SenToy, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England
	Ana Paiva , Marco Costa , Ricardo Chaves , Moisés Piedade , Dário Mourão , Daniel Sobral , Kristina Höök , Gerd Andersson , Adrian Bullock, SenToy: an affective sympathetic interface, International Journal of Human-Computer Studies, v.59 n.1-2, p.227-235, July 2003
	Ana Paiva , Rui Prada , Ricardo Chaves , Marco Vala , Adrian Bullock , Gerd Andersson , Kristina Höök, Towards tangibility in gameplay: building a tangible affective interface for a computer game, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
	Agnes Lisowska, Multimodal interface design for multimodal meeting content retrieval, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
	Johanna Höysniemi , Anne Aula , Petra Auvinen , Jaana Hännikäinen , Perttu Hämäläinen, Shadow boxer: a physically interactive fitness game, Proceedings of the third Nordic conference on Human-computer interaction, p.389-392, October 23-27, 2004, Tampere, Finland
	Jaya Vaidyanathan , Jason E. Robbins , David F. Redmiles, Using HTML to create early prototypes, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania
	Yang Li , Jason I. Hong , James A. Landay, Topiary: a tool for prototyping location-enhanced applications, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA
	Mikael Drugge , Marcus Nilsson , Roland Parviainen , Peter Parnes, Experiences of using wearable computers for ambient telepresence and remote interaction, Proceedings of the 2004 ACM SIGMM workshop on Effective telepresence, October 15-15, 2004, New York, NY, USA
	Johanna Höysniemi , Perttu Hämäläinen , Laura Turkki, Wizard of Oz prototyping of computer vision based action games for children, Proceeding of the 2004 conference on Interaction design and children: building a community, p.27-34, June 01-03, 2004, Maryland
	Kevin F. White , Wayne G. Lutters, Behind the curtain: lessons learned from a Wizard of Oz field experiment, ACM SIGGROUP Bulletin, v.24 n.3, December 2003
	Stephen Voida , Mark Podlaseck , Rick Kjeldsen , Claudio Pinhanez, A study on the manipulation of 2D objects in a projector/camera-based augmented reality environment, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA
	James Allan , Ben Carterette , Joshua Lewis, When will information retrieval be "good enough"?, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil
	James Fogarty , Scott E. Hudson , Christopher G. Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny C. Lee , Jie Yang, Predicting human interruptibility with sensors, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.119-146, March 2005
	Yang Li , Evan Welbourne , James A. Landay, Design and experimental analysis of continuous location tracking techniques for Wizard of Oz testing, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada
	Steven Dow , T. Scott Saponas , Yang Li , James A. Landay, External representations in ubiquitous computing design and the implications for design tools, Proceedings of the 6th ACM conference on Designing Interactive systems, June 26-28, 2006, University Park, PA, USA
	Richard Catrambone , John Stasko , Jun Xiao, ECA as user interface paradigm, From brows to trust: evaluating embodied conversational agents, Kluwer Academic Publishers, Norwell, MA, 2004
	Kristina Höök, User-centred design and evaluation of affective interfaces, From brows to trust: evaluating embodied conversational agents, Kluwer Academic Publishers, Norwell, MA, 2004
	I. Scott MacKenzie , Janet C. Read, Using paper mockups for evaluating soft keyboard layouts, Proceedings of the 2007 conference of the center for advanced studies on Collaborative research, October 22-25, 2007, Richmond Hill, Ontario, Canada
	David Akers, CINCH: a cooperatively designed marking interface for 3D pathway selection, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland
	Timothy Bickmore , Toni Giorgino, Health dialog systems for patients and consumers, Journal of Biomedical Informatics, v.39 n.5, p.556-571, October 2006
	Fiorella de Rosis , Nicole Novielli , Valeria Carofiglio , Addolorata Cavalluzzi , Berardina De Carolis, User modeling and adaptation in health promotion dialogs with an animated character, Journal of Biomedical Informatics, v.39 n.5, p.514-531, October 2006
	Anders I. Mørch , Jan A. Dolonen , Jan Eirik B. Nævdal, An evolutionary approach to prototyping pedagogical agents: from simulation to integrated system, Journal of Network and Computer Applications, v.29 n.2, p.177-199, April 2006
	Arjan Geven , Johann Schrammel , Manfred Tscheligi, Interacting with embodied agents that can see: how vision-enabled agents can assist in spatial tasks, Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, p.135-144, October 14-18, 2006, Oslo, Norway
	Alice Kerly , Phil Hall , Susan Bull, Bringing chatbots into education: Towards natural language negotiation of open learner models, Knowledge-Based Systems, v.20 n.2, p.177-185, March, 2007
	Marie-Luce Bourguet, Towards a taxonomy of error-handling strategies in recognition-based multi-modal human-computer interfaces, Signal Processing, v.86 n.12, p.3625-3643, December 2006
	Miroslav Melichar , Pavel Cenek, From vocal to multimodal dialogue management, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Cosmin Munteanu , Gerald Penn , Ron Baecker , Yuecheng Zhang, Automatic speech recognition for webcasts: how good is good enough and what to do when it isn't, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
	Jean Scholtz, Metrics for evaluating human information interaction systems, Interacting with Computers, v.18 n.4, p.507-527, July, 2006
	Marita Ailomaa , Miroslav Melichar , Martin Rajman , Agnes Lisowska , Susan Armstrong, Archivus: a multimodal system for multimedia meeting browsing and retrieval, Proceedings of the COLING/ACL on Interactive presentation sessions, p.49-52, July 17-18, 2006, Sydney, Australia
	Richard C. Davis , T. Scott Saponas , Michael Shilman , James A. Landay, SketchWizard: Wizard of Oz prototyping of pen-based user interfaces, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA
	Alan L. Liu , Yang Li, BrickRoad: a light-weight tool for spontaneous design of location-enhanced applications, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA
	Nina Wacholder , Diane Kelly , Paul Kantor , Robert Rittman , Ying Sun , Bing Bai , Sharon Small , Boris Yamrom , Tomek Strzalkowski, A model for quantitative evaluation of an end-to-end question-answering system, Journal of the American Society for Information Science and Technology, v.58 n.8, p.1082-1099, June 2007
	Ana Paiva , Gerd Andersson , Kristina Höök , Dário Mourão , Marco Costa , Carlos Martinho, SenToy in FantasyA: Designing an Affective Sympathetic Interface to a Computer Game, Personal and Ubiquitous Computing, v.6 n.5-6, p.378-389, December 2002
	Jasper Lindenberg , Wouter Pasman , Kim Kranenborg , Joris Stegeman , Mark A. Neerincx, Improving service matching and selection in ubiquitous computing environments: a user study, Personal and Ubiquitous Computing, v.11 n.1, p.59-68, October 2006
	Anders I. Mørch , Silje Jondahl , Jan A. Dolonen, Supporting Conceptual Awareness with Pedagogical Agents, Information Systems Frontiers, v.7 n.1, p.39-53, January 2005
	Nuno Otero , Aris Alissandrakis , Kerstin Dautenhahn , Chrystopher Nehaniv , Dag Sverre Syrdal , Kheng Lee Koay, Human to robot demonstrations of routine home tasks: exploring the role of the robot's feedback, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands
	Jun Xiao , John Stasko , Richard Catrambone, An Empirical Study of the Effect of Agent Competence on User Performance and Perception, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, p.178-185, July 19-23, 2004, New York, New York
	Jens Edlund , Joakim Gustafson , Mattias Heldner , Anna Hjalmarsson, Towards human-like spoken dialogue systems, Speech Communication, v.50 n.8-9, p.630-645, August, 2008
	Paul Wais , Aaron Wolin , Christine Alvarado, Designing a sketch recognition front-end: user perception of interface elements, Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling, August 02-03, 2007, Riverside, California
	Brian P. Bailey , Jacob T. Biehl , Damon J. Cook , Heather E. Metcalf, Adapting paper prototyping for designing user interfaces for multiple display environments, Personal and Ubiquitous Computing, v.12 n.3, p.269-277, January 2008
	Hilary Davis , Mikael B. Skov , Malthe Stougaard , Frank Vetere, Virtual box: supporting mediated family intimacy through virtual and physical play, Proceedings of the 2007 conference of the computer-human interaction special interest group (CHISIG) of Australia on Computer-human interaction: design: activities, artifacts and environments, November 28-30, 2007, Adelaide, Australia
	Pedro Ferreira , Pedro Sanches , Kristina Höök , Tove Jaensson, License to chill!: how to empower users to cope with stress, Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges, October 20-22, 2008, Lund, Sweden
	Nuno Otero , Joe Saunders , Kerstin Dautenhahn , Chrystopher L. Nehaniv, Teaching robot companions: the role of scaffolding and event structuring, Connection Science, v.20 n.2-3, p.111-134, June 2008
	Yang Li , Jason I. Hong , James A. Landay, Design Challenges and Principles for Wizard of Oz Testing of Location-Enhanced Applications, IEEE Pervasive Computing, v.6 n.2, p.70-75, April 2007
	Phil Cohen , Colin Swindells , Sharon Oviatt , Alex Arthur, A high-performance dual-wizard infrastructure for designing speech, pen, and multimodal interfaces, Proceedings of the 10th international conference on Multimodal interfaces, October 20-22, 2008, Chania, Crete, Greece
	Jeni Paay , Jesper Kjeldskov, Understanding the user experience of location-based services: five principles of perceptual organisation applied, Journal of Location Based Services, v.2 n.4, p.267-286, December 2008
	Ana Ramírez Chang , John Canny, Illuminac: simultaneous naming and configuration for workspace lighting control, Proceedings of the 13th international conference on Intelligent user interfaces, February 08-11, 2009, Sanibel Island, Florida, USA
	S. Quarteroni , S. Manandhar, Designing an interactive open-domain question answering system, Natural Language Engineering, v.15 n.1, p.73-95, January 2009
	Elizabeth S. Kim , Dan Leyzberg , Katherine M. Tsui , Brian Scassellati, How people talk when teaching a robot, Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, March 09-13, 2009, La Jolla, California, USA
	Daniel Schulman , Timothy Bickmore, Persuading users through counseling dialogue with a conversational agent, Proceedings of the 4th International Conference on Persuasive Technology, April 26-29, 2009, Claremont, California
	Jeni Paay , Jesper Kjeldskov , Steve Howard , Bharat Dave, Out on the town: A socio-physical approach to the design of a context-aware urban guide, ACM Transactions on Computer-Human Interaction (TOCHI), v.16 n.2, p.1-34, June 2009
	Marilyn Rose McGee-Lennon , Andrew Ramsay , David McGookin , Philip Gray, User evaluation of OIDE: a rapid prototyping platform for multimodal interaction, Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, July 15-17, 2009, Pittsburgh, PA, USA
	Diane Kelly, Methods for Evaluating Interactive Information Retrieval Systems with Users, Foundations and Trends in Information Retrieval, v.3 n.1—2, p.1-224, January 2009
	Anoop K. Sinha , James A. Landay, Embarking on Multimodal Interface Design, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.355, October 14-16, 2002