User-created forms as an effective method of human-agent communication

ABSTRACT

A key challenge for mixed-initiative systems is to create a shared understanding of the task between human and agent. To address this challenge, we created a mixed-initiative interface called Mixer to aid administrators with automating tedious information-retrieval tasks. Users initiate communication with the agent by constructing a form, creating a structure to hold the information they require and to show context in order to interpret this information. They then populate the form with the desired results, demonstrating to the agent the steps required to retrieve the information. This method of form creation explicitly defines the shared understanding between human and agent. An evaluation of the interface shows that administrators can effectively create forms to communicate with the agent, that they are likely to accept this technology in their work environment, and that the agent's help can significantly reduce the time they spend on repeated information-retrieval tasks.

REFERENCES

• 1: Allen, J., Chambers, N., Ferguson, G., Galescu, L., Jung, H., Swift, M., Taysom, W. PLOW: A Collaborative Task Learning Agent. Proc. of AAAI (2007).
• 2: Alterman, R., Feinman, A., Introne, J. and Landsman, S. Coordinating Representations in Computer-Mediated Joint Activities. In Proc. of the Conference of the Cognitive Science Society (2001).
• 3: Sara Bly , Elizabeth F. Churchill, Design through matchmaking: technology in search of users, interactions, v.6 n.2, p.23-31, March/April 1999 [doi>10.1145/296165.296174]
• 4: Bresina, J. L. and Morris, P. H. Mixed-Initiative Planning in Space Mission Operations. AI Magazine, 28, 2 (2007), 75--89.
• 5: Burstein, M. H. and Diller, D. E. Cooperative Information Sharing Among Mixed-Initiative Human/Agent Teams. In Proc. of the Conference on Artificial Intelligence, (2003).
• 6: Burstein, M., Laddaga, R., McDonald, D., Cox, M., Benyo, B., Robertson, P., Hussain, T., Brinn, M. and McDermott, D. POIROT: Integrated Learning of Web Service Procedures. Proc. of AAAI (2008).
• 7: Allen Cypher, Eager: programming repetitive tasks by demonstration, Watch what I do: programming by demonstration, MIT Press, Cambridge, MA, 1993
• 8: Davis, F. D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly, 13, 3 (Sept 1989), 319--340.
• 9: Alan Dix , Roberta Mancini , Stefano Levialdi, Communication, action and history, Proceedings of the SIGCHI conference on Human factors in computing systems, p.542-543, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.259023]
• 10: Fischer, G. and Giaccardi, E. Meta-Design: A Framework for the Future of End User Development. In End User Development: Empowering People to Flexibly Employ Advanced Information and Communication Technology. Kluwer Academic Publishers, 2006, 427--457.
• 11: James Fogarty , Scott E. Hudson , Christopher G. Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny C. Lee , Jie Yang, Predicting human interruptibility with sensors, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.119-146, March 2005 [doi>10.1145/1057237.1057243]
• 12: Freed, M., Carbonell, J., Gordon, G., Hayes, J., Myers, B., Siewiorek, D., Smith, S., Steinfeld, A., Tomasic, A. RADAR: A Personal Assistant that Learns to Reduce Email Overload. In Proc. of AAAI Conference on Artificial Intelligence, (2008)
• 13: Mixed-Initiative Interaction, IEEE Intelligent Systems, v.14 n.5, p.14-23, September 1999 [doi>10.1109/5254.796083]
• 14: Eric Horvitz, Principles of mixed-initiative user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.159-166, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303030]
• 15: Horvitz, E. Reflections on Challenges and Promises of Mixed-Initiative Interaction. AAAI Magazine, 28(2007).
• 16: David S. Kosbie , Brad A. Myers, A system-wide macro facility based on aggregate events: a proposal, Watch what I do: programming by demonstration, MIT Press, Cambridge, MA, 1993
• 17: Gilly Leshed , Eben M. Haber , Tara Matthews , Tessa Lau, CoScripter: automating & sharing how-to knowledge in the enterprise, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357323]
• 18: Thomas W. Malone , Kenneth R. Grant , Kum-Yew Lai , Ramana Rao , David Rosenblitt, Semistructured messages are surprisingly useful for computer-supported coordination, ACM Transactions on Information Systems (TOIS), v.5 n.2, p.115-131, April 1987 [doi>10.1145/27636.27637]
• 19: Brad Myers , Scott E. Hudson , Randy Pausch, Past, present, and future of user interface software tools, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.3-28, March 2000 [doi>10.1145/344949.344959]
• 20: Bonnie A. Nardi, A small matter of programming: perspectives on end user computing, MIT Press, Cambridge, MA, 1993
• 21: Tecuci, G., Boicu, M. and Cox, M. T. Seven Aspects of Mixed-Initiative Reasoning: An Introduction to the Special Issue on Mixed-Initiative Assistants. AI Magazine, 28, 2 (2007), 11.
• 22: Tomasic, A., Zimmerman, J., Hargraves, I., McMullen, R. User Constructed Data Integration via Mixed Initiative Design. In Proc. of AAAI, Spring Symposium, (2007).
• 23: Rattapoom Tuchinda , Pedro Szekely , Craig A. Knoblock, Building data integration queries by demonstration, Proceedings of the 12th international conference on Intelligent user interfaces, January 28-31, 2007, Honolulu, Hawaii, USA [doi>10.1145/1216295.1216328]
• 24: John Zimmerman , Jodi Forlizzi , Shelley Evenson, Research through design as a method for interaction design research in HCI, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240704]
• 25: John Zimmerman , Anthony Tomasic , Isaac Simmons , Ian Hargraves , Ken Mohnkern , Jason Cornwell , Robert Martin McGuire, Vio: a mixed-initiative approach to learning and automating procedural update tasks, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240843]
• 26: M. M. Zloof, QBE/OBE: A Language for Office and Business Automation, Computer, v.14 n.5, p.13-22, May 1981 [doi>10.1109/C-M.1981.220446]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors

Keywords:
agents, information retrieval, interaction design, mixed-initiative