From geek to sleek: integrating task learning tools to support end users in real-world applications

ABSTRACT

Numerous techniques exist to help users automate repetitive tasks; however, none of these methods fully support end-user creation, use, and modification of the learned tasks. We present an integrated task learning system (ITL) that learns executable procedures based on user demonstration and instruction, constituting a first step toward a broader solution for procedure management. We discuss our deployment of ITL into a collaborative command-and-control system. In this complex domain, ITL's performance with end users doing real tasks indicates that providing multiple, integrated learning techniques both extends functionality and improves user experience. Our experience in integrat-ing this system also provides key insights for future designs of domain-independent task learning systems, specifically in supporting users' ability to understand and edit lengthy procedures.

REFERENCES

• 1: Allen, J. et al. PLOW: A Collaborative Task Learning Agent. Proc. AAAI 2007.
• 2: Jim Blythe, Task learning by instruction in tailor, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040874]
• 3: Burnett, M. Software Engineering for Visual Programming Languages. Handbook of Software Engineering and Knowledge Engineering, Vol. 2, World Scientific Publishing Company, June 2001.
• 4: Burstein, M., Laddaga, R., McDonald, D., Benyo, B., et al. POIROT--Integrated Learning of Web Service Procedures. Proc. AAAI-08.
• 5: Command Post of the Future (CPOF) http://www.darpa.gov/sto/strategic/cpof.html
• 6: Allen Cypher , Daniel C. Halbert , David Kurlander , Henry Lieberman , David Maulsby , Brad A. Myers , Alan Turransky, Watch what I do: programming by demonstration, MIT Press, Cambridge, MA, 1993
• 7: Jason Dedrick , Vijay Gurbaxani , Kenneth L. Kraemer, Information technology and economic performance: A critical review of the empirical evidence, ACM Computing Surveys (CSUR), v.35 n.1, p.1-28, March 2003 [doi>10.1145/641865.641866]
• 8: Gervasio, M., Lee, T. J., and Eker, S. Learning Email Procedures for the Desktop. Proc. AAAI 2008 Workshop on Enhanced Messaging.
• 9: Huffman, S. and Laird, J. Flexibly Instructable Agents, Journal of AI Research, 3, 1995
• 10: Lerman, K., Plangrasopchok, A. and Knoblock, C. Semantic Labelling of Online Information Sources, IJSWIS 2007.
• 11: Lieberman, H. (Ed.). Your Wish is My Command: Programming by Example. Morgan Kaufmann, San Francisco, CA, 2001.
• 12: David Morley , Karen Myers, The SPARK Agent Framework, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, p.714-721, July 19-23, 2004, New York, New York [doi>10.1109/AAMAS.2004.267]
• 13: Bonnie A. Nardi, A Small Matter of Programming: Perspectives on End User Computing, MIT Press, Cambridge, MA, 1993

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

General Terms:
Algorithms, Design, Human Factors

Keywords:
end user programming, interaction design, programming by demonstration, reasoning about actions, task learning