Modeling the user in natural language systems

ABSTRACT

For intelligent interactive systems to communicate with humans in a natural manner, they must have knowledge about the system users. This paper explores the role of user modeling in such systems. It begins with a characterization of what a user model is and how it can be used. The types of information that a user model may be required to keep about a user are then identified and discussed. User models themselves can vary greatly depending on the requirements of the situation and the implementation, so several dimensions along which they can be classified are presented. Since acquiring the knowledge for a user model is a fundamental problem in user modeling, a section is devoted to this topic. Next, the benefits and costs of implementing a user modeling component for a system are weighed in light of several aspects of the interaction requirements that may be imposed by the system. Finally, the current state of research in user modeling is summarized, and future research topics that must be addressed in order to achieve powerful, general user modeling systems are assessed.

REFERENCES

• 1: Allen, James F. and Perrault, C. Raymond 1980 Analyzing Intention in Utterances. Artificial Intelligence 15: 143--178.
• 2: Allen, James F.; Frisch, Alan M.; and Litman, Diane J. 1982 ARGOT: the Rochester Dialogue System. In Proceedings of the 2nd National Conference on Artificial Intelligence: 66--70.
• 3: Brown, J. S. and Burton, R. R. 1978 Diagnostic Models for Procedural Bugs in Basic Mathematical Skills. Cognitive Science 2: 155--192.
• 4: Carberry, Sandra 1983 Tracking User Goals in an Information Seeking Environment. In Proceedings of the 3rd National Conference on Artificial Intelligence: 59--63.
• 5: Mary Sandra Carberry, Pragmatic modeling in information system interfaces (goals, dialogue, plans, ill-formedness), 1985
• 6: Carberry, Sandra (this issue) Modeling the User's Plans and Goals.
• 7: Carbonell, J. R. 1970 AI in CAI: An Artificial Intelligence Approach to Computer-Aided Instruction. IEEE Transactions on Man-Machine Systems 11: 190--202.
• 8: Carbonell, Jaime G.; Boggs, W. Mark; Mauldin, Michael L.; and Anick, Peter G. 1983 The XCALIBUR Project: a Natural Language Interface to Expert Systems. In 8th International Conference on Artificial Intelligence: 653--656.
• 9: Carr, Brian and Goldstein, Ira P. 1977 Overlays: A Theory of .Modeling for Computer-Aided Instruction. Technical Report AI Memo 406, MIT Artificial Intelligence Laboratory, Cambridge, MA.
• 10: Chin, David N. 1988 KNOME: Modeling What the User Knows in UC. In Kobsa, Alfred and Wahlster, Wolfgang (eds.), User Models in Dialog Systems, Springer Verlag, Berlin---New York.
• 11: Doyle, Jon 1979 A Truth Maintenance System. Artificial Intelligence 12(3): 231--272.
• 12: Fagin, Ronald and Halpern, Joseph Y. 1985 Belief, Awareness and Limited Reasoning: Preliminary Report. In 9th International Conference on Artificial Intelligence: 491--501.
• 13: Finin, Tim 1982 Help and Advice in Task-Oriented Systems. Technical Report MS-CIS-82-22, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
• 14: Finin, Tim 1983 Providing Help and Advice in Task-Oriented Systems. In 8th International Conference on Artificial Intelligence: 176--178.
• 15: Finin, Tim and Drager, David 1986 GUMS: a General User Modeling System. In Proceedings of the 1986 Conference of the Canadian Society for Computational Studies of Intelligence: 24--30.
• 16: Finin, Tim; Joshi, Aravind; and Webber, Bonnie 1986 Natural Language Interactions with Artificial Experts. Proceedings of the IEEE 74: 921--938.
• 17: Genesereth, Michael 1979 The Role of Plans in Automated Consultation. In 6th International Conference on Artificial Intelligence: 311--319.
• 18: Genesereth, Michael R. 1982 The Role of Plans in Intelligent Teaching Systems. In Sleeman, D. and Brown, J. S. (eds.), Intelligent Tutoring Systems, 137--156, Academic Press, New York, NY.
• 19: Gershman, A. 1981 Finding Out What the User Wants---Steps Toward an Automated Yellow Pages Assistant. In 7th International Conference on Artificial Intelligence: 423--425.
• 20: Goodman, Bradley A. 1985 Communication and Miscommunication. Technical Report 5681, Bolt, Beranek, and Newman.
• 21: Goodman, Bradley A. 1986 Miscommunication and Plan Recognition. Unpublished paper from UM86, the International Workshop on User Modeling, Maria Laach, West Germany.
• 22: Grice, H. P. 1975 Logic and Conversation. In Cole, P. and Morgan, J. L. (eds.), Syntax and Semantics 3, Academic Press, New York, NY.
• 23: Frank G. Halasz , Thomas P. Moran, Mental models and problem solving in using a calculator, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.212-216, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801613]
• 24: Halpern, Joseph Y. and Moses, Yoram 1985 A Guide to the Modal Logics of Knowledge and Belief: Preliminary Draft. In 9th International Conference on Artificial Intelligence: 480--490.
• 25: Hoeppner, Wolfgang; Christaller, Thomas; Marburger, Heinz; Morik, Katharina; Nebel, Bernhard; O'Leary, Mike; and Wahlster, Wolfgang 1983 Beyond Domain Independence: Experience with the Development of a German Language Access System to Highly Diverse Background Systems. In 8th International Conference on Artificial Intelligence: 588--594.
• 26: Jameson, A. 1983 Impression Monitoring in Evaluation-Oriented Dialog: The Role of the Listener's Assumed Expectations and Values in the Generation of Informative Statements. In 8th International Conference on Artificial Intelligence: 616--620.
• 27: Jameson, Anthony 1988 But What Will the Listener Think? Belief Ascription and Image Maintenance in Dialog. In Kobsa, Alfred and Wahlster, Wolfgang (eds.), User Models in Dialog Systems, Springer Verlag, Berlin---New York.
• 28: Johnson, W. Lewis and Soloway, Elliot 1984 Intention-Based Diagnosis of Programming Errors. In Proceedings of the 4th National Conference on Artificial Intelligence: 162--168.
• 29: Joshi, Aravind K. 1982 Mutual Beliefs in Question Answering Systems. In Smith, N. (ed.), Mutual Belief, Academic Press, New York.
• 30: Joshi, A.; Webber, Bonnie; and Weischedel, Ralph 1984 Living Up to Expectations: Computing Expert Responses. In Proceedings of the 4th National Conference on Artificial Intelligence.
• 31: Kaplan, S. J. 1982 Cooperative Responses from a Portable Natural Language Database Query System. Artificial Intelligence 19(2): 165--188.
• 32: Kass, Robert 1987 Implicit Acquisition of User Models in Cooperative Advisory Systems. Technical Report MS-CIS-87-05, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
• 33: Kass, Robert 1987 The Role of User Modeling in Intelligent Tutoring Systems. In Kobsa, Alfred and Wahlster, Wolfgang (eds.), User Models in Dialog Systems. Springer Verlag, Berlin---New York. (An earlier version of this paper appeared as Technical Report Number MS-CIS-86-58, Department of Computer Science, University of Pennsylvania, Philadelphia, PA.)
• 34: Kass, Robert 1987 Rules for the Implicit Acquisition of Knowledge About the User. In Proceedings of the 6th National Conference on Artificial Intelligence. (Also available as Technical Report Number MS-CIS-87-10, Department of Computer Science, University of Pennsylvania, Philadelphia, PA.)
• 35: Kautz, Henry A. and Allen, James F. 1986 Generalized Plan Recognition. In Proceedings of the 5th National Conference on Artificial Intelligence: 32--37.
• 36: Kobsa, Alfred 1984 Three Steps in Constructing Mutual Belief Models from User Assertions. In Proceedings of the 6th European Conference on Artificial Intelligence: 423--427.
• 37: Kobsa, Alfred 1985 Using Situation Descriptions and Russellian Attitudes for Representing Beliefs and Wants. In 9th International Conference on Artificial Intelligence: 513--515.
• 38: Alfred Kobsa , Wolfgang Wahlster, User models in dialog systems, Springer-Verlag New York, Inc., New York, NY, 1990
• 39: Konolige, Kurt 1983 A Deductive Model of Belief. In 8th International Conference on Artificial Intelligence: 377--381.
• 40: Diane J. Litman , James F. Allen, A plan recognition model for clarification subdialogues, Proceedings of the 22nd annual meeting on Association for Computational Linguistics, p.302-311, July 02-06, 1984, Stanford, California
• 41: McCoy, Kathleen F. 1985 Correcting Object-Related Misconceptions. Technical Report MS-CIS-85-57, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
• 42: McCoy, Kathleen F. 1988 Highlighting User Model to Respond to Misconceptions. In Kobsa, Alfred and Wahlster, Wolfgang (eds.), User Models in Dialog Systems, Springer Verlag, Berlin---New York.
• 43: McCoy, Kathleen F. (this issue) Reasoning on a Highlighted User Model to Respond to Misconceptions.
• 44: Kathleen R. McKeown, Discourse strategies for generating natural-language text, Artificial Intelligence, v.27 n.1, p.1-41, Sept. 1985 [doi>10.1016/0004-3702(85)90082-7]
• 45: McKeown, Kathleen R. 1985 Tailoring Explanations for the User. In 9th International Conference on Artificial Intelligence: 794--798.
• 46: Moore, Robert C. 1984 A Formal Theory of Knowledge and Action. In Moore, R. C. and Hobbs, J. (eds.), Formal Theories of the Commonsense World, Ablex Publishing, Norwood, NJ; 319--358.
• 47: Morik, Katharina 1986 User Modeling and Conversational Settings: Modeling the User's Wants. In Kobsa, Alfred and Wahlster, Wolfgang (eds.), User Models in Dialog Systems, Springer Verlag, Berlin---New York.
• 48: Morik, Katharina and Rollinger, Claus-Rainer 1985 The Real-Estate Agent---Modeling Users by Uncertain Reasoning. AI Magazine 6: 44--52.
• 49: Cécile L. Paris, Tailoring object descriptions to a user's level of expertise, Computational Linguistics, v.14 n.3, September 1988
• 50: Perrault, C. Raymond 1987 An Application of Default Logic to Speech Act Theory. Report No. CSLI-87-90, Center for the Study of Language and Information, Stanford, CA.
• 51: Martha E. Pollack, Information sought and information provided: an empirical study of user/expert dialogues, Proceedings of the SIGCHI conference on Human factors in computing systems, p.155-159, April 1985, San Francisco, California, United States
• 52: Martha Elizabeth Pollack, Inferring domain plans in question-answering, University of Pennsylvania, Philadelphia, PA, 1986
• 53: Pollack, Martha E.; Hirschberg, Julia; and Webber, Bonnie 1982 User Participation in the Reasoning Processes of Expert Systems. In Proceedings of the 2nd National Conference on Artificial Intelligence: 358--361. (A longer version of this paper appears as Technical Report MS-CIS-82-9, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.)
• 54: Reichman, Rachel 1981 Plain-Speaking: A Theory and Grammar of Spontaneous Discourse. Ph.D. thesis, Harvard University, Cambridge, MA.
• 55: Reiter, Raymond 1980 A Logic for Default Reasoning. Artificial Intelligence 13(1): 81--132.
• 56: Rich, Elaine 1979 User Modeling Via Stereotypes. Cognitive Science 3: 329--354.
• 57: Rich, Elaine 1983 Users as Individuals: Individualizing User Models. International Journal of Man-Machine Studies 18: 199--214.
• 58: Schuster, Ethel 1984 VPe : The Role of User Modeling in Correcting Errors in Second Language Learning. Technical Report MS-CIS-84-66, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
• 59: Schuster, Ethel 1985 Grammars as User Models. In 9th International Conference on Artificial Intelligence: 20--22.
• 60: Sergot, M. 1983 A Query-the-User Facility of Logic Programming. In Degano, P. and Sandewall, E. (eds.), Integrated Interactive Computing Systems, North-Holland.
• 61: Shrager, J. 1981 Invoking a Beginner's Aid Processor by Recognizing JCL Goal. Technical Report MS-CIS-81-07, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
• 62: Shrager, J. and Finin, Tim 1982 An Expert System that Volunteers Advice. In Proceedings of the 2nd National Conference on Artificial Intelligence: 339--340.
• 63: Sidner, Candace L. and Israel, David J. 1981 Recognizing Intended Meaning and Speakers' Plans. In 7th International Conference on Artificial Intelligence: 203--208.
• 64: Sleeman, D. 1982 Assessing Aspects of Competence in Basic Algebra. In Sleeman, D. and Brown, J. S. (eds.), Intelligent Tutoring Systems, Academic Press, New York, NY; 185--200.
• 65: Sleeman, D. and Brown, J. S. 1982 Intelligent Tutoring Systems, Academic Press, New York, NY.
• 66: Sleeman, D.; Appelt, Doug; Konolige, Kurt; Rich, Elaine; Sridharan, N. S.; and Swartout, Bill 1985 User Modeling Panel. In 9th International Conference on Artificial Intelligence: 1298--1302.
• 67: Smith, Brian 1982 Reflection and Semantics in a Procedural Language. Ph.D. thesis, MIT, Cambridge, MA. (Also available as Technical Report MIT/LCS/TR-272.) Sparck Jones, Karen 1984 User Models and Expert Systems. Technical Report 61, Computer Laboratory, University of Cambridge, Cambridge, England.
• 68: Swartout, William R. 1983 XPLAIN: A System for Creating and Explaining Expert Consulting Programs. Artificial Intelligence 21: 285--325.
• 69: Alfred Kobsa , Wolfgang Wahlster, User models in dialog systems, Springer-Verlag New York, Inc., New York, NY, 1990
• 70: Jerold W. Wallis , Edward H. Shortliffe, Explanatory power for medical expert systems: studies in the representation of causal relationships for clinical consultations, Stanford University, Stanford, CA, 1982
• 71: David L. Waltz, An English language question answering system for a large relational database, Communications of the ACM, v.21 n.7, p.526-539, July 1978 [doi>10.1145/359545.359550]
• 72: Bonnie L Webber, Questions, answers, and responses: interacting with knowledge base systems, On knowledge base management systems: integrating artificial intelligence and d atabase technologies, Springer-Verlag New York, Inc., New York, NY, 1986
• 73: Webber, Bonnie Lynn and Finin, Tim 1984 In Response: Next Steps in Natural Language Interaction. In Reitman, W. (ed.), Artificial Intelligence Applications for Business, Ablex Publishing Company, Norwood, NJ.
• 74: Robert Wilensky , Yigal Arens , David Chin, Talking to UNIX in English: an overview of UC, Communications of the ACM, v.27 n.6, p.574-593, June 1984 [doi>10.1145/358080.358101]
• 75: Wilks, Y. and Bien, J. 1983 Beliefs, Points of View, and Multiple Environments. Cognitive Science 7: 95--119.