Turing's test and believable AI in games

ABSTRACT

The Turing test is perhaps the most famous, most quoted, and probably most often misrepresented and misunderstood measure of machine intelligence. In this article we'll briefly review the Turing test and some of its key criticisms. In particular, we will try to answer whether the Turing test -- or something derived from it -- can be of use in developing and assessing game AI. We will also present a brief overview of a methodology for conducting believability testing for games and highlight some of the problems inherent in any attempt to categorically determine whether or not some AI behavior is capable of convincing, life-like behavior.

REFERENCES

• 1: Varol Akman , Patrick Blackburn, Editorial: Alan Turing and Artificial Intelligence, Journal of Logic, Language and Information, v.9 n.4, p.391-395, October 2000 [doi>10.1023/A:1008389623883]
• 2: Rodney A. Brooks, Intelligence without representation, Artificial Intelligence, v.47 n.1-3, p.139-159, Jan. 1991 [doi>10.1016/0004-3702(91)90053-M]
• 3: Butcher, C. and Griesemer, J. 2002. The illusion of intelligence: The integration of AI and level design in Halo. Presented at the Game Developers Conference (San Jose, CA, March 21-23, 2002).
• 4: Charles, D. 2003. Enhancing gameplay: Challenges for artificial intelligence in digital games. In Level Up: Digital Games Research Conference Proceedings (Utrecht, Nov. 4-6).
• 5: Cohen, P. 2004. If not the Turing test, then what? In Proceedings of the Nineteenth National Conference on Artificial Intelligence (San Jose, CA, July 25-29, 2004). American Association of Artificial Intelligence.
• 6: Colby, K. M. 1981. Modeling a paranoid mind. Behavioral and Brain Sciences 4 (1981), 515-560.
• 7: Dick, P. K. 1968. Do androids Dream of Electric Sheep?
• 8: Dick, P. K., FANCHER, H., AND PEOPLES, D. 1982. Blade Runner. R. Scott (Director).
• 9: Hare, R. D. 1993. Without Conscience: The Disturbing World of the Psychopaths Among Us. Simon & Schuster, New York.
• 10: S. Harnad, Minds, Machines and Turing, Journal of Logic, Language and Information, v.9 n.4, p.425-445, October 2000 [doi>10.1023/A:1008315308862]
• 11: Hayes, P. J. AND FORD, K. M. 1995. Turing test considered harmful. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-95, Montreal, Quebec).
• 12: Humphrys, M. 1995. How my program passed the Turing test. http://computing.dcu.ie/~humphrys/eliza.html. Online Mar. 1, 2005.
• 13: Marina Krol, Have We Witnessed a Real-Life Turing Test?, Computer, v.32 n.3, p.27-30, March 1999 [doi>10.1109/2.751325]
• 14: Laird, J. E. and Duchi, J. C. 2000. Creating human-like synthetic characters with multiple skill levels: A case study using the Soar Quakebot. In Proceedings of the AAAI 2000 Fall Symposium: Simulating Human Agents (North Falmouth, MA, Nov. 3-5, 2000).
• 15: Laird, J. E. and van Lent, M. 1999. Developing an artificial intelligence engine. In Proceedings of the Game Developers Conference (San Jose, CA, Nov. 3-5, 1999).
• 16: Mac Namee, B. 2004. Proactive persistent agents: Using situational intelligence to create support characters in character-centric computer games. Ph.D. dissertation, Dept. of Computer Science. University of Dublin, Dublin, Ireland
• 17: Mcglinchey, S. 2003. Learning of AI players from game observation data. In Proceedings of the Game-On 2003, 4th International Conference on Intelligent Games and Simulation (London).
• 18: Mcglinchey, S. and Livingstone, D. 2004. What believability testing can tell us. In CGAIDE, Proceedings of the Conference on Game AI, Design and Education (Microsoft Campus, Redding, WA).
• 19: Purdy, J. H. and Thornton, J. S. 2004. What effects should a game have on brain & body to be successful? In Proceedings of the Game Developers Conference Europe (London, Aug. 31-Sept. 3, 2004).
• 20: SEARLE, J. R. 1980. Minds, brains and programs. Behavioral and Brain Sciences 3 (1980), 417-424.
• 21: Sweetser, P. and Drenna, P. 2003. User-centred design in games. Presented at the Australian Game Developers Conference Academic Summit (Melbourne, Nov. 20, 2003).
• 22: Penelope Sweetser , Peta Wyeth, GameFlow: a model for evaluating player enjoyment in games, Computers in Entertainment (CIE), v.3 n.3, July 2005 [doi>10.1145/1077246.1077253]
• 23: Turing, A. M. 1950. Computing machinery and intelligence. Mind LIX, 236 (1950), 433-460.
• 24: Westwood. 1998. Blade Runner (PC CD-Rom).
• 25: Wetzel, B. 2004. Step one: Document the problem. In Proceedings of the AAAI Workshop on Challenges in Game AI (San Jose, CA, July 25-26, 2004).

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems
          Subjects: Games

Additional Classification:
  J. Computer Applications
  J.7 COMPUTERS IN OTHER SYSTEMS
      Subjects: Consumer products

General Terms:
Design, Human Factors, Measurement

Keywords:
believability, evaluation, games