Evaluation of modeling techniques for agent-based systems

ABSTRACT

To develop agent- based systems, one needs a methodology that supports the development process as common in other disciplines. In recent years, several such methodologies and modeling techniques have been suggested. An important question is, to what extent do the existing methodologies address the developers' needs. In this paper we attempt to answer this question. In particular, we discuss suitability of agent modeling techniques to agent- based systems development. In evaluating existing modeling techniques, we address criteria from software engineering as well as characteristics of agent- based systems. Our evaluation shows that some aspects of modeling techniques for agent- based systems may benefit from further enhancements. As we show, these aspects include distribution, concurrency, testing and communication richness. We also find space for (relatively small) improvements in aspects such as the refining of the models throughout the development process and the coverage and consistency checking of the suggested models.

REFERENCES

• 1: Mark A. Ardis , John A. Chaves , Lalita Jategaonkar Jagadeesan , Peter Mataga , Carlos Puchol , Mark G. Staskauskas , James Von Olnhausen, A framework for evaluating specification methods for reactive systems: experience report, Proceedings of the 17th international conference on Software engineering, p.159-168, April 24-28, 1995, Seattle, Washington, United States [doi>10.1145/225014.225029]
• 2: Bernhard Bauer , Jörg P. Müller , James Odell, Agent UML: a formalism for specifying multiagent software systems, First international workshop, AOSE 2000 on Agent-oriented software engineering, p.91-103, January 2001, Limerick, Ireland
• 3: F. M. T. Brazier, B. Dunin-Keplicz, N. R. Jennings and J. Treur, DESIRE: Modelling Multi-Agent Systems in a Compositional Formal Framework. Intl. Journal of Cooperative Information Systems, vol. 6, Formal Methods in Cooperative Information Systems: Multi-Agent Systems, (M. Huhns and M. Singh, eds.), 1997, pp. 67-94.
• 4: Frances M. T. Brazier , Barbara Dunin-Keplicz , Jan Treur , Rineke Verbrugge, Modelling Internal Dynamic Behaviour of BDI Agents, Selected papers from the ESPRIT Project ModelAge Final Workshop on Formal Models of Agents, p.36-56, January 1999
• 5: F. M. T. Brazier., C. M. Jonker, J. Treur and N.J.E. Wijngaards, Compositional Design of a Generic Design Agent. In: G. Luger, L. Interrante (eds.), Proc. of AAAI Workshop on AI and Manufacturing: State of the Art and State of Practice. AAAI Press, 1998, pp. 30-39.
• 6: Carlos Argel Iglesias , Mercedes Garijo , José Centeno-González, A Survey of Agent-Oriented Methodologies, Proceedings of the 5th International Workshop on Intelligent Agents V, Agent Theories, Architectures, and Languages, p.317-330, July 04-07, 1998
• 7: N. R. Jennings and M. Wooldridge, Agent-Oriented Software Engineering, Handbook of Agent Technology (ed. J. Bradshaw) AAAI/MIT Press, 2000 (to appear).
• 8: N. R. Jennings, P. Faratin, M. J. Johnson, P. O'Brien, M. E. Wiegand: Using Intelligent Agents to Manage Business Processes, Proc. of PAAM96, London, UK, 1996, 345-360
• 9: Nicholas R. Jennings, On agent-based software engineering, Artificial Intelligence, v.117 n.2, p.277-296, March 2000 [doi>10.1016/S0004-3702(99)00107-1]
• 10: N. R. Jennings, P. Faratin, T. J. Norman, P. O'Brien and B. Odgers, Autonomous Agents for Business Process Management, Int. Journal of Applied AI 14 (2), 2000, 145-189.
• 11: N. R. Jennings, P. Faratin, T. J. Norman, P. O'Brien, B. Odgers and J. L. Alty, Implementing a Business Process Management System using ADEPT: A Real-World Case Study, Intl. Journal of Applied AI 14 (5), 2000, 421-465.
• 12: S. Katz, Draft of Formal Specification Method Book, http://www.cs.technion.ac.il/~cs236368/, 2000.
• 13: Catholijn M. Jonker , Matthias Klusch , Jan Treur, Design of Collaborative Information Agents, Proceedings of the 4th International Workshop on Cooperative Information Agents IV, The Future of Information Agents in Cyberspace, p.262-283, July 07-09, 2000
• 14: Michael Luck , Mark d'Inverno, Structuring a Z Specification to Provide a Formal Framework for Autonomous Agent Systems, Proceedings of the 9th International Conference of Z Usres on The Z Formal Specification Notation, p.47-62, September 07-09, 1995
• 15: Marco Mulder , Jan Treur , Michael Fisher, Agent Modelling in METATEM and DESIRE, Proceedings of the 4th International Workshop on Intelligent Agents IV, Agent Theories, Architectures, and Languages, p.193-207, July 24-26, 1997
• 16: Timothy J. Norman , Nicholas R. Jennings , Peyman Faratin , Abe Mamdani, Designing and Implementing a Multi-Agent Architecture for Business Process Management, Proceedings of the 4th International Workshop on Intelligent Agents IV, Agent Theories, Architectures, and Languages, p.261-275, July 24-26, 1997
• 17: O. Shehory, Architectural Properties of Multi-Agent Systems, Technical Report CMU-RI-TR-98-28, The Robotics Institute, Carnegie Mellon University, 1998.
• 18: O. Shehory and A. Sturm, Evaluating Agent-Based System Modeling Techniques, Technical Report TR-ISE/IE-003-2000, Faculty of Industrial Engineering and Management Technion - Israel Institute of Technology, 2000.
• 19: Michael Wooldridge , Nicholas R. Jennings , David Kinny, A methodology for agent-oriented analysis and design, Proceedings of the third annual conference on Autonomous Agents, p.69-76, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301165]
• 20: Michael Wooldridge , Nicholas R. Jennings , David Kinny, The Gaia Methodology for Agent-Oriented Analysis and Design, Autonomous Agents and Multi-Agent Systems, v.3 n.3, p.285-312, September 2000 [doi>10.1023/A:1010071910869]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING

General Terms:
Design, Measurement, Performance, Theory