Model-based ambient analysis of human task execution

ABSTRACT

One of the challenges for ambient intelligent agents to support a human in demanding tasks, is to find out and be aware of what the human is exactly doing, and how much progress is made. Of course, in principle it would be possible to interact with the human to discover what this human is doing, but this communication can potentially slow down or even endanger task performance. In this paper an ambient agent model is presented that is able to obtain such an awareness of the human's progress in task execution by performing model-based analysis using available workflow models and available observation information. The design of the model is based on a component-based generic ambient agent model. Simulation experiments for a case study are discussed, and evaluated by automated formal verification.

REFERENCES

• 1: Aalst, W. M. P. van der, Hofstede, A. H. M. ter, Kiepuszewski, B., and Barros, A. P. Workflow Patterns. QUT Technical report FIT-TR-2002-02, Queensland University of Technology, Brisbane, 2002.
• 2: Aarts, E.; Collier, R.; van Loenen, E.; Ruyter, B. de (eds.) (2003). Ambient Intelligence. Proc. of the First European Symposium, EUSAI 2003. Lecture Notes in Computer Science, vol. 2875. Springer Verlag, 2003, pp. 432.
• 3: Emile Aarts , Rick Harwig , Martin Schuurmans, Ambient intelligence, The invisible future: the seamless integration of technology into everyday life, McGraw-Hill, Inc., New York, NY, 2001
• 4: Bosse, T., Both, F., Gerritsen, C., Hoogendoorn, M., and Treur, J., Model-Based Reasoning Methods within an Ambient Intelligent Agent Model. In: Proc. of the First International Workshop on Human Aspects in Ambient Intelligence. Published in: M. Mühlhäuser, A. Ferscha, and E. Aitenbichler (eds.), Constructing Ambient Intelligence: AmI-07 Workshops Proceedings. Communications in Computer and Information Science (CCIS), vol. 11, Springer Verlag, 2008, pp. 352--370.
• 5: Bosse, T., Hoogendoorn, M., Klein, M., and Treur, J., (2008a). An Agent-Based Generic Model for Human-Like Ambience. In: Proc. of the First Intern.Workshop on Model Driven Software Engineering for Ambient Intelligence Applications. Published in: M. Mühlhäuser, A. Ferscha, and E. Aitenbichler (eds.), Constructing Ambient Intelligence: AmI-07 Workshops Proceedings. Communications in Computer and Information Science (CCIS), vol. 11, Springer Verlag, 2008, pp. 93--103.
• 6: Bosse, T., Hoogendoorn, M., Klein, M., and Treur, J., (2008b) A Component-Based Ambient Agent Model for Assessment of Driving Behaviour. In: Proceedings of the 5th International Conference on Ubiquitous Intelligence and Computing. Lecture Notes in Computer Science, Springer Verlag, 2008, to appear.
• 7: Tibor Bosse , Catholijn M. Jonker , Lourens van der Meij , Alexei Sharpanskykh , Jan Treur, Specification and Verification of Dynamics in Cognitive Agent Models, Proceedings of the IEEE/WIC/ACM international conference on Intelligent Agent Technology, p.247-254, December 18-22, 2006 [doi>10.1109/IAT.2006.112]
• 8: Bosse, T., Jonker, C. M., Meij, L. van der, and Treur, J. (2007). A Language and Environment for Analysis of Dynamics by Simulation. International Journal of Artificial Intelligence Tools, vol. 16, 2007, pp. 435--464.
• 9: Clarence A. Ellis , Gary J. Nutt, Modeling and Enactment of Workflow Systems, Proceedings of the 14th International Conference on Application and Theory of Petri Nets, p.1-16, June 21-25, 1993
• 10: Dimitrios Georgakopoulos , Mark Hornick , Amit Sheth, An overview of workflow management: from process modeling to workflow automation infrastructure, Distributed and Parallel Databases, v.3 n.2, p.119-153, April 1995 [doi>10.1007/BF01277643]
• 11: Liao, L., Fox, D., and Kautz, H., Location-Based Activity Recognition using Relational Markov Networks. In: Proceedings of the Nineteenth International Conference on Artificial Intelligence, IJCAI'05, 2005.
• 12: Donald J. Patterson , Dieter Fox , Henry Kautz , Matthai Philipose, Fine-Grained Activity Recognition by Aggregating Abstract Object Usage, Proceedings of the Ninth IEEE International Symposium on Wearable Computers, p.44-51, October 18-21, 2005 [doi>10.1109/ISWC.2005.22]
• 13: Riva, G., F. Vatalaro, F. Davide, M. Alcañiz (eds.) (2005). Ambient Intelligence. IOS Press.
• 14: Daniel Thalmann, The role of virtual humans in virtual environment technology and interfaces, Frontiers of human-centred computing, online communities and virtual environments, Springer-Verlag, London, 2001
• 15: Xinzhou Qin , Wenke Lee, Attack Plan Recognition and Prediction Using Causal Networks, Proceedings of the 20th Annual Computer Security Applications Conference, p.370-379, December 06-10, 2004 [doi>10.1109/CSAC.2004.7]
• 16: Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., and Rehg, J. M., A Scalable Approach to Activity Recognition based on Object Use. In: Proc. of the 11th Int. IEEE Conference on Computer Vision, ICCV'07, 2007, pp. 1--8.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.11 Distributed Artificial Intelligence

General Terms:
Design, Human Factors

Keywords:
ambient agent, awareness, model-based reasoning, task progress, workflow model