An agent-based system for simulating dynamic choice-sets

ABSTRACT

Contributing to the recent interest in the dynamics of activity-travel patterns, this paper discusses a framework for the dynamic formation of location choice-sets. It is based on the concepts of aspiration, activation and expected utility. Based on principles of Bayesian learning, reinforcement learning and social comparison theories, the framework specifies functions for experience-based learning, extended and integrated with social learning.

REFERENCES

• 1: T. A. Arentze, and H. J. P. Timmermans, Albatross: A Learning Based Transportation Oriented Simulation System, EIRASS, Eindhoven, The Netherlands, 2001.
• 2: T. A. Arentze, and H. J. P. Timmermans, "Measuring impacts of condition variables in rule-based models of space-time choice behavior: method and empirical illustration," Geo. An., 35, pp. 24--45, 2003.
• 3: T. A. Arentze, and H. J. P. Timmermans, "A learning-based transportation oriented simulation system," Transpn. Res. B, 38, pp. 613--633, 2004.
• 4: Joh, C.-H., Arentze, T. A. and H. J. P. Timmermans, "Measuring and predicting adaptation behavior in multidimensional activity-travel patterns," Transportmetrica, 2, pp. 153--173, 2006.
• 5: H. J. P. Timmermans, T. A. Arentze and C. H. Joh, "Analyzing space-time behavior: new approaches to old problems," Progress in Human Geography, 26(2), pp. 175--190, 2002.
• 6: D. Charypar and K. Nagel, "Generating complete all-day activity plans with genetic algorithms," Proc. 10th Int. Conf. Travel Beh. Res., Lucerne, Switzerland (CD-Rom), 2003.
• 7: M. Balmer, K. Nagel and B. Raney, "Large scale multi-agent simulations for transportation applications," Proc. Beh. Responses to ITC, Eindhoven (CD-Rom), 2004.
• 8: R. J. F. Rosetti and R. Liu, "A dynamic network simulation model based on multi-agent systems," Proc. 3rd Works. Agents in Traff. And Transpn., pp88--93, AAMAS, New York, 2004.
• 9: G. Hertkort and P. Wagner, "Adaptation of time use patterns to simulated travel times in a travel demand model," in Progress in Activity-Based Analysis, H. Timmermans, Ed. Amsterdam, pp. 161--174, 2005.
• 10: G. Rindsfuser and F. Klugl, "The scheduling agent using Sesam to implement a generator of activity programs," in Progress in Activity-Based Analysis, H. Timmermans, Ed. Amsterdam, pp. 115--137, 2005.
• 11: T. A. Arentze, H. J. P. Timmermans, D. Janssens and G. Wets, "Modeling short-term dynamics in activity-travel patterns: from Aurora to Feathers," Paper presented at the Innovations in Travel Modeling Conference, May 21--23, 2006, Austin, Texas.
• 12: D. Janssens, G. Wets, H. J. P. Timmermans and T. A. Arentze, "Modeling short-term dynamics in activity-travel patterns: the Feathers model," Proceedings WCTR Conference, 2007, Berkeley, (CD-ROM: 24 pp.).
• 13: T. A. Arentze, and H. J. P. Timmermans, "Modeling learning and adaptation processes in activity-travel choice," Transportation, 30, pp. 37--62, 2003.
• 14: J. W. Payne, D. J. Laughunn and R. Crum, "Translation of gambles and aspiration level effects on risky choice behavior," Management Science, 26(10), pp. 1039--1060, 1980.
• 15: P. West and S. Broniarczyk, "Integrating multiple opinions: the role of aspiration level on consumer response to critic consensus," Journal of Consumer Research, vol. 25(1), pp. 38--51, 1998.
• 16: Richard S. Sutton , Andrew G. Barto, Introduction to Reinforcement Learning, MIT Press, Cambridge, MA, 1998
• 17: John R. Anderson, The Architecture of Cognition, Harvard University Press, Cambridge, MA, 1983
• 18: T. A. Arentze, and H. J. P. Timmermans, "Social networks, social interactions and activity-travel behavior: a framework for micro-simulation," In: Proceedings of the 85th Annual Meeting of the Transportation Research Board, Washington, D.C. (CD-ROM: 18 pp.), 2006. To appear in Environment and planning B.
• 19: L. Festinger, "A theory of social comparison processes," Human Relations, 7, pp. 117--140, 1954.

INDEX TERMS

Keywords:
dynamic behavior, habit formation context dependent, information exchange, social learning