Performance prediction of component- and pattern-based middleware for distributed systems

ABSTRACT

Design patterns, components, and frameworks have been successfully used to build various distributed real-time, and embedded (DRE) systems such as high-performance servers, telecommunication systems, and control systems. An application developer may choose from several approaches to implement a distributed application and the choice of design patterns and their configuration can impact the overall performance of the system. Unlike components, design patterns are often descriptions of a programming approach and need to be reified for each application. However, some core pattern implementations can often be reused across applications, if they can be correctly configured to meet application requirements. Currently, there is no general way to quantify the performance of components and design pattern implementations across various dimensions such as throughput, response time, and scalability. The overall performance of applications that are composed from pre-coded components and patterns can be inferred using analytical techniques by modeling the behavior of the individual components. In particular, while we know from experience that patterns exhibit various tradeoffs in terms of performance and complexity; we would like to explore these tradeoffs in a formal way. Toward this goal, we make the following contributions in this thesis: 1) we develop analytical models for various design patterns using queuing models, 2) we present a technique to analyze the performance of combinations of design patterns as observed in real-world applications, and 3) we validate the models using empirical measurements.

REFERENCES

• 1: A. Bogárdi-Mészöly, T. Levendovszky, and H. C. (Hungary). Using queueing model in predicting the response time of asp.net web applications. In The IASTED Conference on Software Engineering, February 2006.
• 2: Frank Buschmann , Regine Meunier , Hans Rohnert , Peter Sommerlad , Michael Stal, Pattern-oriented software architecture: a system of patterns, John Wiley & Sons, Inc., New York, NY, 1996
• 3: Center for Distributed Object Computing. The ZEN ORB. www.zen.uci.edu, University of California at Irvine.
• 4: R. G. Franks. The Layered Queueing Network Tutorial.
• 5: Roy Gregory Franks , C. Murray Woodside, Performance analysis of distributed server systems, Carleton University, Ottawa, Ont., Canada, 2000
• 6: T. Gensler and C. Zeidler. Rule-driven component composition for embedded systems. In 4th ICSE Workshop on Component-Based Software Engineering: Component Certification and System Prediction, 2004.
• 7: Swapna S. Gokhale , Jijun Lu, Performance and Availability Analysis of an E-Commerce Site, Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC'06), p.495-502, September 17-21, 2006 [doi>10.1109/COMPSAC.2006.65]
• 8: S. Gorappa and R. Klefstad. Modeling the performance of communication framework design patterns using queuing theory. In Proceedings of the 10th International Symposium on Performance Evaluation of Computer and Telecommunication Systems, July 2007.
• 9: J. Hu, S. Gorappa, J. A. Colmenares, and R. Klefstad. Compadres: A Lightweight Real-time Java Component Middleware Framework for Composing Distributed, Real-time, Embedded Systems. In Middleware, November 2007.
• 10: Stephen D. Huston , James C. E. Johnson , Umar Syyid, The ACE Programmer's Guide: Practical Design Patterns for Network and Systems Programming, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2003
• 11: R. Jain. The Art of Computer Systems Performance Analysis. John Wiley and Sons, Inc., 1991.
• 12: Prasad Jogalekar , Murray Woodside, Evaluating the Scalability of Distributed Systems, IEEE Transactions on Parallel and Distributed Systems, v.11 n.6, p.589-603, June 2000 [doi>10.1109/71.862209]
• 13: Arundhati Kogekar , Aniruddha Gokhale, Performance evaluation of the reactor pattern using the OMNeT++ simulator, Proceedings of the 44th annual Southeast regional conference, March 10-12, 2006, Melbourne, Florida [doi>10.1145/1185448.1185603]
• 14: A. Kogekar, D. Kaul, A. Gokhale, P. Vandal, U. Praphamontripong, S. Gokhale, J. Zhang, Y. Lin, and J. Gray. Model-driven generative techniques for scalable performability analysis of distributed systems. In Parallel and Distributed Processing Symposium, April 2006.
• 15: Alberto Leon-Garcia, Probability and Random Processes For EE's (3rd Edition), Prentice-Hall, Inc., Upper Saddle River, NJ, 2007
• 16: Nike Liu , Kemin Zhou, Optimal robust fault detection for linear discrete time systems, Journal of Control Science and Engineering, v.2008 n.1, p.1-16, January 2008 [doi>10.1155/2008/829459]
• 17: Michael Menth , Robert Henjes, Analysis of the Message Waiting Time for the FioranoMQ JMS Server, Proceedings of the 26th IEEE International Conference on Distributed Computing Systems, p.1, July 04-07, 2006 [doi>10.1109/ICDCS.2006.16]
• 18: S. Microsystems. Enterprise JavaBeans specification, v2.1.
• 19: I. Pyarali, C. O'Ryan, D. Schmidt, N. Wang, V. Kachroo, and A. Gokhale. Applying optimization principle patterns to real-time orbs, 2000.
• 20: Srinivasan Ramani , Kishor S. Trivedi , Balakrishnan Dasarathy, Performance Analysis of the CORBA Event Service Using Stochastic Reward Nets, Proceedings of the 19th IEEE Symposium on Reliable Distributed Systems (SRDS'00), p.238, October 16-18, 2000
• 21: Sridhar Ramesh , Harry G. Perros, A Multilayer Client-Server Queueing Network Model with Synchronous and Asynchronous Messages, IEEE Transactions on Software Engineering, v.26 n.11, p.1086-1100, November 2000 [doi>10.1109/32.881719]
• 22: Douglas C. Schmidt, Reactor: an object behavioral pattern for concurrent event demultiplexing and event handler dispatching, Pattern languages of program design, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1995
• 23: Douglas C. Schmidt , Charles D. Cranor, Half-sync/half-async: an architectural pattern for efficient and well-structured concurrent I/O, Pattern languages of program design 2, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 24: D. C. Schmidt and et al. Leader/Followers - A Design Pattern for Efficient Multi-threaded Event Demultiplexing and Dispatching. In 7th Pattern Languages of Programs Conference, 2000.
• 25: Douglas C. Schmidt , James C. Hu, Developing flexible and high-performance Web servers with frameworks and patterns, ACM Computing Surveys (CSUR), v.32 n.1es, March 2000 [doi>10.1145/351936.351976]
• 26: Douglas C. Schmidt , Hans Rohnert , Michael Stal , Dieter Schultz, Pattern-Oriented Software Architecture: Patterns for Concurrent and Networked Objects, John Wiley & Sons, Inc., New York, NY, 2000
• 27: R. D. van der Mei, R. Hariharan, and P. Reeser. Web server performance modeling. Telecommunication Systems, 16(3--4):361--378, 2001.
• 28: N. Wang, D. C. Schmidt, A. Gokhale, C. D. Gill, B. Natarajan, J. P. Loyall, R. E. Schantz, and C. Rodrigues. Qos-enabled middleware (chapter 6). In Middleware for Communications. John Wiley & Sons, 2004.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Performance

Keywords:
component middleware, design patterns, distributed systems, queuing models