Architecture based analysis of performance, reliability and security of software systems

ABSTRACT

With software systems becoming more complex, and handling diverse and critical applications, the need for their thorough evaluation has become ever more important at each phase of software development. With the prevalent use of component-based design, the software architecture as well as the behavior of the individual components of the system needs to be taken into account when evaluating it. In recent past a number of studies have focused on architecture based reliability estimation. But areas such as security and cache behavior still lack such an approach. In this paper we propose an architecture based unified hierarchical model for software reliability, performance, security and cache behavior prediction. We define a metric called the vulnerability index of a software component for quantifying its (in)security. We provide expressions for predicting the overall behavior of the system based on the characteristics of individual components, which also takes into account second order architectural effects for providing an accurate prediction. This approach also facilitates the identification of reliability, performance, security and cache performance bottlenecks. In addition we illustrate how the approach could be applied to software systems by case studies and also provide expressions to perform sensitivity analysis.

REFERENCES

• 1: Swapna S. Gokhale , Kishor S. Trivedi, Reliability Prediction and Sensitivity Analysis Based on Software Architecture, Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE'02), p.64, November 12-15, 2002
• 2: Architecture-based approach to reliability assessment of software systems, Performance Evaluation, v.45 n.2-3, p.179-204, July 1 2001 [doi>10.1016/S0166-5316(01)00034-7]
• 3: Swapna S. Gokhale, Kishor S. Trivedi, W. Eric Wong and J. R. Horgan, "An analytical approach to architecutre-based software reliability prediction", in IEEE International Computer Performance and Dependability Symposium 98.
• 4: R. C. Cheung, "A user--oriented software reliability model", IEEE Trans. on Software Engineering, 6 (2) (1980) 118--125.
• 5: J. C. Laprie, "Dependability evaluation of software systems in operation", IEEE Trans. on Software Engineering, 10 (6) (1984) 701--714.
• 6: J. Ledoux, "Availability modeling of modular software", IEEE Trans, on Reliability, 48 (2) (1999) 159--168.
• 7: P. Kubat, "Assessing reliability of modular software", Operations Research Letters, 8 (1989) 35--41.
• 8: B. Littlewood, "A reliability model for systems with Markov structure", Applied Statistics, 24 (2) (1975) 172--177.
• 9: Sherif M. Yacoub , Bojan Cukic , Hany H. Ammar, Scenario-Based Reliability Analysis of Component-Based Software, Proceedings of the 10th International Symposium on Software Reliability Engineering, p.22, November 01-04, 1999
• 10: Martin L. Shooman, Structural models for software reliability prediction, Proceedings of the 2nd international conference on Software engineering, p.268-280, October 13-15, 1976, San Francisco, California, United States
• 11: William W. Everett, Software Component Reliability Analysis, Proceedings of the 1999 IEEE Symposium on Application - Specific Systems and Software Engineering and Technology, p.204, March 24-27, 1999
• 12: M. Xie, C. Wohlin, "An additive reliability model for the analysis of modular software failure data", in Proc. of 6th Int'l Symposium on Software Reliability Engineering (ISSRE'95), 1995, pp. 188--194.
• 13: Douglas W. Clark , Joel S. Emer, Performance of the VAX-11/780 translation buffer: simulation and measurement, ACM Transactions on Computer Systems (TOCS), v.3 n.1, p.31-62, Feb. 1985 [doi>10.1145/214451.214455]
• 14: Wen-Hann Wang , Jean-Loup Baer, Efficient trace-driven simulation method for cache performance analysis, Proceedings of the 1990 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.27-36, April 1990, Univ. of Colorado, Boulder, Colorado, United States
• 15: Jaswinder Pal Singh , Harold S. Stone , Dominique F. Thiébaut, A Model of Workloads and its Use in Miss-Rate Prediction for Fully Associative Caches, IEEE Transactions on Computers, v.41 n.7, p.811-825, July 1992 [doi>10.1109/12.256450]
• 16: C. K. Chow, "Determination of a cache's capacity and its matching storage capacity", IEEE Transactions on Computers, vol. C25, no. 2, pp. 157--164, Feb 1976.
• 17: Dominique Thiebaut , Harold S. Stone, Footprints in the cache, ACM Transactions on Computer Systems (TOCS), v.5 n.4, p.305-329, Nov. 1987 [doi>10.1145/29868.32979]
• 18: Gururaj S. Rao, Performance Analysis of Cache Memories, Journal of the ACM (JACM), v.25 n.3, p.378-395, July 1978 [doi>10.1145/322077.322081]
• 19: A. Agarwal , J. Hennessy , M. Horowitz, An analytical cache model, ACM Transactions on Computer Systems (TOCS), v.7 n.2, p.184-215, May 1989 [doi>10.1145/63404.63407]
• 20: Somnath Ghosh , Margaret Martonosi , Sharad Malik, Cache miss equations: an analytical representation of cache misses, Proceedings of the 11th international conference on Supercomputing, p.317-324, July 07-11, 1997, Vienna, Austria [doi>10.1145/263580.263657]
• 21: G. S. Shedler and C Tung, "Locality in page reference strings", SIAM Journal of computing, vol. 1, no. 3, pp. 218--241.
• 22: Swapna S. Gokhale and Kishor S. Trivedi, "A hierarchical approach to architecture-based analysis of software systems", in Proc. of IEEE International Computer Performance and Dependability Symposium 00.
• 23: Wei Li, "A Markovian Analytical cache Performance Model", Masters Thesis, 2000, Duke University, USA.
• 24: Amitabh Srivastava , Alan Eustace, ATOM: a system for building customized program analysis tools, Proceedings of the ACM SIGPLAN 1994 conference on Programming language design and implementation, p.196-205, June 20-24, 1994, Orlando, Florida, United States
• 25: J. R. Horgan and S. London, "Atac: A data flow coverage testing tool for C", in Proc. of Second Symposium on Assessment of Quality software Tools, New Orleans, Louisiana, May 1992, pp. 2--10.
• 26: www.gnu.org/software/binutils/manual/gprof-2.9.1/gprof.html
• 27: Robin A. Sahner , Kishor S. Trivedi , Antonio Puliafito, Performance and reliability analysis of computer systems: an example-based approach using the SHARPE software package, Kluwer Academic Publishers, Norwell, MA, 1996
• 28: S. Krishnamurthy , A. P. Mathur, On The Estimation Of Reliability Of A Software System Using Reliabilities Of Its Components, Proceedings of the Eighth International Symposium on Software Reliability Engineering (ISSRE '97), p.146, November 02-05, 1997
• 29: Kishor S. Trivedi, Probability and statistics with reliability, queuing and computer science applications, John Wiley and Sons Ltd., Chichester, UK, 2001
• 30: J. Voas, A. Ghosh, Gary McGraw, F. Chharon, and K. Miller. "Defining an Adaptive Software Security Metric from a Dynamic Software Failure Tolerance Measure", in Proc. of the 11th Annual Conference on Computer Assurance (COMPASS'96), 1997.
• 31: Howard F. Lipson, Nancy R. Mead, Andrew P. Moore, "Can We Ever Build Survivable Systems from COTS Components?", Technical Note, CMU/SEI--2001.
• 32: Kateriana Goýeva-Popstojanova , Aditya Mathur P. , Kishor Trivedi S., Many architecture-based software reliability modelsComparison of Architecture-Based Software Reliability Models, Proceedings of the 12th International Symposium on Software Reliability Engineering (ISSRE'01), p.22, November 27-30, 2001
• 33: U. N. Bhat, "Elements of applied stochastic processes", Second edition, John Wiley & Sons, Inc., 1984.
• 34: Connie U. Smith, Performance Engineering of Software Systems, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 35: Vibhu Saujanya Sharma, Pankaj Jalote, Kishor S. Trivedi, "Evaluating Performance Attributes of Layered Software Architecture", To appear in Proc. of 8th International SIGSOFT Symposium on Component-based Software Engineering (CBSE), St. Louis, Missouri, USA, May 2005.
• 36: Dorin C. Petriu , C. Murray Woodside, Software Performance Models from System Scenarios in Use Case Maps, Proceedings of the 12th International Conference on Computer Performance Evaluation, Modelling Techniques and Tools, p.141-158, April 14-17, 2002

INDEX TERMS

General Terms:
Performance, Reliability, Security