Fine grain performance evaluation of e-commerce sites

ABSTRACT

E-commerce sites are still a reference for the Web technology in terms of complexity and performance requirements, including availability and scalability. In this paper we show that a coarse grain analysis, that is used in most performance studies, may lead to incomplete or false deductions about the behavior of the hardware and software components supporting e-commerce sites. Through a fine grain performance evaluation of a medium size e-commerce site, we find some interesting results that demonstrate the importance of an analysis approach that is carried out at the software function level with the combination of distribution oriented metrics instead of average values.

REFERENCES

• 1: Apache web server, 2004. http://httpd.apache.org/.
• 2: Valeria Cardellini , Emiliano Casalicchio , Michele Colajanni , Philip S. Yu, The state of the art in locally distributed Web-server systems, ACM Computing Surveys (CSUR), v.34 n.2, p.263-311, June 2002 [doi>10.1145/508352.508355]
• 3: E. Cecchet, A. Chanda, S. Elnikety, J. Marguerite, and W. Zwaenepoel. Performance comparison of middleware architectures for generating dynamic web content. In Proc. of 4th Middleware Conference, Jun 2003.
• 4: Michael Dahlin, Interpreting Stale Load Information, IEEE Transactions on Parallel and Distributed Systems, v.11 n.10, p.1033-1047, October 2000 [doi>10.1109/71.888643]
• 5: R. C. Dodge, D. A. Menascé, and D. Barbará. Testing e-commerce site scalability with tpc-w. In Proc. of 2001 Computer Measurement Group Conference, Dec 2001.
• 6: Sameh Elnikety , Erich Nahum , John Tracey , Willy Zwaenepoel, A method for transparent admission control and request scheduling in e-commerce web sites, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988710]
• 7: S. Godard. Syssyat: System performance tools for linux os, 2004. http://perso.wanadoo.fr/sebastien.godard/.
• 8: X. He and Q. Yang. Performance evaluation of distributed web server architectures under e-commerce workloads. In Proc. of the 1st Int'l Conference on Internet Computing (IC'2000), Jun 2000.
• 9: S. Hemminger. netem: Network emulator, 2004. - http://developer.osdl.org/shemminger/netem/.
• 10: Y. Hu, A. Nanda, and Q. Yang. Measurement, analysis and performance improvement of the apache web server. International Journal of Computers and Their Applications, 8(4), Dec. 2001.
• 11: A. Iyengar, R. King, H. Ludwig, and I. Rouvellou. Performance and service level considerations for distributed web applications. In In Proc. of the 7th World Multiconference on Systems, Cybernetics, and Informatics (SCI 2003), Jul 2003.
• 12: Java Technology. Java 2 platform, enterprise edition (j2ee), 2004. - http://java.sun.com/j2ee/index.jsp.
• 13: K. S. Juse, S. Kounev, and A. Buchmann. Petstore-ws: Measuring the performance implications of web services. In Proc. of the 29th Int'l Conference of the Computer Measurement Group (CMG) on Resource Management and Performance Evaluation of Enterprise Computing Systems - CMG2003, Dec. 2003.
• 14: J. Levon. Oprofile - a system profiler for linux, 2004. - http://oprofile.sourceforge.net/.
• 15: Mysql database server, 2004. - http://www.mysql.com/.
• 16: Erich M. Nahum , Marcel-Catalin Rosu , Srinivasan Seshan , Jussara Almeida, The effects of wide-area conditions on WWW server performance, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.257-267, June 2001, Cambridge, Massachusetts, United States
• 17: Php scripting language, 2004. - http://www.php.net/.
• 18: H. Xie, L. Bhuyan, and Y.-K. Chang. Benchmarking web server architectures: A simulation study on micro performance. In Fifth Workshop on Computer Architecture Evaluation using Commercial Workloads (CAECW-02), with HPCA-8, Feb 2002.