Understanding the management of client perceived response time

ABSTRACT

Understanding and managing the response time of web services is of key importance as dependence on the World Wide Web continues to grow. We present Remote Latency-based Management (RLM), a novel server-side approach for managing pageview response times as perceived by remote clients, in real-time. RLM passively monitors server-side network traffic, accurately tracks the progress of page downloads and their response times in real-time, and dynamically adapts connection setup behavior and web page content as needed to meet response time goals. To manage client perceived pageview response times, RLM builds a novel event node model to guide the use of several techniques for manipulating the packet traffic in and out of a web server complex, including fast SYN and SYN/ACK retransmission, and embedded object removal and rewrite. RLM operates as a stand-alone appliance that simply sits in front of a web server complex, without any changes to existing web clients, servers, or applications. We have implemented RLM on an inexpensive, commodity, Linux-based PC and present experimental results that demonstrate its effectiveness in managing client perceived pageview response times on transactional e-commerce web workloads.

REFERENCES

• 1: Tarek F. Abdelzaher , Kang G. Shin , Nina Bhatti, Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach, IEEE Transactions on Parallel and Distributed Systems, v.13 n.1, p.80-96, January 2002 [doi>10.1109/71.980028]
• 2: Tarek F. Abdelzaher , Nina Bhatti, Web content adaptation to improve server overload behavior, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1563-1577, May 17, 1999
• 3: J. Almeida et al. Providing Differentiated Levels of Service in Web Content Hosting. In Workshop on Internet Server Performance Conference, June 1998.
• 4: Hari Balakrishnan , Venkata N. Padmanabhan , Srinivasan Seshan , Randy H. Katz, A comparison of mechanisms for improving TCP performance over wireless links, IEEE/ACM Transactions on Networking (TON), v.5 n.6, p.756-769, Dec. 1997 [doi>10.1109/90.650137]
• 5: Hari Balakrishnan , Srinivasan Seshan , Randy H. Katz, Improving reliable transport and handoff performance in cellular wireless networks, Wireless Networks, v.1 n.4, p.469-481, 1995 [doi>10.1007/BF01985757]
• 6: Paul Barford , Mark Crovella, Critical path analysis of TCP transactions, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.127-138, August 28-September 01, 2000, Stockholm, Sweden
• 7: Nina Bhatti , Anna Bouch , Allan Kuchinsky, Integrating user-perceived quality into Web server design, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.1-16, June 2000, Amsterdam, The Netherlands
• 8: N. Bhatti and R. Friedrich. Web Server Support for Tiered Services. IEEE Network, 13(5):6764--6771, September-October 1999.
• 9: J. M. Blanquer et al. Quorum: Flexible Quality of Service for Internet Services. In NSDI 2005, p. 159--174, Boston, MA, May 2005.
• 10: N. Cardwell, S. Savage, and T. Anderson. Modeling TCP Latency. In IEEE Infocom, volume 3, p. 1742--1751, 2000.
• 11: S. Chandra, C. Ellis, and A. Vahdat. Differentiated Multimedia Web Services Using Quality Aware Transcoding. In IEEE Infocom, Tel-Aviv, Israel, March 2000.
• 12: L. Cherkasova and P. Phaal. Session Based Admission Control: a Mechanism for Improving Performance of Commercial Web Sites. In IWQoS 1999, p. 226--235, London, UK, May 1999.
• 13: I. Cohen et al. Correlating Instrumentation Data to System States: A Building Block for Automated Diagnosis and Control. In OSDI 2004, p. 231--244, San Francisco, CA, December 2004.
• 14: M. Crovella, R. Frangioso, and M. Harchol-Balter. Connection Scheduling in Web Servers. In USITS 1999, p. 243--254, Boulder, CO, October 1999.
• 15: Yixin Diao , Joseph L. Hellerstein , Sujay Parekh, Optimizing Quality of Service Using Fuzzy Control, Proceedings of the 13th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management: Management Technologies for E-Commerce and E-Business Applications, p.42-53, October 21-23, 2002
• 16: Sameh Elnikety , Erich Nahum , John Tracey , Willy Zwaenepoel, A method for transparent admission control and request scheduling in e-commerce web sites, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988710]
• 17: Yun Fu , Amin Vahdat , Ludmila Cherkasova , Wenting Tang, EtE: Passive End-to-End Internet Service Performance Monitoring, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.115-130, June 10-15, 2002
• 18: E. Hu et al. Adaptive Fast Path Architecture. IBM Journal of Research and Development, 45(2):191--206, April 2001.
• 19: Hani Jamjoom , Padmanabhan Pillai , Kang G. Shin, Resynchronization and controllability of bursty service requests, IEEE/ACM Transactions on Networking (TON), v.12 n.4, p.582-594, August 2004 [doi>10.1109/TNET.2004.833147]
• 20: Hani Jamjoom , Kang G. Shin, Persistent dropping: an efficient control of traffic aggregates, Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications, August 25-29, 2003, Karlsruhe, Germany [doi>10.1145/863955.863988]
• 21: M. F. Kaashoek at al. Application Performance and Flexibility on Exokernel Systems. In OSDI, Saint-Malo, France, October 1997.
• 22: Maria Kihl , Niklas Widell, Admission control schemes guaranteeing customer QOS in commercial web sites, Proceedings of the IFIP TC6 / WG6.2 & WG6.7 Conference on Network Control and Engineering for QoS, Security and Mobility, p.305-316, October 23-25, 2002
• 23: X. Liu et al. Online Response Time Optimization of Apache Web Server. In IWQoS, p. 461--478, 2003.
• 24: Jeffrey C. Mogul , K. K. Ramakrishnan, Eliminating receive livelock in an interrupt-driven kernel, ACM Transactions on Computer Systems (TOCS), v.15 n.3, p.217-252, Aug. 1997 [doi>10.1145/263326.263335]
• 25: Erich M. Nahum , Marcel-Catalin Rosu , Srinivasan Seshan , Jussara Almeida, The effects of wide-area conditions on WWW server performance, Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.257-267, June 2001, Cambridge, Massachusetts, United States
• 26: David Olshefski , Jason Nieh , Dakshi Agrawal, Using certes to infer client response time at the web server, ACM Transactions on Computer Systems (TOCS), v.22 n.1, p.49-93, February 2004 [doi>10.1145/966785.966787]
• 27: D. Olshefski, J. Nieh, and E. Nahum. ksniffer: Determining the Remote Client Perceived Response Time from Live Packet Streams. In OSDI 2004, p. 333--346, San Francisco, CA, December 2004. USENIX.
• 28: Jitendra Padhye , Victor Firoiu , Don Towsley , Jim Kurose, Modeling TCP throughput: a simple model and its empirical validation, ACM SIGCOMM Computer Communication Review, v.28 n.4, p.303-314, Oct. 1998
• 29: P. Pradhan et al. An Observation-based Approach Towards Self-managing Web Servers. In IWQoS 2002, p. 13--22, Miami, FL, May 2002. IEEE/ACM.
• 30: A. Rubini. rshaper. HTTP://www.linux.it/~rubini/software/index.html.
• 31: S. Seshan, M. Stemm, and R. Katz. Benefits of Transparent Content Negotiation in HTTP. In IEEE GLOBECOM 98 Internet Mini-Conference, Sydney, Australia, Nov. 1998.
• 32: B. Sikdar, S. Kalyanaraman, and K. Vastola. Analytic Models and Comparative Study of the Latency and Steady-state Throughput of TCP Tahoe, Reno and SACK. In IEEE GLOBECOM, p. 100--110, San Antonio, TX, November 2001.
• 33: The Transaction Processing Council (TPC). http://www.tpc.org/tpcw.
• 34: Tomcat 5.5. http://www.jakarta.apache.org/tomcat.
• 35: TPC-W Java Implementation. http://mitglied.lycos.de/jankiefer/tpcw.
• 36: Thiemo Voigt , Renu Tewari , Douglas Freimuth , Ashish Mehra, Kernel Mechanisms for Service Differentiation in Overloaded Web Servers, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.189-202, June 25-30, 2001
• 37: J. Wei and C.-Z. Xu. eQoS: Provisioning of Client-Perceived End-to-End QoS Guarantees in Web Servers. In IQWoS 2005, Passau, Germany, June 2005.
• 38: Carey Williamson , Qian Wu, A case for context-aware TCP/IP, ACM SIGMETRICS Performance Evaluation Review, v.29 n.4, March 2002 [doi>10.1145/512840.512843]
• 39: Yin Zhang , Nick Duffield, On the constancy of internet path properties, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA [doi>10.1145/505202.505228]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Modeling techniques

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Client/server

General Terms:
Experimentation, Management, Measurement, Performance

Keywords:
QoS, admission control, client perceived response time, web server performance