The effect of latency on user performance in Warcraft III

ABSTRACT

Latency on the Internet is a well-known problem for interactive applications. With the increase in interactive network games comes the increased importance of understanding the effects of latency on user performance. Classes of network games such as First Person Shooters (FPS) and Real Time Strategy (RTS) differ in their user interaction model and hence susceptibility to latency. While previous work has measured the effects of latency on FPS games, there has been no systematic investigation of the effects of latency on RTS games. In this work, we design and conduct user studies that measure the impact of latency on user performance in Warcraft III, a popular RTS game. As a foundation for the research, we separated typical Warcraft III user interactions into the basic components of explore, build and combat, and analyzed each individually. We find modest statistical correlations between user performance and latency for exploration, but very weak correlations for building and combat. Overall, the effect of even very high latency, while noticeable to users, has a negligible effect on the outcome of the game. We attribute this somewhat surprising result to the nature of RTS game-play that clearly favors strategy over the real-time aspects.

REFERENCES

• 1: Mark Allman, A web server's view of the transport layer, ACM SIGCOMM Computer Communication Review, v.30 n.5, October 2000 [doi>10.1145/505672.505674]
• 2: Grenville Armitage. Lag Over 150 Milliseconds is Unacceptable, May 2001. {Online} http://gja.space4me.com/things/quake3-latency-051701.html.
• 3: Paul Bettner and Mark Terrano. 1500 Archers on a 28.8: Network Programming in Age of Empires and Beyond. Gamasutra, March 2001. {Online} http://www.gamasutra.com/-features/20010322/terrano_02.htm.
• 4: Nina Bhatti , Anna Bouch , Allan Kuchinsky, Integrating user-perceived quality into Web server design, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.1-16, June 2000, Amsterdam, The Netherlands
• 5: S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, and W. Weiss. An Architecture for Differentiated Services. IETF Request for Comments (RFC) 2475, December 1998.
• 6: U.S. Census Bureau. Home computers and internet use in the united states, September 2001. {Online} http://www.census.gov/prod/2001pubs/-p23-207.pdf.
• 7: Mark Claypool, David LaPoint, and Josh Winslow. Network Analysis of Counter-strike and Starcraft. In Proceedings of the 22nd IEEE International Performance, Computing, and Communications Conference (IPCCC), April 2003.
• 8: Chris Haag. Targeting, a Variation of Dead Veckoning, May 2001. {Online} http://www.gamedev.net/reference/articles/-article1370.asp.
• 9: Tristan Henderson, Latency and User Behaviour on a Multiplayer Game Server, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.1-13, November 07-09, 2001
• 10: International Digital Software Association. Economic Impacts of the Demand for Playing Interactive Entertainment Software, 2001. {Online} http://www.idsa.com/releases/EIS2001.pdf.
• 11: Peter Lincroft. The Internet Sucks: Or, What I Learned Coding X-Wing vs. Tie Fighter. Gamasutra, September 1999. {Online} http://www.gamasutra.com/features/19990903/-lincroft_01.htm.
• 12: Dmitri Loguinov , Hayder Radha, Measurement study of low-bitrate internet video streaming, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA [doi>10.1145/505202.505238]
• 13: S. McCreary and k claffy. Trends in Wide Area IP Traffic Patterns: A View from Ames Internet Exchange. In Proceedings of ITC Specialist Seminar on Measurment and Modeling of IP Traffic, pages 1--11, September 2000. {Online} http://www.caida.org/outreach/papers/-2000/AIX0005/AIX0005.html.
• 14: Yu-Shen Ng. Designing Fast-Action Games for the Internet. Gamasutra, September 1997. {Online} http://www.gamasutra.com/features/-19970905/ng_01.htm.
• 15: Blizzard Entertainment Press Release. Warcraft III - Shatters Sales Records Worldwide with over 1 Million Copies Sold, October 2002. {Online} http://www.blizzard.com/press/-020722war3.shtml.