Networked games: a QoS-sensitive application for QoS-insensitive users?

ABSTRACT

Research into providing different levels of network Quality of Service (QoS) often assumes that there is a large market for QoS-sensitive applications that will be fulfilled once QoS-enabled networks have been deployed. Multiplayer networked games are an example of such an application that requires QoS, and hence will only become popular if QoS is made widely available. The prima facie evidence, however, is that games are already popular, in spite of the existing QoS-free best-effort Internet.Networked games may have become popular despite the lack of QoS because players "make do" with what is available to them. Such popularity is a double-edged sword. It may mean that there is a demand, as yet unfulfilled, from game players for QoS-enabled networks. On the other hand, it may mean that players have become accustomed to playing games without QoS, and therefore might be less willing to pay for higher QoS when it does eventually become available.In this paper we present the results of a short experiment to examine the QoS tolerances of game players. We use a set of popular First Person Shooter (FPS) game servers that are publicly available to Internet users at large. By systematically altering the network latency to the servers, we attempt to study whether degraded QoS (in the form of higher network delay) affects a user's decision to participate in the game.We find that increased network delay has an effect on a user's decision to join a game server. It appears, however, that there is no significant difference in the number of players who leave the game as a result of increased delay. We speculate that this may be due to a user's enjoyment exceeding their QoS-sensitivity, and discuss the implications of our findings with respect to providing and charging for QoS.

REFERENCES

• 1: G. Armitage. Sensitivity of Quake3 players to network latency. Poster, ACM SIGCOMM Internet Measurement Workshop 2001, Berkeley, CA, USA, Nov. 2001.
• 2: Robert W. Bailey, Human performance engineering: using human factors/ergonomics to achieve computer system usability (2nd ed.), Prentice-Hall, Inc., Upper Saddle River, NJ, 1989
• 3: Y. W. Bernier. Latency compensating methods in client/server in-game protocol design and optimization. In Proceedings of the 15th Games Developers Conference, San Jose, CA, USA, Mar. 2001.
• 4: S. Blake, D. L. Black, M. Carlson, E. Davies, Z. Wang, and W. Weiss. An architecture for differentiated services, Dec. 1998. RFC 2475.
• 5: R. Braden, D. Clark, and S. Shenker. Integrated Services in the Internet architecture: an overview, June 1994. RFC 1633.
• 6: S. Cheshire. Latency and the quest for interactivity, Nov. 1996. White paper commissioned by Volpe Welty Asset Management, L.L.C., for the Synchronous Person-to-Person Interactive Computing Environments Meeting.
• 7: Framework and requirements of Quality of Service for multimedia applications, Proceedings of the 1997 IASTED International Conference on Intelligent Information Systems (IIS '97), p.466, December 08-10, 1997
• 8: Inside Sony Online Entertainment. Edge, 102:56--61, Oct. 2001.
• 9: P. C. Fishburn and A. M. Odlyzko. Competitive pricing of information goods: Subscription pricing versus pay-per-use. Economic Theory, 13(2):447--470, Mar. 1999.
• 10: J. Heinanen, F. Baker, W. Weiss, and J. Wroclawski. Assured forwarding PHB group, June 1999. RFC 2597.
• 11: Tristan Henderson, Latency and User Behaviour on a Multiplayer Game Server, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.1-13, November 07-09, 2001
• 12: Tristan Henderson, Observations on game server discovery mechanisms, Proceedings of the 1st workshop on Network and system support for games, p.47-52, April 16-17, 2002, Bruanschweig, Germany [doi>10.1145/566500.566507]
• 13: Institute of Electrical and Electronic Engineers. 1278.2-1995, IEEE Standard for Distributed Interactive Simulation --- Communication Services and Profiles. IEEE, New York, NY, USA, Apr. 1996.
• 14: International Telecommunication Union. ITU-T Recommendation G.114: International telephone connections and circuits --- General Recommendations on the transmission quality for an entire international telephone connection --- One-way transmission time. International Telecommunication Union, Geneva, Switzerland, May 2000.
• 15: V. Jacobson, K. Nichols, and K. Poduri. An expedited forwarding PHB, June 1999. RFC 2598.
• 16: Y. A. Korilis, A. A. Lazar, and A. Orda. Architecting noncooperative networks. IEEE Journal of Selected Areas In Communications, 13(7):1241--1251, Sept. 1995.
• 17: J. Larkin. Winning the monster game. Far Eastern Economic Review, page 32, Sept. 05, 2002.
• 18: I. Scott MacKenzie , Colin Ware, Lag as a determinant of human performance in interactive systems, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.488-493, May 1993, Amsterdam, The Netherlands
• 19: L. Mathy, C. Edwards, and D. Hutchison. Principles of QoS in group communications. Telecommunication Systems, 11(1--2):59--84, 1999.
• 20: S. McCreary and K. Claffy. Trends in wide area IP traffic patterns: A view from Ames Internet Exchange. In Proceedings of the ITC Specialist Seminar on IP Traffic Modeling, Measurement and Management, Monterey, CA, USA, Sept. 2000.
• 21: E. Medina. Yahoo enters game rental arena. Boston Globe, page C3, Sept. 23, 2002.
• 22: netfilter/iptables project. http://netfilter.samba.org.
• 23: A. M. Odlyzko. Internet pricing and the history of communications. Computer Networks, 36(5--6):493--517, Aug. 2001.
• 24: Manuel Oliveira , Tristan Henderson, What online gamers really think of the Internet?, Proceedings of the 2nd workshop on Network and system support for games, p.185-193, May 22-23, 2003, Redwood City, California [doi>10.1145/963900.963918]
• 25: Lothar Pantel , Lars C. Wolf, On the impact of delay on real-time multiplayer games, Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video, May 12-14, 2002, Miami, Florida, USA [doi>10.1145/507670.507674]
• 26: Kihong Park , Meera Sitharam , Shaogang Chen, Quality of service provision in noncooperative networks: heterogenous preferences, multi-dimensional QoS vectors, and burstiness, Proceedings of the first international conference on Information and computation economies, p.111-127, October 25-28, 1998, Charleston, South Carolina, United States [doi>10.1145/288994.289022]
• 27: Kyoung Shin Park , Robert V. Kenyon, Effects of Network Characteristics on Human Performance in a Collaborative Virtual Environment, Proceedings of the IEEE Virtual Reality, p.104, March 13-17, 1999
• 28: A. Patrizio. Coming soon: Pay-per-game. Wired News, Oct. 20, 2000. http://www.wired.com/news/culture/0,1284,39505,00.html.
• 29: M. Ranta-aho, A. Leppinen, G. Poulain, A. Roella, M. Mirabelli, A. Ousland, and J. Norgaard. Task-dependent user requirements for Quality of service of Videoconferencing-CSCW services. In Proceedings of the 16th International Symposium on Human Factors in Telecommunications, pages 251--254, Oslo, Norway, May 1997.
• 30: D. P. Reed. Going nowhere fast. Context Magazine, July/Aug. 1999.
• 31: Christian Schaefer , Thomas Enderes , Hartmut Ritter , Marina Zitterbart, Subjective quality assessment for multiplayer real-time games, Proceedings of the 1st workshop on Network and system support for games, p.74-78, April 16-17, 2002, Bruanschweig, Germany [doi>10.1145/566500.566511]
• 32: Nathan Sheldon , Eric Girard , Seth Borg , Mark Claypool , Emmanuel Agu, The effect of latency on user performance in Warcraft III, Proceedings of the 2nd workshop on Network and system support for games, p.3-14, May 22-23, 2003, Redwood City, California [doi>10.1145/963900.963901]
• 33: Slashdot.org. How fast too slow? A study of Quake pings, May 24, 2001. http://slashdot.org/articles/01/05/24/2044233.shtml.
• 34: M. Terrano and P. Bettner. 1500 archers on a 28.8: Network programming in Age of Empires and beyond. In Proceedings of the 15th Games Developers Conference, San Jose, CA, USA, Mar. 2001.
• 35: Ivan Vaghi , Chris Greenhalgh , Steve Benford, Coping with inconsistency due to network delays in collaborative virtual environments, Proceedings of the ACM symposium on Virtual reality software and technology, p.42-49, December 20-22, 1999, London, United Kingdom [doi>10.1145/323663.323670]