Performance analysis of the ANGEL system for automated control of game traffic prioritisation

ABSTRACT

The Automated Network Games Enhancement Layer (ANGEL) [6] is a novel architecture for meeting Quality of Service (QoS) requirements of real-time network game traffic across consumer broadband links. ANGEL utilises detection of game traffic in the ISP network via the use of Machine Learning techniques and then uses this information to inform network routers - in particular the home access modem where bandwidth is limited - of these flows such that the traffic may be prioritised. In this paper we present the performance characteristics of the fully built ANGEL system. In particular we show that ANGEL is able to detect game traffic with better than 96% accuracy and effect prioritisation within a second of game flow detection. We also demonstrate the processing performance of key ANGEL components under typical hardware scenarios.

REFERENCES

• 1: SONG - Simulating Online Networked Games Database, Smart Internet CRC, May 2007. http://caia.swin.edu.au/sitcrc/staticpages/index.php?page=song.
• 2: University of twente - traffic measurement data repository, as of 26th March 2006. http://m2c-a.cs.utwente.nl/repository.
• 3: Et server, as of 27th April 2006. http://gs.act.grangenet.net.
• 4: A. McGregor, M. Hall, P. Lorier, J. Brunskill. Flow Clustering Using Machine Learning Techniques. In Passive & Active Measurement Workshop, April 2004.
• 5: Andrew W. Moore , Denis Zuev, Internet traffic classification using bayesian analysis techniques, ACM SIGMETRICS Performance Evaluation Review, v.33 n.1, June 2005
• 6: Jason But , Nigel Williams , Sebastian Zander , Lawrence Stewart , Grenville Armitage, Automated network games enhancement layer: a proposed architecture, Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games, October 30-31, 2006, Singapore [doi>10.1145/1230040.1230073]
• 7: D-Link. 108G Gaming Router. http://games.dlink.com/products/?pid=370.
• 8: G. Armitage, Networking and Online Games, John Wiley & Sons, 2006
• 9: G. J. Armitage. An Experimental Estimation of Latency Sensitivity in Multiplayer Quake3. In Proceedings 11th IEEE International Conference on Networks (ICON), September 2003.
• 10: J. But and J. Bussiere. Improving NetSniff Capture Performance on FreeBSD by Increasing the PCAP Capture Buffer Size. Technical Report 051027A, CAIA, October 2005. http://caia.swin.edu.au/reports/051027A/CAIA-TR-051027A.pdf.
• 11: J. But, S. Burriss, G. Armitage. Priority Queuing of Network Game Traffic over a DOCSIS Cable Modem Link. In Proceedings of Australian Telecommunications and Network Applications Conference (ATNAC), December 2006.
• 12: G. John and P. Langley. Estimating continuous distributions in Bayesian classifiers. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, 1995.
• 13: Matthias Dick , Oliver Wellnitz , Lars Wolf, Analysis of factors affecting players' performance and perception in multiplayer games, Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games, October 10-11, 2005, Hawthorne, NY [doi>10.1145/1103599.1103624]
• 14: T. Nguyen and G. Armitage. Synthetic Sub-flow Pairs for Timely and Stable IP Traffic Identification. In Proceedings of the Australian Telecommunication Networks and Application Conference, Melbourne, Australia, 2006.
• 15: T. Nguyen and G. Armitage. Training on multiple sub-flows to optimise the use of machine learning classifiers in real-world ip networks. In Proceedings of the IEEE 31st Conference on Local Computer Networks, Florida, USA, 2006.
• 16: S. Zander, G. Armitage. Empirically Measuring the QoS Sensitivity of Interactive Online Game Players. In Proceedings of Australian Telecommunications and Network Applications Conference (ATNAC), December 2004.
• 17: Sebastian Zander , Thuy Nguyen , Grenville Armitage, Automated Traffic Classification and Application Identification using Machine Learning, Proceedings of the The IEEE Conference on Local Computer Networks 30th Anniversary, p.250-257, November 15-17, 2005 [doi>10.1109/LCN.2005.35]
• 18: Tom Beigbeder , Rory Coughlan , Corey Lusher , John Plunkett , Emmanuel Agu , Mark Claypool, The effects of loss and latency on user performance in unreal tournament 2003®, Proceedings of 3rd ACM SIGCOMM workshop on Network and system support for games, August 30-30, 2004, Portland, Oregon, USA [doi>10.1145/1016540.1016556]
• 19: Tristan Henderson , Saleem Bhatti, Networked games: a QoS-sensitive application for QoS-insensitive users?, Proceedings of the ACM SIGCOMM workshop on Revisiting IP QoS: What have we learned, why do we care?, August 25-27, 2003, Karlsruhe, Germany [doi>10.1145/944592.944601]
• 20: W. E. Territory, as of December 2005. http://games.activision.com/games/wolfenstein.
• 21: Thomas M. Mitchell, Machine Learning, McGraw-Hill Higher Education, 1997
• 22: Ubicom Inc. Solving Performance Problems with Interactive Applications in a Broadband Environment using StreamEngine Technology, October 2004.
• 23: Nigel Williams , Sebastian Zander , Grenville Armitage, A preliminary performance comparison of five machine learning algorithms for practical IP traffic flow classification, ACM SIGCOMM Computer Communication Review, v.36 n.5, October 2006 [doi>10.1145/1163593.1163596]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS

General Terms:
Management, Performance

Keywords:
machine learning, online gaming, quality-of-service, traffic classification