A user-friendly self-similarity analysis tool

ABSTRACT

The concepts of self-similarity, fractals, and long-range dependence (LRD) have revolutionized network modeling during the last decade. However, despite all the attention these concepts have received, they remain difficult to use by non-experts. This difficulty can be attributed to a relative complexity of the mathematical basis, the absence of a systematic approach to their application and the absence of publicly available software. In this paper, we introduce SELFIS, a comprehensive tool, to facilitate the evaluation of LRD by practitioners. Our goal is to create a stand-alone public tool that can become a reference point for the community. Our tool integrates most of the required functionality for an in-depth LRD analysis, including several LRD estimators. In addition, SELFIS includes a powerful approach to stress-test the existence of LRD, Using our tool, evidence are presented that the widely-used LRD estimators can provide misleading results. It is worth mentioning that 25 researchers have acquired SELFIS within a month of its release, which clearly demonstrates the need for such a tool.

REFERENCES

• 1: The SELFIS Tool. http://www.cs.ucr.edu/~tkarag.
• 2: P.Abry and D. Veitch. Wavelet Analysis of Long-Range Dependence Traffic. In IEEE Transactions on Information Theory, 1998.
• 3: B. Audit, C. Vaillant, A. Arneodo, Y. d'Aubenton Carafa, and C. Thermes. Long-Range Correlation Between DNA Bending Sites. In Journal of Molecular Biology, volume 4, pages 903--918, 2002.
• 4: Julius S. Bendat , Allan G. Piersol, Random Data: Analysis and Measurement Procedures, John Wiley & Sons, Inc., New York, NY, 2000
• 5: J. Beran. Statistics for Long-memory Processes. Chapman and Hall, New York, 1994.
• 6: Mark E. Crovella , Azer Bestavros, Self-similarity in World Wide Web traffic: evidence and possible causes, IEEE/ACM Transactions on Networking (TON), v.5 n.6, p.835-846, Dec. 1997 [doi>10.1109/90.650143]
• 7: Ashok Erramilli , Onuttom Narayan , Walter Willinger, Experimental queueing analysis with long-range dependent packet traffic, IEEE/ACM Transactions on Networking (TON), v.4 n.2, p.209-223, April 1996 [doi>10.1109/90.491008]
• 8: A. Feldmann , A. C. Gilbert , W. Willinger, Data networks as cascades: investigating the multifractal nature of Internet WAN traffic, ACM SIGCOMM Computer Communication Review, v.28 n.4, p.42-55, Oct. 1998
• 9: Anja Feldmann , Anna C. Gilbert , Polly Huang , Walter Willinger, Dynamics of IP traffic: a study of the role of variability and the impact of control, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.301-313, August 30-September 03, 1999, Cambridge, Massachusetts, United States
• 10: A. Feldmann , A. C. Gilbert , W. Willinger , T. G. Kurtz, The changing nature of network traffic: scaling phenomena, ACM SIGCOMM Computer Communication Review, v.28 n.2, p.5-29, Apr. 1998 [doi>10.1145/279345.279346]
• 11: Matthias Grossglauser , Jean-Chrysostome Bolot, On the relevance of long-range dependence in network traffic, IEEE/ACM Transactions on Networking (TON), v.7 n.5, p.629-640, Oct. 1999 [doi>10.1109/90.803379]
• 12: G. K. K. Park and M. E. Crovella. On the Effect of Traffic Self-Similarity on Network Performance. In Proceedings of SPIE International Conference on Performance and Control of Network Systems, 1997.
• 13: T. Karagiannis and M. Faloutsos. SELFIS: A Tool For Self-Similarity and Long-Range Dependence Analysis. In 1st Workshop on Fractals and Self-Similarity in Data Mining: Issues and Approaches (in KDD), Edmonton, Canada, July 23, 2002.
• 14: T. Karagiannis, M. Faloutsos, and R. Riedi. Long-Range dependence: Now you see it, now you don't! In IEEE GLOBECOM, Global Internet Symposium, 2002.
• 15: M. Krunz. On the limitations of the variance-time test for inference of long-range dependence. In IEEE INFOCOM, pages 1254--1260, 2001.
• 16: Will E. Leland , Murad S. Taqqu , Walter Willinger , Daniel V. Wilson, On the self-similar nature of Ethernet traffic (extended version), IEEE/ACM Transactions on Networking (TON), v.2 n.1, p.1-15, Feb. 1994 [doi>10.1109/90.282603]
• 17: X. Lu, Z. Sun, H. Chen, and Y. Li. Characterizing Self-Similarity in Bacteria DNA Sequences. In Physical Review E, volume 58, pages 3578--3584, 1998.
• 18: S. Molnar and T. D. Dang. Pitfalls in Long Range Dependence Testing and Estimation. In GLOBECOM, 2000.
• 19: Kihong Park , Gitae Kim , Mark Crovella, On the relationship between file sizes, transport protocols, and self-similar network traffic, Proceedings of the 1996 International Conference on Network Protocols (ICNP '96), p.171, October 29-November 01, 1996
• 20: K. Park and W. Willinger. Self-similar network traffic: An overview. In Self-Similar Network Traffic and Performance Evaluation. Wiley-Interscience, 2000.
• 21: V. Paxson. Fast approximation of self similar network traffic. Technical Report LBL, 1995.
• 22: Vern Paxson , Sally Floyd, Wide area traffic: the failure of Poisson modeling, IEEE/ACM Transactions on Networking (TON), v.3 n.3, p.226-244, June 1995 [doi>10.1109/90.392383]
• 23: R. H. Riedi, M. S. Crouse, V. J. Ribeiro, and R. G. Baraniuk. A Multifractal Wavelet Model with Application to Network Traffic. In IEEE Special Issue on Information Theory, pages 992--1018, 1999.
• 24: Z. Sahinoglu and S. Tekinay. On Multimedia Networks: Self-similar Traffic and Network Performance. In IEEE Communications Magazine, volume 37, pages 48--52, 1999.
• 25: M. Schroeder. Fractals, Chaos, Power Laws: Minutes from an Infinite Paradise. W. H. Freeman & Co., 1992.
• 26: R. V. Sole, S. C. Manrubia, M. Benton, and P. Bak. Self-Similarity of Extinction Statistics in the Fossil Record. In Nature, volume 388, pages 764--767. Macmillan Publishers Ltd, 1997.
• 27: Murad S. Taqqu , Vadim Teverovsky, On estimating the intensity of long-range dependence in finite and infinite variance time series, A practical guide to heavy tails: statistical techniques and applications, Birkhauser Boston Inc., Cambridge, MA, 1998
• 28: V. Teverovsky. http://math.bu.edu/people/murad/methods/.
• 29: X. Tian, J. Wu, and C. Ji. A Unified Framework for Understanding Network Traffic Using Independent Wavelet Models. In IEEE INFOCOM, 2002.
• 30: Velleman, P. F., and D. C. Hoaglin. Applications, Basics, and Computing of Exploratory Data Analysis. Duxbury Press, Boston, MA, 1981.
• 31: A. Veres , Kenesi S. Molnár , G. Vattay, On the propagation of long-range dependence in the Internet, Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, p.243-254, August 28-September 01, 2000, Stockholm, Sweden
• 32: W. Willinger and V. Paxson. Where Mathematics Meets the Internet. In Notices of the AMS, 1998.
• 33: Walter Willinger , Murad S. Taqqu , Robert Sherman , Daniel V. Wilson, Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level, IEEE/ACM Transactions on Networking (TON), v.5 n.1, p.71-86, Feb. 1997 [doi>10.1109/90.554723]