|
 ABSTRACT
We have developed Gigascope, a stream database for network applications including traffic analysis, intrusion detection, router configuration analysis, network research, network monitoring, and performance monitoring and debugging. Gigascope is undergoing installation at many sites within the AT&T network, including at OC48 routers, for detailed monitoring. In this paper we describe our motivation for and constraints in developing Gigascope, the Gigascope architecture and query language, and performance issues. We conclude with a discussion of stream database research problems we have found in our application.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
1
|
Brian Babcock , Shivnath Babu , Mayur Datar , Rajeev Motwani , Jennifer Widom, Models and issues in data stream systems, Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 03-05, 2002, Madison, Wisconsin
[doi> 10.1145/543613.543615]
|
| |
2
|
D. Carney and et al. Monitoring streams - a new class of data management applications. In Proc. Intl. Conf. Ver Large Databases, 2002.
|
| |
3
|
|
| |
4
|
Chuck Cranor , Yuan Gao , Theodore Johnson , Vlaidslav Shkapenyuk , Oliver Spatscheck, Gigascope: high performance network monitoring with an SQL interface, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin
[doi> 10.1145/564691.564777]
|
| |
5
|
|
| |
6
|
M. Sullivan and A. Heybey. Tribeca: A system for managing large databases of network traffic. In Proc. USENIX Annual Technical Conf., 1998.
|
| |
7
|
P. Tucker and D. Maier. Exploiting punctuation semantics for querying continuous data streams. In intl. Conf. Data Engineering, 2002.
|
CITED BY 92
|
|
Abhishek Kumar , Jun (Jim) Xu , Li Li , Jia Wang, Space-code bloom filter for efficient traffic flow measurement, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA
|
|
|
|
|
|
|
|
|
|
|
|
Subhabrata Sen , Oliver Spatscheck , Dongmei Wang, Accurate, scalable in-network identification of p2p traffic using application signatures, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA
|
|
|
L. Bent , M. Rabinovich , G. M. Voelker , Z. Xiao, Characterization of a large web site population with implications for content delivery, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA
|
|
|
Graham Cormode , Theodore Johnson , Flip Korn , S. Muthukrishnan , Oliver Spatscheck , Divesh Srivastava, Holistic UDAFs at streaming speeds, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France
|
|
|
|
|
|
|
|
|
|
|
|
Matthew Roughan , Subhabrata Sen , Oliver Spatscheck , Nick Duffield, Class-of-service mapping for QoS: a statistical signature-based approach to IP traffic classification, Proceedings of the 4th ACM SIGCOMM conference on Internet measurement, October 25-27, 2004, Taormina, Sicily, Italy
|
|
|
Shivnath Babu , Rajeev Motwani , Kamesh Munagala , Itaru Nishizawa , Jennifer Widom, Adaptive ordering of pipelined stream filters, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Jin Li , David Maier , Kristin Tufte , Vassilis Papadimos , Peter A. Tucker, Semantics and evaluation techniques for window aggregates in data streams, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Roxana Geambasu , Tanya Bragin , Jaeyeon Jung , Magdalena Balazinska, On-demand view materialization and indexing for network forensic analysis, Proceedings of the 3rd USENIX international workshop on Networking meets databases, p.1-7, April 10, 2007, Cambridge, MA
|
|
|
|
|
|
Lei Guo , Enhua Tan , Songqing Chen , Zhen Xiao , Oliver Spatscheck , Xiaodong Zhang, Delving into internet streaming media delivery: a quality and resource utilization perspective, Proceedings of the 6th ACM SIGCOMM on Internet measurement, October 25-27, 2006, Rio de Janeriro, Brazil
|
|
|
|
|
|
Ioana Stanoi , George Mihaila , Themis Palpanas , Christian Lang, Maximizing the sustained throughput of distributed continuous queries, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA
|
|
|
|
|
|
|
|
|
Yijian Bai , Hetal Thakkar , Haixun Wang , Chang Luo , Carlo Zaniolo, A data stream language and system designed for power and extensibility, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA
|
|
|
Zhang Longbo , Li Zhanhuai , Zhao Yiqiang , Yu Min , Zhang Yang, A priority random sampling algorithm for time-based sliding windows over weighted streaming data, Proceedings of the 2007 ACM symposium on Applied computing, March 11-15, 2007, Seoul, Korea
|
|
|
Edith Cohen , Nick Duffield , Haim Kaplan , Carsten Lund , Mikkel Thorup, Sketching unaggregated data streams for subpopulation-size queries, Proceedings of the twenty-sixth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 11-13, 2007, Beijing, China
|
|
|
Herbert Bos , Willem de Bruijn , Mihai Cristea , Trung Nguyen , Georgios Portokalidis, FFPF: fairly fast packet filters, Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, p.24-24, December 06-08, 2004, San Francisco, CA
|
|
|
Lei Guo , Songqing Chen , Zhen Xiao , Enhua Tan , Xiaoning Ding , Xiaodong Zhang, Measurements, analysis, and modeling of BitTorrent-like systems, Proceedings of the Internet Measurement Conference 2005 on Internet Measurement Conference, p.4-4, October 19-21, 2005, Berkeley, CA
|
|
|
Patrick Verkaik , Oliver Spatscheck , Jacobus Van der Merwe , Alex C. Snoeren, PRIMED: community-of-interest-based DDoS mitigation, Proceedings of the 2006 SIGCOMM workshop on Large-scale attack defense, p.147-154, September 11-15, 2006, Pisa, Italy
|
|
|
|
|
|
Abhinandan Das , Sumit Ganguly , Minos Garofalakis , Rajeev Rastogi, Distributed set-expression cardinality estimation, Proceedings of the Thirtieth international conference on Very large data bases, p.312-323, August 31-September 03, 2004, Toronto, Canada
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Lisha Ma , Werner Nutt , Hamish Taylor, Condensative stream query language for data streams, Proceedings of the eighteenth conference on Australasian database, p.113-122, January 30-February 02, 2007, Ballarat, Victoria, Australia
|
|
|
|
|
|
Navendu Jain , Dmitry Kit , Prince Mahajan , Praveen Yalagandula , Mike Dahlin , Yin Zhang, STAR: self-tuning aggregation for scalable monitoring, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Demetris Antoniades , Panagiotis Trimintzios , Michalis Polychronakis , Sven Ubik , Antonis Papadogiannakis , Vladimir Smotlacha, LOBSTER: a European platform for passive network traffic monitoring, Proceedings of the 4th International Conference on Testbeds and research infrastructures for the development of networks & communities, March 18-20, 2008, Innsbruck, Austria
|
|
|
|
|
|
|
|
|
Jimeng Sun , Evan Hoke , John D. Strunk , Gregory R. Ganger , Christos Faloutsos, Intelligent system monitoring on large clusters, Proceedings of the 3rd workshop on Data management for sensor networks: in conjunction with VLDB 2006, September 11-11, 2006, Seoul, Korea
|
|
|
|
|
|
|
|
|
Qiuxia Chen , Lei Chen , Xiang Lian , Yunhao Liu , Jeffrey Xu Yu, Indexable PLA for efficient similarity search, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
|
|
|
|
|
|
Andrew Witkowski , Srikanth Bellamkonda , Hua-Gang Li , Vince Liang , Lei Sheng , Wayne Smith , Sankar Subramanian , James Terry , Tsae-Feng Yu, Continuous queries in oracle, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
|
|
|
|
|
|
|
|
|
|
|
|
Lukasz Golab , Theodore Johnson , Nick Koudas , Divesh Srivastava , David Toman, Optimizing away joins on data streams, Proceedings of the 2nd international workshop on Scalable stream processing system, March 29-29, 2008, Nantes, France
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Edith Cohen , Nick Duffield , Haim Kaplan , Carsten Lund , Mikkel Thorup, Stream sampling for variance-optimal estimation of subset sums, Proceedings of the Nineteenth Annual ACM -SIAM Symposium on Discrete Algorithms, p.1255-1264, January 04-06, 2009, New York, New York
|
|
|
|
|
|
Irina Botan , Gustavo Alonso , Peter M. Fischer , Donald Kossmann , Nesime Tatbul, Flexible and scalable storage management for data-intensive stream processing, Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology, March 24-26, 2009, Saint Petersburg, Russia
|
|
|
|
|
|
|
|
|
|
|
|
Jeffrey Erman , Alexandre Gerber , Mohammad T. Hajiaghayi , Dan Pei , Oliver Spatscheck, Network-aware forward caching, Proceedings of the 18th international conference on World wide web, April 20-24, 2009, Madrid, Spain
|
|
|
|
|
Adobe Acrobat
QuickTime
Windows Media Player
Real Player
Pdf
H.2