Supporting a spectrum of out-of-order event processing technologies: from aggressive to conservative methodologies

ABSTRACT

This demonstration presents a complex event processing system which focuses on out-of-order handling. State-of-the-art event stream processing technology experiences significant challenges when faced with out-of-order data arrival including huge system latencies, missing results, and incorrect result generation. We propose two out-of-order handling techniques, conservative and aggressive strategies. We will show the efficiency of our techniques and how they can satisfy various QoS requirements of different applications.

REFERENCES

• 1: A. J. Demers, J. Gehrke and B. Panda et al. Cayuga: A general purpose event monitoring system. In CIDR, pages 412--422, 2007.
• 2: A. Arasu, S. Babu, and J. Widom. CQL: A language for continuous queries over streams and relations. In DBPL, pages 1--19, Sep 2003.
• 3: Shivnath Babu , Utkarsh Srivastava , Jennifer Widom, Exploiting k-constraints to reduce memory overhead in continuous queries over data streams, ACM Transactions on Database Systems (TODS), v.29 n.3, p.545-580, September 2004 [doi>10.1145/1016028.1016032]
• 4: Jeong-Hyon Hwang , Magdalena Balazinska , Alexander Rasin , Ugur Cetintemel , Michael Stonebraker , Stan Zdonik, High-Availability Algorithms for Distributed Stream Processing, Proceedings of the 21st International Conference on Data Engineering, p.779-790, April 05-08, 2005 [doi>10.1109/ICDE.2005.72]
• 5: Mo Liu , Ming Li , Denis Golovnya , Elke A. Rundensteiner , Kajal Claypool, Sequence Pattern Query Processing over Out-of-Order Event Streams, Proceedings of the 2009 IEEE International Conference on Data Engineering, p.784-795, March 29-April 02, 2009 [doi>10.1109/ICDE.2009.95]
• 6: Peter A. Tucker , David Maier , Tim Sheard , Leonidas Fegaras, Exploiting Punctuation Semantics in Continuous Data Streams, IEEE Transactions on Knowledge and Data Engineering, v.15 n.3, p.555-568, March 2003 [doi>10.1109/TKDE.2003.1198390]
• 7: Sharma Chakravarthy , V. Krishnaprasad , Eman Anwar , S.-K. Kim, Composite Events for Active Databases: Semantics, Contexts and Detection, Proceedings of the 20th International Conference on Very Large Data Bases, p.606-617, September 12-15, 1994
• 8: Utkarsh Srivastava , Jennifer Widom, Flexible time management in data stream systems, Proceedings of the twenty-third ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 14-16, 2004, Paris, France [doi>10.1145/1055558.1055596]
• 9: Eugene Wu , Yanlei Diao , Shariq Rizvi, High-performance complex event processing over streams, Proceedings of the 2006 ACM SIGMOD international conference on Management of data, June 27-29, 2006, Chicago, IL, USA [doi>10.1145/1142473.1142520]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing

General Terms:
Algorithms, Design

Keywords:
complex event processing, out-of-order data, stream processing