The many faces of publish/subscribe

ABSTRACT

Well adapted to the loosely coupled nature of distributed interaction in large-scale applications, the publish/subscribe communication paradigm has recently received increasing attention. With systems based on the publish/subscribe interaction scheme, subscribers register their interest in an event, or a pattern of events, and are subsequently asynchronously notified of events generated by publishers. Many variants of the paradigm have recently been proposed, each variant being specifically adapted to some given application or network model. This paper factors out the common denominator underlying these variants: full decoupling of the communicating entities in time, space, and synchronization. We use these three decoupling dimensions to better identify commonalities and divergences with traditional interaction paradigms. The many variations on the theme of publish/subscribe are classified and synthesized. In particular, their respective benefits and shortcomings are discussed both in terms of interfaces and implementations.

REFERENCES

• 1: Marcos K. Aguilera , Robert E. Strom , Daniel C. Sturman , Mark Astley , Tushar D. Chandra, Matching events in a content-based subscription system, Proceedings of the eighteenth annual ACM symposium on Principles of distributed computing, p.53-61, May 04-06, 1999, Atlanta, Georgia, United States [doi>10.1145/301308.301326]
• 2: Altherr, M., Erzberger, M., and Maffeis, S. 1999. iBus---a software bus middleware for the Java platform. In Proceedings of the International Workshop on Reliable Middleware Systems. 43--53.
• 3: Mehmet Altinel , Michael J. Franklin, Efficient Filtering of XML Documents for Selective Dissemination of Information, Proceedings of the 26th International Conference on Very Large Data Bases, p.53-64, September 10-14, 2000
• 4: A. L. Ananda , B. H. Tay , E. K. Koh, A survey of asynchronous remote procedure calls, ACM SIGOPS Operating Systems Review, v.26 n.2, p.92-109, April 1992 [doi>10.1145/142111.142121]
• 5: Jean Bacon , Ken Moody , John Bates , Richard Hayton , Chaoying Ma , Andrew McNeil , Oliver Seidel , Mark Spiteri, Generic Support for Distributed Applications, Computer, v.33 n.3, p.68-76, March 2000 [doi>10.1109/2.825698]
• 6: An Efficient Multicast Protocol for Content-Based Publish-Subscribe Systems, Proceedings of the 19th IEEE International Conference on Distributed Computing Systems, p.262, May 31-June 04, 1999
• 7: Guruduth Banavar , Tushar Deepak Chandra , Robert E. Strom , Daniel C. Sturman, A Case for Message Oriented Middleware, Proceedings of the 13th International Symposium on Distributed Computing, p.1-18, September 27-29, 1999
• 8: Suman Banerjee , Bobby Bhattacharjee , Christopher Kommareddy, Scalable application layer multicast, Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, August 19-23, 2002, Pittsburgh, Pennsylvania, USA
• 9: Kenneth P. Birman, The process group approach to reliable distributed computing, Communications of the ACM, v.36 n.12, p.37-53, Dec. 1993 [doi>10.1145/163298.163303]
• 10: Birman, K., Cooper, R., Joseph, T., Marzullo, K., Makpangou, M., Kane, K., Schmuck, F., and Wood, M. 1990. The Isis System Manual. Dept. of Computer Science, Cornell University, Ithaca, NY.
• 11: Kenneth P. Birman , Mark Hayden , Oznur Ozkasap , Zhen Xiao , Mihai Budiu , Yaron Minsky, Bimodal multicast, ACM Transactions on Computer Systems (TOCS), v.17 n.2, p.41-88, May 1999 [doi>10.1145/312203.312207]
• 12: Andrew D. Birrell , Bruce Jay Nelson, Implementing Remote procedure calls, Proceedings of the ninth ACM symposium on Operating systems principles, p.3, October 10-13, 1983, Bretton Woods, New Hampshire, United States
• 13: Burnie Blakeley , Harry Harris , Rhys Lewis, Messaging and queueing using the MQI, McGraw-Hill, Inc., New York, NY, 1995
• 14: Alexis Campailla , Sagar Chaki , Edmund Clarke , Somesh Jha , Helmut Veith, Efficient filtering in publish-subscribe systems using binary decision diagrams, Proceedings of the 23rd International Conference on Software Engineering, p.443-452, May 12-19, 2001, Toronto, Ontario, Canada
• 15: Denis Caromel, Toward a method of object-oriented concurrent programming, Communications of the ACM, v.36 n.9, p.90-102, Sept. 1993 [doi>10.1145/162685.162711]
• 16: Antonio Carzaniga , David S. Rosenblum , Alexander L. Wolf, Achieving scalability and expressiveness in an Internet-scale event notification service, Proceedings of the nineteenth annual ACM symposium on Principles of distributed computing, p.219-227, July 16-19, 2000, Portland, Oregon, United States [doi>10.1145/343477.343622]
• 17: Design and evaluation of a wide-area event notification service, ACM Transactions on Computer Systems (TOCS), v.19 n.3, p.332-383, Aug. 2001 [doi>10.1145/380749.380767]
• 18: Castro, M., Druschel, P., Kermarrec, A.-M., and Rowstron, A. 2002. SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE J. Sel. Areas Commun. 20, 8 (Oct.), 1489--1499.
• 19: Chan, C.-Y., Fan, W., Felber, P., Garofalakis, M., and Rastogi, R. 2002a. Tree pattern aggregation for scalable XML data dissemination. In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB '02, Hong Kong, China).
• 20: Efficient Filtering of XML Documents with XPath Expressions, Proceedings of the 18th International Conference on Data Engineering, p.235, February 26-March 01, 2002
• 21: Chung, P., Huang, Y., Yajnik, S., Liang, D., Shih, J., Wang, C.-Y., and Wang, Y. 1998. DCOM and CORBA side by side, step by step, and layer by layer. C++ Rep. 10, 1 (Jan.), 18--29.
• 22: Gianpaolo Cugola , Elisabetta Di Nitto , Alfonso Fuggetta, The JEDI Event-Based Infrastructure and Its Application to the Development of the OPSS WFMS, IEEE Transactions on Software Engineering, v.27 n.9, p.827-850, September 2001 [doi>10.1109/32.950318]
• 23: DEC. 1994. DECMessageQ: Introduction to Message Queuing. Digital Equipment Corporation; now part of Hewlett Packard, Palo Alto, CA.
• 24: Deering, S. n. d. Host extension for ip multicast. IETF RFC 1112. Internet Engineering Task Force (Web site: www.ietf.org).
• 25: YFilter: Efficient and Scalable Filtering of XML Documents, Proceedings of the 18th International Conference on Data Engineering, p.341, February 26-March 01, 2002
• 26: Eugster, P. and Guerraoui, R. 2001. Content-based publish/subscribe with structural reflection. In Proceedings of the 6th Usenix Conference on Object-Oriented Technologies and Systems (COOTS'01).
• 27: Patrick Th. Eugster , Rachid Guerraoui , Christian Heide Damm, On objects and events, Proceedings of the 16th ACM SIGPLAN conference on Object oriented programming, systems, languages, and applications, p.254-269, October 14-18, 2001, Tampa Bay, FL, USA
• 28: Patrick Th. Eugster , Rachid Guerraoui , Joe Sventek, Distributed Asynchronous Collections: Abstractions for Publish/Subscribe Interaction, Proceedings of the 14th European Conference on Object-Oriented Programming, p.252-276, June 12-16, 2000
• 29: Françoise Fabret , H. Arno Jacobsen , François Llirbat , Joăo Pereira , Kenneth A. Ross , Dennis Shasha, Filtering algorithms and implementation for very fast publish/subscribe systems, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.115-126, May 21-24, 2001, Santa Barbara, California, United States
• 30: Sally Floyd , Van Jacobson , Ching-Gung Liu , Steven McCanne , Lixia Zhang, A reliable multicast framework for light-weight sessions and application level framing, IEEE/ACM Transactions on Networking (TON), v.5 n.6, p.784-803, Dec. 1997 [doi>10.1109/90.650139]
• 31: Michael Franklin , Stanley Zdonik, A framework for scalable dissemination-based systems, Proceedings of the 12th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, p.94-105, October 05-09, 1997, Atlanta, Georgia, United States
• 32: Eric Freeman , Ken Arnold , Susanne Hupfer, JavaSpaces Principles, Patterns, and Practice, Addison-Wesley Longman Ltd., Essex, UK, 1999
• 33: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 34: David Garlan , David Notkin, Formalizing Design Spaces: Implicit Invocation Mechanisms, Proceedings of the 4th International Symposium of VDM Europe on Formal Software Development-Volume I: Conference Contributions, p.31-44, October 21-25, 1991
• 35: David Gelernter, Generative communication in Linda, ACM Transactions on Programming Languages and Systems (TOPLAS), v.7 n.1, p.80-112, Jan. 1985 [doi>10.1145/2363.2433]
• 36: Hapner, M., Burridge, R., Sharma, R., Fialli, J., and Stout, K. 2002. Java Message Service. Sun Microsystems Inc., Santa Clara, CA.
• 37: Timothy H. Harrison , David L. Levine , Douglas C. Schmidt, The design and performance of a real-time CORBA event service, Proceedings of the 12th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, p.184-200, October 05-09, 1997, Atlanta, Georgia, United States
• 38: Hauswirth, M. 1999. Internet-scale push systems for information distribution---architecture, components, and communication. Ph.D. dissertation. Technical University of Vienna, Vienna, Austria.
• 39: Manfred Hauswirth , Mehdi Jazayeri, A component and communication model for push systems, Proceedings of the 7th European software engineering conference held jointly with the 7th ACM SIGSOFT international symposium on Foundations of software engineering, p.20-38, September 06-10, 1999, Toulouse, France
• 40: Hugh W. Holbrook , Sandeep K. Singhal , David R. Cheriton, Log-based receiver-reliable multicast for distributed interactive simulation, Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, p.328-341, August 28-September 01, 1995, Cambridge, Massachusetts, United States
• 41: Horstmann, M. and Kirtland, M. 1997. DCOM architecture. Available online at www.microsoft. com/com/tech/DCOM.asp.
• 42: Houston, P. 1998. Building distributed applications with message queuing middleware White paper. Available online at http://msdn.microsoft. com/library/en-us/dnmqqc/html/bldappmq.asp.
• 43: Yongqiang Huang , Hector Garcia-Molina, Publish/Subscribe in a mobile enviroment, Proceedings of the 2nd ACM international workshop on Data engineering for wireless and mobile access, p.27-34, May 2001, Santa Barbara, California, United States [doi>10.1145/376868.376889]
• 44: IBM Corporation. 1995. MQSeries: An introduction to messaging and queuing. Tech. Rep. GC33-0805-01. IBM Corporation, Yorktown Heights, NY.
• 45: Lehman, T., Laughry, S. M., and Wyckoff, P. 1999. Tspaces: The next wave. In Proceedings of the Hawaii International Conference on System Sciences (HICSS-32).
• 46: Lewis, R. 1999. Advanced Messaging Applications with MSMQ and MQSeries. QUE.
• 47: Kai Li , Paul Hudak, Memory coherence in shared virtual memory systems, ACM Transactions on Computer Systems (TOCS), v.7 n.4, p.321-359, Nov. 1989 [doi>10.1145/75104.75105]
• 48: Lin, J. and Paul, S. 1996. A reliable multicast transport protocol. In Proceedings of the IEEE INFOCOM'96. IEEE Computer Society Press, Los Alamitos, CA, 1414--1424.
• 49: OMG. 2001. CORBA Event Service Specification. Object Management Group, Needham, MA.
• 50: OMG. 2002a. The Common Object Request Broker: Core Specification. Object Management Group, Needham, MA.
• 51: OMG. 2002b. CORBA Notification Service Specification. Object Management Group, Needham, MA.
• 52: Oracle 2002. Oracle9i Application Developer's Guide---Advanced Queuing. Oracle, Redwood Shores, CA.
• 53: Papadopoulos, G. and Arbab, F. 1998. Coordination models and languages. In The Engineering of Large Systems. Advances in Computers, vol. 46. Academic Press, New York, NY.
• 54: João Pereira , Françoise Fabret , François Llirbat , Dennis Shasha, Efficient Matching for Web-Based Publish/Subscribe Systems, Proceedings of the 7th International Conference on Cooperative Information Systems, p.162-173, September 06-08, 2000
• 55: David Powell, Group communication, Communications of the ACM, v.39 n.4, p.50-53, April 1996 [doi>10.1145/227210.227225]
• 56: Sylvia Ratnasamy , Mark Handley , Richard M. Karp , Scott Shenker, Application-Level Multicast Using Content-Addressable Networks, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.14-29, November 07-09, 2001
• 57: David S. Rosenblum , Alexander L. Wolf, A design framework for Internet-scale event observation and notification, Proceedings of the 6th European conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering, p.344-360, September 22-25, 1997, Zurich, Switzerland
• 58: Antony Rowstron, WCL: A co-ordination language for geographically distributed agents, World Wide Web, v.1 n.3, p.167-179, 1998 [doi>10.1023/A:1019263731139]
• 59: Segall, B. and Arnold, D. 1997. Elvin has left the building: A publish/subscribe notification service with quenching. In Proceedings of the Australian UNIX and Open Systems User Group Conference (AUUG'97). Available online at http://www.dtsc.edu.au/.
• 60: Segall, B., Arnold, D., Boot, J., Henderson, M., and Phelps, T. 2000. Content based routing with Elvin4. In AUUG2K (Canberra, Australia).
• 61: Roger Sessions, COM and DCOM: Microsoft's vision for distributed objects, John Wiley & Sons, Inc., New York, NY, 1997
• 62: Skeen, D. 1998. Vitria's Publish-Subscribe Architecture: Publish-Subscribe Overview. http://www.vitria.com.
• 63: Ion Stoica , Daniel Adkins , Shelley Zhuang , Scott Shenker , Sonesh Surana, Internet indirection infrastructure, Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, August 19-23, 2002, Pittsburgh, Pennsylvania, USA
• 64: Kevin Sullivan , David Notkin, Reconciling environment integration and component independence, Proceedings of the fourth ACM SIGSOFT symposium on Software development environments, p.22-33, December 03-05, 1990, Irvine, California, United States
• 65: Sun. 2000. Java Remote Method Invocation Specification. Sun Microsystems, Santa Clara, CA.
• 66: Sun. 2002. JavaSpaces Service Specification. Sun Microsystems, Santa Clara, CA.
• 67: Stefan Tai , Isabelle Rouvellou, Strategies for integrating messaging and distributed object transactions, IFIP/ACM International Conference on Distributed systems platforms, p.308-330, April 03-07, 2000, New York, New York, United States
• 68: Talarian Corporation. 1999. Everything you need to know about middleware: Mission-critical interprocess communication. White paper. Talarian Corporation, Los Altos, CA (now part of TIBCO, Palo Alto, CA). Available online at http://www.talarian. com/.
• 69: Ming-Chit Tam , Jonathan M. Smith , David J. Farber, A taxonomy-based comparison of several distributed shared memory systems, ACM SIGOPS Operating Systems Review, v.24 n.3, p.40-67, July 1990 [doi>10.1145/382244.382831]
• 70: B. H. Tay , A. L. Ananda, A survey of remote procedure calls, ACM SIGOPS Operating Systems Review, v.24 n.3, p.68-79, July 1990 [doi>10.1145/382244.382832]
• 71: TIBCO. 1999. TIB/Rendezvous. White paper. TIBCO, Palo Alto, CA.
• 72: Wessels, D. 1995. Intelligent caching for world-wide-web objects. In Proceedings of INET'95 (Honolulu, HI).
• 73: Akinori Yonezawa , Etsuya Shibayama , Toshihiro Takada , Yasuaki Honda, Modelling and programming in an object-oriented concurrent language ABCL/1, Object-oriented concurrent programming, MIT Press, Cambridge, MA, 1987
• 74: Shelley Q. Zhuang , Ben Y. Zhao , Anthony D. Joseph , Randy H. Katz , John D. Kubiatowicz, Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination, Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video, p.11-20, January 2001, Port Jefferson, New York, United States [doi>10.1145/378344.378347]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

Additional Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES
      D.1.3 Concurrent Programming
          Subjects: Distributed programming

General Terms:
Design

Keywords:
Distribution, interaction, publish/subscribe