A hybrid publish subscribe protocol

ABSTRACT

Content-based publish/subscribe system performance depends upon the efficient subscription matching and event dissemination to interested subscribers. We propose a hybrid content-based publish/subscribe protocol for large size events wherein a centralized brokering system is coupled with a decentralized BitTorrent-like peer-to-peer (P2P) protocol for scalable event distribution among publishers and subscribers. Events are mapped to a torrent that grows as new events are published. Subscribers self-broker on event metadata and request content only if interested. Subscriber interests determine event popularity that the broker estimates with sampling. Popular events are disseminated P2P; unpopular events, directly from the broker; and somewhat popular ones, with P2P and broker-directed pre-seeding. The challenge is the dissemination of popular events without overwhelming centralized resources while efficiently disseminating unpopular events that lack sufficient interest to sustain gossip-based dissemination. The key advances include new means of handling variable event popularity inherent in content-based pub/sub and an adaptive anti-entropy mechanism for undelivered events.

REFERENCES

• 1: Monsoon: Efficient distrobuted data dissemination. http://www.mitre.org/news/events/tech07/3112.pdf.
• 2: Network emulation testbed home. http://www.isislab.vanderbilt.edu/index.php3.
• 3: An open platform for developing, deploying, and accessing planetary-scale services. http://www.planet-lab.org.
• 4: bittorrent.org. Dht protocol. http://bittorrent.org/Draft_DHT_protocol.html, July 2006.
• 5: B. Cohen. Incentives build robustness in bittorrent. http://www.bittorrent.org/bittorrentecon.pdf, 2003.
• 6: V. T. Combs, R. Hillman, M. T. Muccio, and R. W. McKeel. Joint battlespace infosphere: Information management within a c2 enterprise. Ft. Belvoir: Defense Technical Information Center. http://handle.dtic.mil/100.2/ADA463694, 2005.
• 7: C. Dana, D. Li, D. Harrison, and C. Chuah. Bass: Bittorrent assisted streaming system for video-on-demand. http://www.ece.ucdavis.edu/~chuah/paper/2005/mmsp05-bass.pdf, 2005.
• 8: R. Szarowski. Hybrid publish-subscribe: A compromise approach for large-scale. citeseer.ist.psu.edu/643523.html.
• 9: Xiaoyu Yang , Yiming Hu, A DHT-based Infrastructure for Content-based Publish/Subscribe Services, Proceedings of the Seventh IEEE International Conference on Peer-to-Peer Computing, p.185-192, September 02-05, 2007

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Performance

Keywords:
BitTorrent, content distribution, event-based systems, middleware, peer-to-peer, publish and subscribe, scalability