Experiences with open overlays: a middleware approach to network heterogeneity

ABSTRACT

In order to provide an increasing number of functionalities and benefit from sophisticated and application-tailored services from the network, distributed applications are led to integrate an ever-widening range of networking technologies. As these applications become more complex, this requirement for 'network heterogeneity' is becoming a crucial issue in their development. Although progress has been made in the networking community in addressing such needs through the development of network overlays, we claim in this paper that the middleware community has been slow to integrate these advances into middleware architectures, and, hence, to provide the foundational bedrock for heterogeneous distributed applications. In response, we propose our 'open overlays' framework. This framework, which is part of a wider middleware architecture, accommodates 'overlay plug-ins', allows physical nodes to support multiple overlays, supports the stacking of overlays to create composite protocols, and adopts a declarative approach to configurable deployment and dynamic reconfigurability. The framework has been in development for a number of years and supports an extensive range of overlay plug-ins including popular protocols such as Chord and Pastry. We report on our experiences with the open overlays framework, evaluate it in detail, and illustrate its application in a detailed case study of network heterogeneity.

REFERENCES

• 1: A. Andersen, G. S. Blair, V. Goebel, R. Karlsen, T. Stabell-Kul and W. Yu. Arctic Beans: Configurable and Reconfigurable Enterprise Component Architectures. IEEE Distributed Systems Online, 2 (7), November 2001.
• 2: S. Behnel and A. Buchmann. Overlay Networks - Implementation by Specification. In Proceedings of the ACM/IFIP/Usenix International Middleware Conference, pages 401--410, Grenoble, France, November 2005.
• 3: K. Beven, R. Romanowicz, F. Pappenberger, P. Young and M. Werner. The Uncertainty Cascade in Flood Forecasting. In Proceedings of the ACTIF meeting on Flood Risk, Tromsø Norway, October 2005.
• 4: G. Blair, G. Coulson, A. Andersen, L. Blair, M. Clarke, F. Costa, H. Duran-Limon, T. Fitzpatrick, L. Johnston, R. Moreira, N. Parlavantzas and K. Saikoski. The Design and Implementation of Open ORB V2. IEEE Distributed Systems Online, 2(6), September 2001.
• 5: D. Bromberg and V. Issarny. INDISS: Interoperable Discovery System for Networked Services. In Proceedings of the ACM/IFIP/Usenix International Middleware Conference, pages 164--183, Greoble, France November 2005.
• 6: L. Capra, W. Emmerich and C. Mascolo. CARISMA: Context-Aware Reflective Middleware System for Mobile Applications. IEEE Transactions on Software Engineering, 29(10):929--945, October 2003.
• 7: M. Castro, P. Druschel, A. Kermarrec, and A. Rowstron. SCRIBE: A Large-scale and Decentralized Application-level Multicast Infrastructure. IEEE Journal on Selected Areas in Communications (JSAC), 20(8):1489--1499, October 2002.
• 8: B. Cooper. Trading off Resources Between Overlapping Overlays. In Proceedings of the ACM/IFIP/USENIX 7th International Middleware Conference, pages 101--120 Melbourne, Australia, December 2006.
• 9: Carlos A. Flores-Cortés , Gordon S. Blair , Paul Grace, A multi-protocol framework for ad-hoc service discovery, Proceedings of the 4th international workshop on Middleware for Pervasive and Ad-Hoc Computing (MPAC 2006), p.10, November 27-December 01, 2006, Melbourne, Australia [doi>10.1145/1169075.1169085]
• 10: Paolo Costa , Geoff Coulson , Richard Gold , Manish Lad , Cecilia Mascolo , Luca Mottola , Gian Pietro Picco , Thirunavukkarasu Sivaharan , Nirmal Weerasinghe , Stefanos Zachariadis, The RUNES Middleware for Networked Embedded Systems and its Application in a Disaster Management Scenario, Proceedings of the Fifth IEEE International Conference on Pervasive Computing and Communications, p.69-78, March 19-23, 2007 [doi>10.1109/PERCOM.2007.36]
• 11: Geoff Coulson , Gordon Blair , David Hutchison , Ackbar Joolia , Kevin Lee , Jo Ueyama , Antonio Gomes , Yimin Ye, NETKIT: a software component-based approach to programmable networking, ACM SIGCOMM Computer Communication Review, v.33 n.5, October 2003 [doi>10.1145/963985.963991]
• 12: G. Coulson, G. Blair, P. Grace, A. Joolia, K. Lee, K., and J. Ueyama, J. A Component Model for Building Systems Software. In Proceedings of Software Engineering and Applications (SEA'04), Cambridge, MA, USA, ACTA Press, ISBN 0-88986-425-X, November 2004.
• 13: Geoff Coulson , Dean Kuo , John Brooke, Sensor Networks + Grid Computing = A New Challenge for the Grid?, IEEE Distributed Systems Online, v.7 n.12, p.2, December 2006 [doi>10.1109/MDSO.2006.72]
• 14: G. Cugola, A. Murphy and G. Picco. Content-Based Publish-Subscribe in a Mobile Environment. Handbook of Mobile Middleware, Corradi, A., and Bellavista, P. eds., pages 257--285, Auerbach Publications, 2006.
• 15: F. Dabek, B. Zhao, P. Druschel, J. Kubiatowicz and I. Stoica. Towards a Common API for Structured P2P Overlays. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS), pages 33--44, Berkeley, CA, USA, February 2003.
• 16: Nigel Davies , Adrian Friday , Stephen P. Wade , Gordon S. Blair, L2imbo: a distributed systems platform for mobile computing, Mobile Networks and Applications, v.3 n.2, p.143-156, Aug. 1998 [doi>10.1023/A:1019116530113]
• 17: Viktor S. Wold Eide , Frank Eliassen , Olav Lysne, Supporting Distributed Processing of Time-Based Media Streams, Proceedings of the Third International Symposium on Distributed Objects and Applications, p.281, September 17-20, 2001
• 18: M. Fleury and F. Reverbel. The JBoss Extensible Server. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference, pages 344--373, Rio, Brazil, June 2003.
• 19: I. Foster. Globus Toolkit Version 4: Software for Service-Oriented Systems. In Proceedings of the IFIP International Conference on Network and Parallel Computing, Springer-Verlag LNCS 3779, pages 2--13, 2006.
• 20: Nathalie Furmento , Anthony Mayer , Stephen McGough , Steven Newhouse , Tony Field , John Darlington, ICENI: optimisation of component applications within a Grid environment, Parallel Computing, v.28 n.12, p.1753-1772, December 2002 [doi>10.1016/S0167-8191(02)00187-4]
• 21: Ayalvadi J. Ganesh , Anne-Marie Kermarrec , Laurent Massoulié, SCAMP: Peer-to-Peer Lightweight Membership Service for Large-Scale Group Communication, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.44-55, November 07-09, 2001
• 22: P. Grace, G. Blair and S. Samuel. ReMMoC: A Reflective Middleware to Support Mobile Client Interoperability. In Proceedings of the International Symposium on Distributed Objects and Applications (DOA), pages 1170--1187, Catania, Sicily, Italy, November 2003.
• 23: P. Grace, G. Coulson, G. Blair, L. Mathy, W. Yeung, W. Cai, D. Duce, and C. Cooper. GridKit: Pluggable Overlay Networks for Grid Computing. In Proceedings of the International Symposium on Distributed Objects and Applications, pages 1463--1481, Cyprus, October 2004.
• 24: P. Grace, G. Coulson, G. Blair and B. Porter. Deep Middleware for the Divergent Grid. In Proceedings of the 6th IFIP/ACM/USENIX International Middleware Conference, pages 334--353, Grenoble, France, November 2005.
• 25: Paul Grace , Geoff Coulson , Gordon S. Blair , Barry Porter, A distributed architecture meta-model for self-managed middleware, Proceedings of the 5th workshop on Adaptive and reflective middleware (ARM '06), p.3, November 27-December 01, 2006, Melbourne, Australia [doi>10.1145/1175855.1175858]
• 26: Karen Henricksen , Ricky Robinson, A survey of middleware for sensor networks: state-of-the-art and future directions, Proceedings of the international workshop on Middleware for sensor networks, p.60-65, November 28-28, 2006, Melbourne, Australia [doi>10.1145/1176866.1176877]
• 27: Vipul Hingne , Anupam Joshi , Tim Finin , Hillol Kargupta , Elias Houstis, Towards a Pervasive Grid, Proceedings of the 17th International Symposium on Parallel and Distributed Processing, p.207.2, April 22-26, 2003
• 28: D. Hughes, P. Greenwood, G. Coulson, G. Blair, F. Pappenberger, P. Smith and K. Beven. An Intelligent and Adaptable Flood Monitoring and Warning System. In Proceedings of the 5th UK E-Science All Hands Meeting (AHM'06), Nottingham, UK, September 2006 http://www.allhands.org.uk/2006/proceedings/proceedings/.
• 29: A. D. Joseph , A. F. de Lespinasse , J. A. Tauber , D. K. Gifford , M. F. Kaashoek, Rover: a toolkit for mobile information access, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.156-171, December 03-06, 1995, Copper Mountain, Colorado, United States
• 30: Fabio Kon , Manuel Román , Ping Liu , Jina Mao , Tomonori Yamane , Claudio Magalhã , Roy H. Campbell, Monitoring, security, and dynamic configuration with the dynamicTAO reflective ORB, IFIP/ACM International Conference on Distributed systems platforms, p.121-143, April 03-07, 2000, New York, New York, United States
• 31: B. Lagaisse and W. Joosen. True and Transparent Distributed Composition of Aspect-Components. In Proceedings of the International ACM/IFIP/Usenix Middleware Conference, LNCS 4290, pages 42--61, Melbourne, December 2006.
• 32: Baochun Li , Jiang Guo , Mea Wang, iOverlay: a lightweight middleware infrastructure for overlay application implementations, Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, October 18-22, 2004, Toronto, Canada
• 33: Boon Thau Loo , Tyson Condie , Joseph M. Hellerstein , Petros Maniatis , Timothy Roscoe , Ion Stoica, Implementing declarative overlays, ACM SIGOPS Operating Systems Review, v.39 n.5, December 2005
• 34: Balasubramaneyam Maniymaran , Marin Bertier , Anne-Marie Kermarrec, Build One, Get One Free: Leveraging the Coexistence of Multiple P2P Overlay Networks, Proceedings of the 27th International Conference on Distributed Computing Systems, p.33, June 25-27, 2007 [doi>10.1109/ICDCS.2007.88]
• 35: Laurent Mathy , Roberto Canonico , David Hutchison, An Overlay Tree Building Control Protocol, Proceedings of the Third International COST264 Workshop on Networked Group Communication, p.76-87, November 07-09, 2001
• 36: Barry Porter , Francois Taiani , Geoff Coulson, Generalised Repair for Overlay Networks, Proceedings of the 25th IEEE Symposium on Reliable Distributed Systems, p.132-142, October 02-04, 2006 [doi>10.1109/SRDS.2006.23]
• 37: O. Riva. Contory: A Middleware for the Provisioning of Context Information on Smart Phones. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference, pages 219--239, Melbourne, Australia, December 2006.
• 38: Adolfo Rodriguez , Charles Killian , Sooraj Bhat , Dejan Kostić , Amin Vahdat, MACEDON: methodology for automatically creating, evaluating, and designing overlay networks, Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation, p.20-20, March 29-31, 2004, San Francisco, California
• 39: M. Roman, D. Mickunas, F. Kon and R. Campbell. LegORB and Ubiquitous CORBA. In Proceedings of the Workshop on Reflective Middleware, IFIP/ACM Middleware'2000, IBM Palisades Executive Conference Center, NY, April 2000.
• 40: Manuel Roman , Nayeem Islam, Dynamically programmable and reconfigurable middleware services, Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, October 18-22, 2004, Toronto, Canada
• 41: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 42: S. M. Sadjadi , P. K. McKinley , E. P. Kasten, Architecture and Operation of an Adaptable Communication Substrate, Proceedings of the The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems (FTDCS'03), p.46, May 28-30, 2003
• 43: Andrew P. Sage , Christopher D. Cuppan, On the Systems Engineering and Management of Systems of Systems and Federations of Systems, Information-Knowledge-Systems Management, v.2 n.4, p.325-345, December 2001
• 44: Ion Stoica , Robert Morris , David Karger , M. Frans Kaashoek , Hari Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.149-160, August 2001, San Diego, California, United States
• 45: R. van Renesse, Y. Minsky and M. Hayden. A Gossip-Based Failure Detection Service. In Proceedings of the 1st IFIP International Conference on Middleware, pages 55--70, Lake District, UK, September 1998.
• 46: Robbert van Renesse , Ken Birman , Mark Hayden , Alexey Vaysburd , David Karr, Building adaptive systems using ensemble, Software—Practice & Experience, v.28 n.9, p.963-979, July 25, 1998 [doi>10.1002/(SICI)1097-024X(19980725)28:9<963::AID-SPE179>3.0.CO;2-9]
• 47: Xiaohui Gu , Klara Nahrstedt, An event-driven, user-centric, QoS-aware middleware framework for ubiquitous multimedia applications, Proceedings of the 2001 international workshop on Multimedia middleware, October 05, 2001, Ottawa, Ontario, Canada [doi>10.1145/985135.985155]
• 48: C. Zhang and H. Jacobsen. Refactoring Middleware with Aspects. IEEE Transactions on Parallel and Distributed Systems, 14(11):1058--1073, November 2003.

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

General Terms:
Algorithms, Design, Experimentation, Measurement, Reliability

Keywords:
WSN, framework, middleware, overlay network