A novel domain oriented approach for scientific grid workflow composition

ABSTRACT

Existing knowledge based Grid workflow languages and composition tools require sophisticated expertise of domain scientists in order to automate the process of managing workflows and its components (activities). So far semantic workflow specification and management has not been addressed from a general and integrated perspective. This paper presents a novel domain oriented approach which features separations of concerns between data meaning and data representation and between activity function (semantic description of workflow activities) and activity type (syntactic description of workflow activities). These separations are implemented as part of Abstract Grid Workflow Language (AGWL) which supports the development of Grid workflows at a high level (semantic) of abstraction. The corresponding workflow composition tool simplifies Grid workflow composition by (i) enabling users to compose Grid workflows at the level of data meaning and activity function that shields the complexity of the Grid, any specific implementation technology (e.g. Web or Grid service) and any specific data representation, (ii) semi-automatic data flow composition, and (iii) automatic data conversions. We have implemented our approach as part of the ASKALON Grid application development and computing environment. We demonstrate the effectiveness of our approach by applying it to a real world meteorology workflow application and report some preliminary results. Our approach can also be adapted to other scientific domains by developing the corresponding ontologies for those domains.

REFERENCES

• 1: Ewa Deelman , Gurmeet Singh , Mei-Hui Su , James Blythe , Yolanda Gil , Carl Kesselman , Gaurang Mehta , Karan Vahi , G. Bruce Berriman , John Good , Anastasia Laity , Joseph C. Jacob , Daniel S. Katz, Pegasus: A framework for mapping complex scientific workflows onto distributed systems, Scientific Programming, v.13 n.3, p.219-237, July 2005
• 2: Tom Oinn , Matthew Addis , Justin Ferris , Darren Marvin , Martin Senger , Mark Greenwood , Tim Carver , Kevin Glover , Matthew R. Pocock , Anil Wipat , Peter Li, Taverna: a tool for the composition and enactment of bioinformatics workflows, Bioinformatics, v.20 n.17, p.3045-3054, November 2004 [doi>10.1093/bioinformatics/bth361]
• 3: Kepler: An Extensible System for Design and Execution of Scientific Workflows, Proceedings of the 16th International Conference on Scientific and Statistical Database Management, p.423, June 21-23, 2004 [doi>10.1109/SSDBM.2004.44]
• 4: Ian Taylor , Ian Wang , Matthew Shields , Shalil Majithia, Distributed computing with Triana on the Grid: Research Articles, Concurrency and Computation: Practice & Experience, v.17 n.9, p.1197-1214, August 2005 [doi>10.1002/cpe.v17:9]
• 5: A. Mayer, S. McGough, N. Furmento, J. Cohen, M. Gulamali, L. Young, A. Afzal, S. Newhouse, J. D. V. Getov, and T. Kielmann, Component Models and Systems for Grid Applications, ser. CoreGRID series. Springer, June 2004, vol. 1, ch. ICENI: An Integrated Grid Middleware to Support e-Science, pp. 109--124.
• 6: T. Fahringer, R. Prodan, R. Duan, J. Hofer, F. Nadeem, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H.-L. Truong, A. Villazon, and M. Wieczorek, Workflows for eScience, Scientific Workflows for Grids. Springer Verlag, 2007, ch. ASKALON: A Development and Grid Computing Environment for Scientific Workflows.
• 7: Ian T. Foster , Jens-S. Vöckler , Michael Wilde , Yong Zhao, Chimera: AVirtual Data System for Representing, Querying, and Automating Data Derivation, Proceedings of the 14th International Conference on Scientific and Statistical Database Management, p.37-46, July 24-26, 2002 [doi>10.1109/SSDM.2002.1029704]
• 8: T. Gubala, D. Harezlak, M. Bubak, and M. Malawski, "Constructing Abstract Workflows of Applications with Workflow Composition Tool," in Proceedings of Cracow Grid Workshop (CGW '06), K-WfGrid - The Knowledge-based Workflow System for Grid Applications, 2006.
• 9: Chad Berkley , Shawn Bowers , Matthew Jones , Bertram Ludäscher , Mark Schildhauer , Jing Tao, Incorporating semantics in scientific workflow authoring, Proceedings of the 17th international conference on Scientific and statistical database management, p.75-78, June 27-29, 2005, Santa Barbara, CA
• 10: L. Salayandia, P. P. da Silva, A. Q. Gates, and A. Rebellon, "A Model-Based Workflow Approach for Scientific Applications," in Proceedings of the 6th OOPSLA Workshop on Domain-Specific Modeling, 2006.
• 11: T. Fahringer , J. Qin , S. Hainzer, Specification of grid workflow applications with AGWL: an Abstract Grid Workflow Language, Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2, p.676-685, May 09-12, 2005
• 12: Jun Qin , Thomas Fahringer, Advanced data flow support for scientific grid workflow applications, Proceedings of the 2007 ACM/IEEE conference on Supercomputing, November 10-16, 2007, Reno, Nevada [doi>10.1145/1362622.1362679]
• 13: Jorge Cardoso , Amit Sheth, Semantic E-Workflow Composition, Journal of Intelligent Information Systems, v.21 n.3, p.191-225, November 2003 [doi>10.1023/A:1025542915514]
• 14: The World Wide Web Consortium (W3C), "OWL-S: Semantic Markup for Web Services." {Online}. Available: http://www.w3.org/Submission/OWL-S/
• 15: Y. Gil, Workflows for e-Science -- Scientific Workflows for Grids. Springer Verlag, 2007, ch. Workflow Composition: Semantic Representations for Flexible Automation.
• 16: The Object Management Group (OMG), "UML 2 Activity Diagram." {Online}. Available: http://www.omg.org/spec/UML/2.1.2/Superstructure/PDF/
• 17: Protege Team, "Protege-OWL Editor." {Online}. Available: http://protege.stanford.edu/overview/protege-owl.html
• 18: Jena Team, "Jena Semantic Web Framework API." {Online}. Available: http://jena.sourceforge.net/
• 19: F. Schüller, J. Qin, F. Nadeem, R. Prodan, T. Fahringer, and G. Mayr, "Performance, Scalability and Quality of the Meteorological Grid Workflow MeteoAG," in Proceedings of 2nd Austrian Grid Symposium. Innsbruck, Austria: OCG Verlag, September 21--23, 2006.
• 20: W. R. Cotton, R. A. Pielke, R. L. Walko, G. E. Liston, C. J. Tremback, H. Jiang, R. L. McAnelly, J. Y. Harrington, M. E. Nicholls, G. G. Carrio, and J. P. McFadden, "RAMS 2001: Current status and future directions," Meteorology and Atmospheric Physics, vol. 82, pp. 5--29, 2003.
• 21: P. Lord, P. Alper, C. Wroe, and C. Goble, The Semantic Web: Research and Applications. Springer, 2005, ch. Feta: A Light-Weight Architecture for User Oriented Semantic Service Discovery, pp. 17--31.
• 22: Jianting Zhang, Ontology-Driven Composition and Validation of Scientific Grid Workflows in Kepler: a Case Study of Hyperspectral Image Processing, Proceedings of the Fifth International Conference on Grid and Cooperative Computing Workshops, p.282-289, October 21-23, 2006 [doi>10.1109/GCCW.2006.68]
• 23: Anthony Mayer , Stephen McGough , Murtaza Gulamali , Laurie Young , Jim Stanton , Steven Newhouse , John Darlington, Meaning and Behaviour in Grid Oriented Components, Proceedings of the Third International Workshop on Grid Computing, p.100-111, November 18, 2002
• 24: Leonardo Salayandia , Paulo Pinheiro da Silva , Ann Q. Gates , Flor Salcedo, Workflow-Driven Ontologies: An Earth Sciences Case Study, Proceedings of the Second IEEE International Conference on e-Science and Grid Computing, p.17, December 04-06, 2006 [doi>10.1109/E-SCIENCE.2006.157]
• 25: METEOR-S Team, "METEOR-S: Semantic Web Services and Processes." {Online}. Available: http://lsdis.cs.uga.edu/projects/meteor-s/
• 26: M. Lemos, M. A. Casanova, L. F. B. Seibel, J. A. F. de Macedo, and A. B. de Miranda, "Ontology-Driven Workflow Management for Biosequence Processing Systems," in Proceedings of 15th International Conference Database and Expert Systems Applications (DEXA 2004), vol. 3180/2004. Zaragoza, Spain: Springer, August 30-September 3 2004, pp. 781--790.
• 27: L. Chen, N. Shadbolt, C. Goble, F. Tao, S. Cox, C. Puleston, and P. Smart, "Towards a Knowledge-based Approach to Semantic Service Composition," in Proc. of the 2nd International Semantic Web Conference (ISWC2003), Florida, USA, 2003, pp. 319--334.
• 28: L. Chen, N. R. Shadbolt, F. Tao, C. Goble, C. Puleston, and S. J. Cox, "Semantics-Assisted Problem Solving on the Semantic Grid," Computational Intelligence, vol. 21, pp. 157--176, 2005.
• 29: James Malone, Semantic-Based Workflow Composition for Video Processing in the Grid, Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, p.161-165, December 18-22, 2006 [doi>10.1109/WI.2006.156]
• 30: S. Majithia, D. W. Walker, and W. A. Gray, "Automated Composition of Semantic Grid Services," in Proceedings of the UK e-Science All Hands Meeting 2004, S. J. Cox, Ed., Nottingham, UK, August 31st - September 3rd 2004.
• 31: Stefano Beco , Barbara Cantalupo , Ludovico Giammarino , Nikolaos Matskanis , Mike Surridge, OWL-WS: A Workflow Ontology for Dynamic Grid Service Composition, Proceedings of the First International Conference on e-Science and Grid Computing, p.148-155, December 05-08, 2005 [doi>10.1109/E-SCIENCE.2005.64]
• 32: The World Wide Web Consortium (W3C), "Web Service Semantics - WSDL-S." {Online}. Available: http://www.w3.org/Submission/WSDL-S/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation
          Subjects: Workflow management

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
  C.4 PERFORMANCE OF SYSTEMS

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Web-based services

General Terms:
Design, Experimentation, Management, Measurement, Performance