An efficient and transparent transaction management based on the data workflow of HVEM DataGrid

ABSTRACT

This paper proposes an efficient and transparent transaction management on HVEM DataGrid. HVEM DataGrid has its data workflow which defines the precedence of the data to be saved. The precedence drives many states in a transaction for data management on HVEM DataGrid. We divide the transaction into several sub-transactions according to the states and classify the sub-transactions. Through the transaction hierarchy and parallelism, large image data can be uploaded to HVEM DataGrid efficiently and safely. The transaction management guarantees effective garbage collection as well. The garbage collection is important in HVEM DataGrid because it allows incomplete data insertion and update; it is not easy to decide whether the experimental results and their metadata are stored completely or not. Also, as shared storage system, HVEM DataGrid is composed of heterogeneous storages such as DBs and file storages. But, the transaction to save data to the datagrid requires to access those storages at the same time. And, the access should be transparent to users. The transaction hierarchy can solve the simultaneous access and satisfy these requirements. We will show the proposed scheme to be sound through analysis and to be effective by performance evaluation and overhead estimation. This paper shows that HVEM DataGrid can be a good model of e-Science datagrid through the efficient and transparent transaction scheme across many heterogeneous storages.

REFERENCES

• 1: Im Y. Jung , In S. Cho , Heon Y. Yeom , Hee S. Kweon , Dong H. Choi, A Stateful Web Service with Scalable Security on HVEM DataGrid, Proceedings of the Third IEEE International Conference on e-Science and Grid Computing, p.360-369, December 10-13, 2007 [doi>10.1109/E-SCIENCE.2007.8]
• 2: Im Young Jung et al., HVEM DataGrid: Implementation of a Biologic Data Management System for Experiments with High Voltage Electron Microscope, Distributed, High-Performance and Grid Computing in Computational Biology (GCCB 2006), 2007, pp 175--190.
• 3: Malcolm Atkinson et al., Web Service Grids: An Evolutionary Approach, UK e-Science Technical Report Series, ISSN 1751-5971, May, 2004.
• 4: State Management in Web Services, Proceedings of the 10th IEEE International Workshop on Future Trends of Distributed Computing Systems, p.21-27, May 26-28, 2004
• 5: Fujun Zhu , Mark Turner , Ioannis Kotsiopoulos , Keith Bennett , Michelle Russell , David Budgen , Pearl Brereton , John Keane , Paul Layzell , Michael Rigby , Jie Xu, Dynamic Data Integration Using Web Services, Proceedings of the IEEE International Conference on Web Services, p.262, June 06-09, 2004 [doi>10.1109/ICWS.2004.49]
• 6: P. Periorellis, J. Wu, P. Watson, Security Mechanisms for Data Intensive Systems, IEEE Web Services Security Symposium (WSSS), 2006
• 7: David F. Ferraiolo , John F. Barkley , D. Richard Kuhn, A role-based access control model and reference implementation within a corporate intranet, ACM Transactions on Information and System Security (TISSEC), v.2 n.1, p.34-64, Feb. 1999 [doi>10.1145/300830.300834]
• 8: Anna Cinzia Squicciarini , Elisa Bertino , Sebastien Goasguen, Access Control Strategies for Virtualized Environments in Grid Computing Systems, Proceedings of the 11th IEEE International Workshop on Future Trends of Distributed Computing Systems, p.48-54, March 21-23, 2007 [doi>10.1109/FTDCS.2007.10]
• 9: Web Services Security (WS-Security 2004) 1.1, Available: http://www.oasis-open.org/specs/index.php#wssv1.1
• 10: W3C, Web Service Description Language(WSDL) 1.1, Available: http://www.w3.org/TR/wsdl
• 11: I. Foster, C. Kesselman, J. Nick and S. Tuecke, The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG, Global Grid Forum, 2002.
• 12: UDDI: Universal Description, Discover and Integration, Available: http://www.uddi.org
• 13: Web Services for Remote Portal, Available: http://www.oasis-open.org/committees/wsrp
• 14: Audun Jøsang , Simon Pope, Semantic constraints for trust transitivity, Proceedings of the 2nd Asia-Pacific conference on Conceptual modelling, p.59-68, January 01, 2005, Newcastle, New South Wales, Australia
• 15: Nicola Mezzetti, Towards a Model for Trust Relationships in Virtual Enterprises, Proceedings of the 14th International Workshop on Database and Expert Systems Applications, p.420, September 01-05, 2003
• 16: Ajay Chander , John C. Mitchell , Drew Dean, A State-Transition Model of Trust Management and Access Control, Proceedings of the 14th IEEE workshop on Computer Security Foundations, p.27, June 11-13, 2001
• 17: Emmanuel Bresson , Olivier Chevassut , David Pointcheval, Provably secure authenticated group Diffie-Hellman key exchange, ACM Transactions on Information and System Security (TISSEC), v.10 n.3, p.10-es, July 2007 [doi>10.1145/1266977.1266979]
• 18: Ravi S. Sandhu , Edward J. Coyne , Hal L. Feinstein , Charles E. Youman, Role-Based Access Control Models, Computer, v.29 n.2, p.38-47, February 1996 [doi>10.1109/2.485845]
• 19: Feng Xu , Guoyuan Lin , Hao Huang , Li Xie, Role-Based Access Control System for Web Services, Proceedings of the The Fourth International Conference on Computer and Information Technology, p.357-362, September 14-16, 2004
• 20: Globus Alliance, Globus Toolkit 4.0 Release Mannuals, Available: http://www.globus.org/toolkit/docs/4.0/
• 21: OASIS Standard, Security Assertion Markup Language, SMAL2.0, Available: http://docs.oasisopen.org/security/saml/v2.0/saml-core-2.0-os.pdf
• 22: Dhiman Barman, Georgios Smaragdakis and Ibrahim Matta, The Effect of Router Buffer Size on HighSpeed TCP Performance, IEEE Globecom, 2004.
• 23: Foster, I. and Kesselman, C. and Tuecke, S., The anatomy of the grid: Enabling scalable virtual organizations, International Journal of Supercomputer Applications, 2001.
• 24: Korea Basic Science Institute, KBSI Microscopes & facilitates, Available: http://hvem.kbsi.re.kr/eng/index.htm
• 25: Hyuck Han and Hyungsoo Jung and Heon Y. Yeom and Hee S. Kweon and Jysoo Lee, HVEM Grid: Experiences in constructing an Electron Microscopy Grid, 2006
• 26: Oxford e-Science Centre, e-Science Definitions, Avilable: http://e-science.ox.ac.uk/public/general/definitions.xml
• 27: Daniel E. Atkins et al, Revolutionizing Science and Engineering Through Cyberinfrastructure : Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure, National Science Foundation, 2003
• 28: PostgreSQL Global Ddevelopment Grpoup, PostgreSQL 8.0, Available: http://www.postgresql.org
• 29: PostgreSQL Global Ddevelopment Grpoup, PostgreSQL 8.0, Available: http://www.postgresql.org
• 30: Martone ME, Zhang S, Gupta A, Qian X, He H, Price DL, Wong M, Santini S and Ellisman MH, The cell-centered database: a database for multiscale structural and protein localization data from light and electron microscopy, Neuroinformatics, Vol. 1, Number 4, 2003, pp 379--395.
• 31: NEESgrid, Available: http://www.neesgrid.org
• 32: UK e-science Programme, Available: http://www.nesc.ac.uk
• 33: Japan NAREGI project, Available: http://www.naregi.org
• 34: Korean Society of Electron Microscopy, Available: http://ksem.com
• 35: European Microscopy Society, Available: http://www.eurmicsoc.org
• 36: Microscopy Society of America, Available: http://www.microscopy.org
• 37: The Royal Microscopical Society, Available: http://www.rms.org.uk
• 38: Telescience Project, Available: https://telescience.ucsd.edu
• 39: M. Hadida-Hassan, S. J. Young, S. T. Peltier, M. Wong, S. P. Lamont and M. H. Ellisman, Web-based telemicroscopy, Journal of Structural Biology, Vol. 125, Number 2, 1999, pp 235--245.
• 40: Steven T. Peltier , Abel W. Lin , David Lee , Stephen Mock , Stephan Lamont , Tomas Molina , Mona Wong , Lu Dai , Maryann E. Martone , Mark H. Ellisman, The Telescience Portal for advanced tomography applications, Journal of Parallel and Distributed Computing, v.63 n.5, p.539-550, May 2003 [doi>10.1016/S0743-7315(03)00061-3]
• 41: Abel W. Lin , Khim Ung, The Telescience Project: Application to Middleware Interaction Components, Proceedings of the 18th IEEE Symposium on Computer-Based Medical Systems, p.543-548, June 23-24, 2005 [doi>10.1109/CBMS.2005.99]
• 42: Biogrid Project, Available: http://www.biogrid.jp
• 43: Chaos Project, Available: http://www.cs.umd.edu/projects/hpsl/chaos/
• 44: Asmara Afework, Michael Beynon, Fabian Bustamante, Angelo Demarzo, Renato Ferreira, Robert Miller, Mark Silberman, Joel Saltz, Alan Sussman and Hubert Tsang, Digital Dynamic Telepathology - the Virtual Microscope, Proceedings of the 1998 AMIA Annual Fall Symposium, 1998.
• 45: Renato Ferreira, Bongki Moon, Jim Humphries, Alan Sussman, Joel Saltz, Robert Miller and Angelo Demarzo, The Virtual Microscope, Proceedings of the 1997 AMIA Annual Fall Symposium, 1997
• 46: CERN Datagrid Project, Available: http://eu-datagrid.web.cern.ch/eu-datagrid/
• 47: V. Breton, R. Medina and J. Montagnat, DataGrid, Prototype of a Biomedical Grid, Methods of Information in Medicine, Vol. 42, Number 2, 2003, pp 143--148.
• 48: Wolfgang Hoschek , Francisco Javier Jaén-Martínez , Asad Samar , Heinz Stockinger , Kurt Stockinger, Data Management in an International Data Grid Project, Proceedings of the First IEEE/ACM International Workshop on Grid Computing, p.77-90, December 17, 2000
• 49: H. Stockinger, F. Dono, E. Laure, S. Muzzafar et al, Grid Data Management in action, computing in high energy physics (CHEP 2003), 2003
• 50: Paricle Physics Data Grid, Available: http://www.ppdg.net
• 51: Kurt Stockinger , Heinz Stockinger , Lukasz Dutka , Renata Slota , Darin Nikolow , Jacek Kitowski, Access Cost Estimation for Unified Grid Storage Systems, Proceedings of the 4th International Workshop on Grid Computing, p.149, November 17-17, 2003
• 52: NERC DataGrid, Available: http://ndg.badc.rl.ac.uk/
• 53: Lawrence B. N., R. Cramer, M. Gutierrez, K. Kleese van Dam, S. Kondapalli, S. Latham, R. Lowry, K. O?Neill and A. Woolf, The NERC DataGrid Prototype, Proceedings of the U.K. e-science All Hands Meeting, 2003.
• 54: Stephens A., Marsh K. P. and B. N. Lawrence, Presenting a multi-terabyte dataset via the web, Proceedings of the ECMWF Ninth Workshop on Meteorological Operational Systems, 2003.
• 55: Juan Rubio , Lizy Kurian John, Reducing Server Data Traffic Using a Hierarchical Computation Model, IEEE Transactions on Parallel and Distributed Systems, v.16 n.10, p.933-943, October 2005 [doi>10.1109/TPDS.2005.127]
• 56: Juan Rubio, Madhavi Valluri and Lizy K. John, Improving Transaction Processing using a Hierarchical Computing Server, TR-020719-01, 2002, Available: http://ndg.badc.rl.ac.uk.
• 57: Robert Marek , Erhard Rahm, Performance Evaluation of Parallel Transaction Processing in Shared Nothing Database Systems, Proceedings of the 4th International PARLE Conference on Parallel Architectures and Languages Europe, p.295-310, June 15-18, 1992
• 58: Erhard Rahm , Robert Marek, Analysis of Dynamic Load Balancing Strategies for Parallel Shared Nothing Database Systems, Proceedings of the 19th International Conference on Very Large Data Bases, p.182-193, August 24-27, 1993

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.m Miscellaneous
          Subjects: Insurance*

General Terms:
Design, Management, Reliability

Keywords:
HVEM DataGrid, data workflow, transaction management