A case study for petascale applications in astrophysics: simulating gamma-ray bursts

ABSTRACT

Petascale computing will allow astrophysicists to investigate astrophysical objects, systems, and events that cannot be studied by current observational means and that were previously excluded from computational study by sheer lack of CPU power and appropriate codes. Here we present a pragmatic case study, focussing on the simulation of gamma-ray bursts as a science driver for petascale computing. We estimate the computational requirements for such simulations and delineate in what way petascale and peta-grid computing can be utilized in this context.

REFERENCES

• 1: M. Alcubierre, B. Brügmann, P. Diener, M. Koppitz, D. Pollney, E. Seidel, and R. Takahashi. Gauge conditions for long-term numerical black hole evolutions without excision. Phys. Rev. D, 67:084023, 2003.
• 2: M. Alcubierre, B. Brügmann, T. Dramlitsch, J. A. Font, P. Papadopoulos, E. Seidel, N. Stergioulas, and R. Takahashi. Towards a stable numerical evolution of strongly gravitating systems in general relativity: The conformal treatments. Phys. Rev. D, 62:044034, 2000.
• 3: Gabrielle Allen , Thomas Dramlitsch , Ian Foster , Nicholas T. Karonis , Matei Ripeanu , Edward Seidel , Brian Toonen, Supporting efficient execution in heterogeneous distributed computing environments with cactus and globus, Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), p.52-52, November 10-16, 2001, Denver, Colorado [doi>10.1145/582034.582086]
• 4: G. Allen and E. Seidel. The Grid: Blueprint for a New Computing Infrastructure (2nd Edition), chapter Collaborative Science: Astrophysics Requirements and Experiences, pages 201--213. Morgan Kaufmann, 2004.
• 5: L. Baiotti, I. Hawke, P. J. Montero, F. Löffler, L. Rezzolla, N. Stergioulas, J. A. Font, and E. Seidel. Three-dimensional relativistic simulations of rotating neutron star collapse to a Kerr black hole. Phys. Rev. D, 71:024035, 2005.
• 6: M. J. Berger and J. Oliger. Adaptive mesh refinement for hyperbolic partial differential equations. J. Comput. Phys., 53:484--512, 1984.
• 7: C. Bernes. A Monte Carlo approach to non-LTE radiative transfer problems. Astron. Astrophys., 73:67, 1979.
• 8: Ruxandra Bondarescu , Gabrielle Allen , Gregory Daues , Ian Kelley , Michael Russell , Edward Seidel , John Shalf , Malcolm Tobias, The astrophysics simulation collaboratory portal: a framework for effective distributed research, Future Generation Computer Systems, v.21 n.2, p.259-270, 1 February 2005 [doi>10.1016/j.future.2003.10.008]
• 9: Ruxandra Bondarescu , Gabrielle Allen , Gregory Daues , Ian Kelley , Michael Russell , Edward Seidel , John Shalf , Malcolm Tobias, The astrophysics simulation collaboratory portal: a framework for effective distributed research, Future Generation Computer Systems, v.21 n.2, p.259-270, 1 February 2005 [doi>10.1016/j.future.2003.10.008]
• 10: S. W. Bruenn, C. J. Dirk, A. Mezzacappa, J. C. Hayes, J. M. Blondin, W. R. Hix, and O. E. B. Messer. Modeling core collapse supernovae in 2 and 3 dimensions with spectral neutrino transport. arXiv:0709.0537 {astro-ph}, 2007.
• 11: Cactus Computational Toolkit home page, http://www.cactuscode.org/.
• 12: Mesh Refinement with Carpet, http://www.carpetcode.org/.
• 13: Spacetime evolution with CCATIE, http://numrel.aei.mpg.de/Research/codes.html.
• 14: T. Goodale, G. Allen, G. Lanfermann, J. Massó, T. Radke, E. Seidel, and J. Shalf. The Cactus framework and toolkit: Design and applications. In Vector and Parallel Processing - VECPAR'2002, 5th International Conference, Lecture Notes in Computer Science, Berlin, 2003. Springer.
• 15: P. Mészáros. Gamma-ray bursts. Reports of Progress in Physics, 69:2259, 2006.
• 16: MPI: Message Passing Interface Forum, http://www.mpi-forum.org/.
• 17: L. Oliker, A. Canning, J. Carter, C. Iancu, M. Lijewski, S. Kamil, J. Shalf, H. Shan, E. Strohmaier, S. Ethier, and T. Goodale. Scientific Application Performance on Candidate PetaScale Platforms. In International Parallel and Distributed Processing Symposium (IPDPS), Long Beach, Ca., March 24--30 2007. Winner Best Paper.
• 18: OpenMP: Simple, Portable, Scalable SMP Programming, http://www.openmp.org/.
• 19: C. D. Ott. Stellar Iron Core Collapse in 3+1 General Relativity and The Gravitational Wave Signature of Core-Collapse Supernovae. PhD thesis, Universität Potsdam, Potsdam, Germany, 2006.
• 20: C. D. Ott, H. Dimmelmeier, A. Marek, H. T. Janka, I. Hawke, B. Zink, and E. Schnetter. 3D Collapse of Rotating Stellar Iron Cores in General Relativity including Deleptonization and a Nuclear Equation of State. Phys. Rev. Lett., 98:261101, 2007.
• 21: Matei Ripeanu , Adriana Iamnitchi , Ian Foster, Performance Predictions for a Numerical Relativity Package in Grid Environments, International Journal of High Performance Computing Applications, v.15 n.4, p.375-387, November 2001 [doi>10.1177/109434200101500404]
• 22: E. Schnetter, S. H. Hawley, and I. Hawke. Evolutions in 3D numerical relativity using fixed mesh refinement. Class. Quantum Grav., 21:1465--1488, 2004.
• 23: E. Schnetter, C. D. Ott, G. Allen, P. Diener, T. Goodale, T. Radke, E. Seidel, and J. Shalf. Cactus Framework: Black holes to gamma ray bursts. In D. A. Bader, editor, Petascale Computing: Algorithms and Applications, chapter 24. Chapman & Hall/CRC Computational Science Series, 2007.
• 24: S. Setiawan, M. Ruffert, and H.-T. Janka. Three-dimensional simulations of non-stationary accretion by remnant black holes of compact object mergers. Astron. Astrophys., 458:553--567, 2006.
• 25: J. van Meter, J. G. Baker, M. Koppitz, and D.-I. Choi. How to move a black hole without excision: gauge conditions for the numerical evolution of a moving puncture. Phys. Rev. D, 73:124011, 2006.
• 26: Whisky, EU Network GR Hydrodynamics Code, http://www.whiskycode.org/.
• 27: S. E. Woosley and J. S. Bloom. The Supernova Gamma-Ray Burst Connection. Ann. Rev. Astron. Astrophys., 44:507, 2006.
• 28: B. Zink. A general relativistic evolution code on cuda architectures. (In preparation), 2008.
• 29: B. Zink, E. Schnetter, and M. Tiglio. Multi-patch methods in general relativistic astrophysics -- i. hydrodynamical flows on fixed backgrounds. arXiv:0712.0353, 2007.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING
      Subjects: Astronomy

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING
      Subjects: Physics