November 2007
Software Enabling Technologies for Petascale Science
Dean N. Williams, Lawrence Livermore National Laboratory
David E. Bernholdt, Oak Ridge National Laboratory
Ian T. Foster, Argonne National Laboratory
Don E. Middleton, National Center for Atmospheric Research

5. Conclusion

ESG has made significant progress towards the definition of the federated metadata, security, and data services required to enable distributed access to, and analysis of, large quantities of climate simulation data. The current production-level ESG system primarily addresses the tasks of publishing and cataloging terabytes of climate model data for a diverse set of registered users. We are now working to take ESG-CET to the next level of distributed environments with an even greater emphasis on federation and server-side capabilities. ESG-CET will build upon the current ESG system and target flexibility, efficiency, and more universal access while expanding to serve much larger archives (petabytes), as required for CMIP4 (IPCC AR5), CCSM, and CCES. To this end, ESG-CET is working with disparate technologies and partnering with national and international leaders in the computer and climate communities to build a robust data and analysis distributed infrastructure in support of advancing climate change research.

This work is supported through the U.S. Department of Energy Office of Science, Offices of Advanced Scientific Computing Research and Biological and Environmental Research, through the SciDAC program. Argonne National Laboratory is managed by Argonne Chicago LLC under Contract DE-AC02-06CH11357. Information Sciences Institute is a research institute of the Viterbi School of Engineering at the University of Southern California. Lawrence Berkeley National Laboratory is managed by the University of California for the U.S. Department of Energy under contract No. DE-AC02-05CH11231. Lawrence Livermore National Laboratory is managed by the University of California for the U.S. Department of Energy under contract No. W-7405-Eng-48. Los Alamos National Security is managed by LLC (LANS) for the U.S. Department of Energy under the contract No. DE-AC52-06NA25396. National Center for Atmospheric Research is managed by the University Corporation for Atmospheric Research under the sponsorship of the U.S. National Science Foundation. Oak Ridge National Laboratory is managed by UT-Battelle, LLC for the U.S. Dept. of Energy under contract DE-AC-05-00OR22725. Pacific Marine Environmental Laboratory is under the National Oceanic and Atmospheric Administration's line office of Ocean and Atmosphere Research, which lies within the U.S. Department of Commerce.
The ESG-CET executive committee consists of David Bernholdt, ORNL; Ian Foster, Argonne; Don Middleton, NCAR; and Dean Williams, LLNL.
This document was reviewed and released under the Lawrence Livermore National Laboratory guidelines and has been assigned the UCRL number: UCRL-TR-235089.
1 Earth System Grid (ESG) - Turning Climate Model Datasets into Community Resources - www.earthsystemgrid.org/, 2004 – 2007.
2 Scientific Discovery through Advanced Computing (SciDAC) - www.scidac.gov/, 2007.
3 Office of Advanced Scientific Computing Research (OASCR) - www.science.doe.gov/ascr/, 2007.
4 Offices of Biological and Environmental Research (OBER) - www.science.doe.gov/ober/, 2007.
5 Bernholdt, D., Bharathi, S., Brown, D., Chanchio, K., Chen, M., Chervenak, A., Cinquini, L., Drach, B., Foster, I., Fox, P., Garcia, J., Kesselman, C., Markel, R., Middleton, D., Nefedova, V., Pouchard, L., Shoshani, A., Sim, A., Strand, G. and Williams, D. "The Earth System Grid: Supporting the Next Generation of Climate Modeling Research," Proceedings of the IEEE, 93 (3). 485-495. 2005.
6 Foster, I., Alpert, E., Chervenak, A., Drach, B., Kesselman, C., Nefedova, V., Middleton, D., Shoshani, A., Sims, A. and Williams, D., "The Earth System Grid: Turning Climate Datasets Into Community Resources," in 82nd Annual American Meteorological Society Meeting, (Orlando, FL., 2002).
7 Eaton, B., Gregory, J., Drach, B., Taylor, K. and Hankin, S. "NetCDF Climate and Forecast Metadata Conventions," cf-pcmdi.llnl.gov, 2007.
8 Welch, V., Siebenlist, F., Foster, I., Bresnahan, J., Czajkowski, K., Gawor, J., Kesselman, C., Meder, S., Pearlman, L. and Tuecke, S., "Security for Grid Services," 12th IEEE International Symposium on High Performance Distributed Computing. 2003.
9Fox, P., Garcia, J. and West, P. "OPeNDAP for the Earth System Grid," Data Science Journal. 2007.
10 Allcock, B., Bresnahan, J., Kettimuthu, R., Link, M., Dumitrescu, C., Raicu, I. and Foster, I., "The Globus Striped GridFTP Framework and Server," Supercomputing 2005 (SC ’05) conference proceedings. 2005.
11 Intergovernmental Panel on Climate Change (IPCC) 4th Assessment Report - www.ipcc.ch/activity/ar.htm, 2007.
12 CCSM Carbon LAnd Model intercomparison Project (C-LAMP) - www.climatemodeling.org/c-lamp/, 2007.
13 World Climate Research Program (WCRP) CMIP3 (IPCC AR4) Subproject Publications - www-pcmdi.llnl.gov/ipcc/subproject_publications.php, 2007.
14 The Parallel Climate Model - www.cgd.ucar.edu/pcm/, 2007.
15 The Parallel Ocean Program (POP) ocean circulation model - climate.lanl.gov/Models/POP/, 2007.

Pages: 1 2 3 4 5

Reference this article
Williams, D. N., Bernholdt, D. E., Foster, I. T., Middleton, D. E. "The Earth System Grid Center for Enabling Technologies: Enabling Community Access to Petascale Climate Datasets ," CTWatch Quarterly, Volume 3, Number 4, November 2007. http://www.ctwatch.org/quarterly/articles/2007/11/the-earth-system-grid-center-for-enabling-technologies-enabling-community-access-to-petascale-climate-datasets/

Any opinions expressed on this site belong to their respective authors and are not necessarily shared by the sponsoring institutions or the National Science Foundation (NSF).

Any trademarks or trade names, registered or otherwise, that appear on this site are the property of their respective owners and, unless noted, do not represent endorsement by the editors, publishers, sponsoring institutions, the National Science Foundation, or any other member of the CTWatch team.

No guarantee is granted by CTWatch that information appearing in articles published by the Quarterly or appearing in the Blog is complete or accurate. Information on this site is not intended for commercial purposes.