Earth System Grid II, Turning Climate Datasets Into Community Resources PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Earth System Grid II, Turning Climate Datasets Into Community Resources PDF full book. Access full book title Earth System Grid II, Turning Climate Datasets Into Community Resources by . Download full books in PDF and EPUB format.
Author: Publisher: ISBN: Category : Languages : en Pages :
Book Description
The Earth System Grid (ESG) II project, funded by the Department of Energy's Scientific Discovery through Advanced Computing program, has transformed climate data into community resources. ESG II has accomplished this goal by creating a virtual collaborative environment that links climate centers and users around the world to models and data via a computing Grid, which is based on the Department of Energy's supercomputing resources and the Internet. Our project's success stems from partnerships between climate researchers and computer scientists to advance basic and applied research in the terrestrial, atmospheric, and oceanic sciences. By interfacing with other climate science projects, we have learned that commonly used methods to manage and remotely distribute data among related groups lack infrastructure and under-utilize existing technologies. Knowledge and expertise gained from ESG II have helped the climate community plan strategies to manage a rapidly growing data environment more effectively. Moreover, approaches and technologies developed under the ESG project have impacted datasimulation integration in other disciplines, such as astrophysics, molecular biology and materials science.
Author: Publisher: ISBN: Category : Languages : en Pages :
Book Description
The Earth System Grid (ESG) II project, funded by the Department of Energy's Scientific Discovery through Advanced Computing program, has transformed climate data into community resources. ESG II has accomplished this goal by creating a virtual collaborative environment that links climate centers and users around the world to models and data via a computing Grid, which is based on the Department of Energy's supercomputing resources and the Internet. Our project's success stems from partnerships between climate researchers and computer scientists to advance basic and applied research in the terrestrial, atmospheric, and oceanic sciences. By interfacing with other climate science projects, we have learned that commonly used methods to manage and remotely distribute data among related groups lack infrastructure and under-utilize existing technologies. Knowledge and expertise gained from ESG II have helped the climate community plan strategies to manage a rapidly growing data environment more effectively. Moreover, approaches and technologies developed under the ESG project have impacted datasimulation integration in other disciplines, such as astrophysics, molecular biology and materials science.
Author: Publisher: ISBN: Category : Languages : en Pages : 7
Book Description
This report discusses a project that used prototyping technology to access and analyze climate data. This project was initially funded under the DOE's Next Generation Internet (NGI) program, with follow-on support from BER and the Mathematical, Information, and Computational Sciences (MICS) office. In this prototype, we developed Data Grid technologies for managing the movement and replication of large datasets, and applied these technologies in a practical setting (i.e., an ESG-enabled data browser based on current climate data analysis tools), achieving cross-country transfer rates of more than 500 Mb/s. Having demonstrated the potential for remotely accessing and analyzing climate data located at sites across the U.S., we won the "Hottest Infrastructure" award in the Network Challenge event. While the ESG I prototype project substantiated a proof of concept ("Turning Climate Datasets into Community Resources"), the SciDAC Earth System Grid (ESG) II project made this a reality. Our efforts targeted the development of metadata technologies (standard schema, XML metadata extraction based on netCDF, and a Metadata Catalog Service), security technologies (Web-based user registration and authentication, and community authorization), data transport technologies (GridFTPenabled OPeNDAP-G for high-performance access, robust multiple file transport and integration with mass storage systems, and support for dataset aggregation and subsetting), as well as web portal technologies to provide interactive access to climate data holdings. At this point, the technology was in place and assembled, and ESG II was poised to make a substantial impact on the climate modelling community.
Author: Ian Foster Publisher: Morgan Kaufmann ISBN: 1558609334 Category : Computers Languages : en Pages : 778
Book Description
"The Grid" is an emerging infrastructure that will fundamentally change the way people think about and use computing. The editors reveal the revolutionary impact of large-scale resource sharing and virtualization within science and industry, and the intimate relationships between organization and resource sharing structures.
Author: V.S. Sunderam Publisher: Springer Science & Business Media ISBN: 3540260447 Category : Computers Languages : en Pages : 1201
Book Description
The three-volume set LNCS 3514-3516 constitutes the refereed proceedings of the 5th International Conference on Computational Science, ICCS 2005, held in Atlanta, GA, USA in May 2005.The 464 papers presented were carefully reviewed and selected from a total of 834 submissions for the main conference and its 21 topical workshops. The papers span the whole range of computational science, ranging from numerical methods, algorithms, and computational kernels to programming environments, grids, networking, and tools. These fundamental contributions dealing with computer science methodologies and techniques are complemented by papers discussing computational applications and needs in virtually all scientific disciplines applying advanced computational methods and tools to achieve new discoveries with greater accuracy and speed.
Author: Barry Wilkinson Publisher: CRC Press ISBN: 1420069543 Category : Computers Languages : en Pages : 389
Book Description
Designed for senior undergraduate and first-year graduate students, Grid Computing: Techniques and Applications shows professors how to teach this subject in a practical way. Extensively classroom-tested, it covers job submission and scheduling, Grid security, Grid computing services and software tools, graphical user interfaces, workflow editors,
Author: Michael Wehner Publisher: ISBN: Category : Languages : en Pages :
Book Description
SciDAC has invested heavily in climate change research. We offer a candid opinion as to the impact of the DOE laboratories' SciDAC projects on the upcoming Fourth Assessment Report of the Intergovernmental Panel on Climate Change. As a result of the direct importance of climate change to society, climate change research is highly coordinated at the international level. The Intergovernmental Panel on Climate Change (IPCC) is charged with providing regular reports on the state of climate change research to government policymakers. These reports are the product of thousands of scientists efforts. A series of reviews involving both scientists and policymakers make them among the most reviewed documents produced in any scientific field. The high profile of these reports acts a driver to many researchers in the climate sciences. The Fourth Assessment Report (AR4) is scheduled to be released in 2007. SciDAC sponsored research has enabled the United States climate modeling community to make significant contributions to this report. Two large multi-Laboratory SciDAC projects are directly relevant to the activities of the IPCC. The first, entitled ''Collaborative Design and Development of the Community Climate System Model for Terascale Computers'', has made important software contributions to the recently released third version of the Community Climate System Model (CCSM3.0) developed at the National Center for Atmospheric Research. This is a multi-institutional project involving Los Alamos National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, Pacific Northwest National Laboratory, Argonne National Laboratory, Lawrence Livermore National Laboratory and the National Center for Atmospheric Research. The original principal investigators were Robert Malone and John B. Drake. The current principal investigators are Phil Jones and John B. Drake. The second project, entitled ''Earth System Grid II: Turning Climate Datasets into Community Resources'' aims to facilitate the distribution of the copious amounts of data produced by coupled climate model integrations to the general scientific community. This is also a multi-institutional project involving Argonne National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, Lawrence Livermore National Laboratory and the National Center for Atmospheric Research. The principal investigators are Ian Foster, Don Middleton and Dean Williams. Perhaps most significant among the activities of the ''Collaborative Design'', project was the development of an efficient multi-processor coupling package. CCSM3.0 is an extraordinarily complicated physics code. The fully coupled model consists of separate submodels of the atmosphere, ocean, sea ice and land. In addition, comprehensive biogeochemistry and atmospheric chemistry submodels are under intensive current development. Each of these submodels is a large and sophisticated program in its own right. Furthermore, in the coupled model, each of the submodels, including the coupler, is a separate multiprocessor executable program. The coupler package must efficiently coordinate the communication as well as interpolate or aggregate information between these programs. This regridding function is necessary because each major subsystem (air, water or surface) is allowed to have its own independent grid.
Author: Publisher: ISBN: Category : Languages : en Pages : 99
Book Description
The mission of the Earth System Grid Federation (ESGF) is to provide the worldwide climate-research community with access to the data, information, model codes, analysis tools, and intercomparison capabilities required to make sense of enormous climate data sets. Its specific goals are to (1) provide an easy-to-use and secure web-based data access environment for data sets; (2) add value to individual data sets by presenting them in the context of other data sets and tools for comparative analysis; (3) address the specific requirements of participating organizations with respect to bandwidth, access restrictions, and replication; (4) ensure that the data are readily accessible through the analysis and visualization tools used by the climate research community; and (5) transfer infrastructure advances to other domain areas. For the ESGF, the U.S. Department of Energy's (DOE's) Earth System Grid Center for Enabling Technologies (ESG-CET) team has led international development and delivered a production environment for managing and accessing ultra-scale climate data. This production environment includes multiple national and international climate projects (such as the Community Earth System Model and the Coupled Model Intercomparison Project), ocean model data (such as the Parallel Ocean Program), observation data (Atmospheric Radiation Measurement Best Estimate, Carbon Dioxide Information and Analysis Center, Atmospheric Infrared Sounder, etc.), and analysis and visualization tools, all serving a diverse user community. These data holdings and services are distributed across multiple ESG-CET sites (such as ANL, LANL, LBNL/NERSC, LLNL/PCMDI, NCAR, and ORNL) and at unfunded partner sites, such as the Australian National University National Computational Infrastructure, the British Atmospheric Data Centre, the National Oceanic and Atmospheric Administration Geophysical Fluid Dynamics Laboratory, the Max Planck Institute for Meteorology, the German Climate Computing Centre, the National Aeronautics and Space Administration Jet Propulsion Laboratory, and the National Oceanic and Atmospheric Administration. The ESGF software is distinguished from other collaborative knowledge systems in the climate community by its widespread adoption, federation capabilities, and broad developer base. It is the leading source for present climate data holdings, including the most important and largest data sets in the global-climate community, and - assuming its development continues - we expect it to be the leading source for future climate data holdings as well. Recently, ESG-CET extended its services beyond data-file access and delivery to include more detailed information products (scientific graphics, animations, etc.), secure binary data-access services (based upon the OPeNDAP protocol), and server-side analysis. The latter capabilities allow users to request data subsets transformed through commonly used analysis and intercomparison procedures. As we transition from development activities to production and operations, the ESG-CET team is tasked with making data available to all users seeking to understand, process, extract value from, visualize, and/or communicate it to others. This ongoing effort, though daunting in scope and complexity, will greatly magnify the value of numerical climate model outputs and climate observations for future national and international climate-assessment reports. The ESG-CET team also faces substantial technical challenges due to the rapidly increasing scale of climate simulation and observational data, which will grow, for example, from less than 50 terabytes for the last Intergovernmental Panel on Climate Change (IPCC) assessment to multiple Petabytes for the next IPCC assessment. In a world of exponential technological change and rapidly growing sophistication in climate data analysis, an infrastructure such as ESGF must constantly evolve if it is to remain relevant and useful. Regretfully, we submit our final report at the end of project funding. To continue to serve the climate-science community, we are currently seeking additional funding. Such funding would allow us to maintain and enhance ESGF production and operation of this vital endeavor of cataloging, serving, and analyzing ultra-scale climate science data. At this time, the entire ESG-CET team would like to take this opportunity to sincerely thank our funding agencies in the DOE Scientific Discovery through Advanced Computing (SciDAC) program and the Office of Biological and Environmental Research (OBER) - as well as our national and international collaborators, stakeholders, and partners - for allowing us to work with you and serve the community these past several years.
Author: Publisher: ISBN: Category : Languages : en Pages : 18
Book Description
The international climate community is expected to generate hundreds of petabytes of simulation data within the next five to seven years. This data must be accessed and analyzed by thousands of analysts worldwide in order to provide accurate and timely estimates of the likely impact of climate change on physical, biological, and human systems. Climate change is thus not only a scientific challenge of the first order but also a major technological challenge. To address this technological challenge, the Earth System Grid Center for Enabling Technologies (ESG-CET) has been established within the U.S. Department of Energy's Scientific Discovery through Advanced Computing (SciDAC)-2 program, with support from the offices of Advanced Scientific Computing Research and Biological and Environmental Research. ESG-CET's mission is to provide climate researchers worldwide with access to the data, information, models, analysis tools, and computational capabilities required to make sense of enormous climate simulation datasets. Its specific goals are to (1) make data more useful to climate researchers by developing Grid technology that enhances data usability; (2) meet specific distributed database, data access, and data movement needs of national and international climate projects; (3) provide a universal and secure web-based data access portal for broad multi-model data collections; and (4) provide a wide-range of Grid-enabled climate data analysis tools and diagnostic methods to international climate centers and U.S. government agencies. Building on the successes of the previous Earth System Grid (ESG) project, which has enabled thousands of researchers to access tens of terabytes of data from a small number of ESG sites, ESG-CET is working to integrate a far larger number of distributed data providers, high-bandwidth wide-area networks, and remote computers in a highly collaborative problem-solving environment.
Author: 
Author: 
Author: 
Author: Ian Foster
Author: V.S. Sunderam
Author: Barry Wilkinson
Author: Michael Wehner
Author: 
Author: 
Author: 
Author: