ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enabl... more ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enables the sharing of all geosciences data, information, and knowledge in an open, transparent and inclusive manner. Brokering of data and improvements in discovery and access are a key to data exchange and promotion of collaboration across the geosciences. In this presentation we describe an evolutionary process of infrastructure and interoperability development focused on participation of existing science research infrastructures and augmenting them for improved access. All geosciences communities already have, to a greater or lesser degree, elements of an information infrastructure in place. These elements include resources such as data archives, catalogs, and portals as well as vocabularies, data models, protocols, best practices and other community conventions. What is necessary now is a process for levering these diverse infrastructure elements into an overall infrastructure that provides easy discovery, access and utilization of resources across disciplinary boundaries. Brokers connect disparate systems with only minimal burdens upon those systems, and enable the infrastructure to adjust to new technical developments and scientific requirements as they emerge. Robust cyberinfrastructure will arise only when social, organizational, and cultural issues are resolved in tandem with the creation of technology-based services. This is a governance issue, but is facilitated by infrastructure capabilities that can impact the uptake of new interdisciplinary collaborations and exchange. Thus brokering must address both the cyberinfrastructure and computer technology requirements and also the social issues to allow improved cross-domain collaborations. This is best done through use-case-driven requirements and agile, iterative development methods. It is important to start by solving real (not hypothetical) information access and use problems via small pilot projects that develop capabilities targeted to specific communities. Brokering, as a critical capability for connecting systems, evolves over time through more connections and increased functionality. This adaptive process allows for continual evaluation as to how well science-driven use cases are being met. There is a near term, and possibly unique, opportunity through EarthCube and European e-Infrastructure projects to increase the impact and interconnectivity of projects. In the developments described in this presentation, brokering has been demonstrated to be an essential part of a robust, adaptive technical infrastructure and demonstration and user scenarios can address of both the governance and detailed implementation paths forward. The EarthCube Brokering roadmap proposes the expansion of brokering pilots into fully operational prototypes that work with the broader science and informatics communities to answer these questions, connect existing and emerging systems, and evolve the EarthCube infrastructure.
Abstract The Hierarchical Data Format (HDF) has been a data format standard in National Aeronauti... more Abstract The Hierarchical Data Format (HDF) has been a data format standard in National Aeronautic and Space Administration (NASA)'s Earth Observing System Data and Information System since the 1990s. Its rich structure, platform independence, full-featured application programming interface (API), and internal compression make it very useful for archiving science data and utilizing them with a rich set of software tools.
Over the last 27 years, the National Snow and Ice Data Center has participated in a number of pro... more Over the last 27 years, the National Snow and Ice Data Center has participated in a number of programs that have striven to provide ready access to high-quality observations and long-term geophysical records. In the last 10 years these programs have increasingly involved data archived at multiple, geographically distributed sites. The key lessons we have learned from these experiences are
NSF's Sustainable Digital Data Preservation and Access Network Partners program is an ambitio... more NSF's Sustainable Digital Data Preservation and Access Network Partners program is an ambitious attempt to integrate a wide variety of expertise and infrastructure into a network for providing "reliable digital preservation, access, integration, and analysis capabilities for science." One of the first two DataNet award recipients, the Data Conservancy, is itself a network of widely diverse partners led by the libraries at the Johns Hopkins University. The Data Conservancy is built on existing exemplar scientific projects, communities, and virtual organizations that have deep engagement with their user communities, and extensive experience with large-scale distributed system development. Data Conservancy members embrace a shared vision that data curation is not an end, but rather a means to collect, organize, validate, and preserve data needed to address the grand research challenges that face society. Data Conservancy members holdings encompass the entire range of eart...
This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwav... more This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwave data. It provides a consistent, daily and monthly time series of sea ice concentrations from 09 July 1987 through through most recent processing for both the north and south polar regions on a 25 km x 25 km grid. The NOAA/NSIDC CDR is based on the recommendations from the National Research Council (NRC) (2004). It is produced from gridded brightness temperatures from the Defense Meteorological Satellite Program (DMSP) series of Special Sensor Microwave Imager (SSM/I) passive microwave radiometers: F-8, F-11, and F-13. The NOAA/NSIDC CDR sea ice concentrations are an estimate of the fraction of ocean area covered by sea ice that is produced by combining concentration estimates created using two algorithms developed at the NASA Goddard Space Flight Center (GSFC): the NASA Team algorithm (Cavalieri et al., 1984) and the Bootstrap algorithm (Comiso, 1986). NSIDC applies the individual algo...
The Earth Observing System (EOS) is NASA's response to the congressionally mandated Global Ch... more The Earth Observing System (EOS) is NASA's response to the congressionally mandated Global Change Research Program (GCRP). Through the EOS program, massive amounts of data will be gathered in areas such as climate and hydrological systems, biogeochemical dynamics, ecological systems, earth system history, human interactions, solid earth processes, and solar influences. The purpose of the EOS Data and Information System
ABSTRACT This data set provides a Climate Data Record (CDR) of sea ice concentration from passive... more ABSTRACT This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwave data. It provides a consistent, daily and monthly time series of sea ice concentrations from 09 July 1987 through through most recent processing for both the north and south polar regions on a 25 km x 25 km grid. The NOAA/NSIDC CDR is based on the recommendations from the National Research Council (NRC) (2004). It is produced from gridded brightness temperatures from the Defense Meteorological Satellite Program (DMSP) series of Special Sensor Microwave Imager (SSM/I) passive microwave radiometers: F-8, F-11, and F-13. The NOAA/NSIDC CDR sea ice concentrations are an estimate of the fraction of ocean area covered by sea ice that is produced by combining concentration estimates created using two algorithms developed at the NASA Goddard Space Flight Center (GSFC): the NASA Team algorithm (Cavalieri et al., 1984) and the Bootstrap algorithm (Comiso, 1986). NSIDC applies the individual algorithms to brightness temperature data from Remote Sensing Systems, Inc. (RSS). The data are gridded on the NSIDC polar stereographic grid with 25 x 25 km grid cells and are available in netCDF file format. Each file includes four different sea ice concentration variables: a variable with the primary CDR sea ice concentrations created by NSIDC and three variables with sea ice concentrations created by Goddard. The three Goddard-produced sea ice concentrations are the Goddard NASA Team algorithm sea ice concentrations, the Goddard Bootstrap sea ice concentrations, and a merged version of the two sea ice concentrations. These Goddard-produced sea ice concentrations are included in the data files for a number of reasons. First, the merged Goddard NASA Team/Bootstrap sea ice concentrations are an ancillary data set that is analogous to the NOAA/NSIDC CDR data but that adds late 1978 through mid 1987 data to the record. A different instrument, the Scanning Multichannel Microwave Radiometer (SMMR), was the source for the brightness temperatures from this period. Sea ice concentrations from the extended period are not part of the primary NSIDC-produced CDR record because complete documentation of the SMMR brightness temperature processing method is not available. Second, the separate Goddard NASA Team and Bootstrap sea ice concentrations are provided for reference. Variables containing standard deviation, quality flags, and projection information are also included in the netCDF files.
ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enabl... more ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enables the sharing of all geosciences data, information, and knowledge in an open, transparent and inclusive manner. Brokering of data and improvements in discovery and access are a key to data exchange and promotion of collaboration across the geosciences. In this presentation we describe an evolutionary process of infrastructure and interoperability development focused on participation of existing science research infrastructures and augmenting them for improved access. All geosciences communities already have, to a greater or lesser degree, elements of an information infrastructure in place. These elements include resources such as data archives, catalogs, and portals as well as vocabularies, data models, protocols, best practices and other community conventions. What is necessary now is a process for levering these diverse infrastructure elements into an overall infrastructure that provides easy discovery, access and utilization of resources across disciplinary boundaries. Brokers connect disparate systems with only minimal burdens upon those systems, and enable the infrastructure to adjust to new technical developments and scientific requirements as they emerge. Robust cyberinfrastructure will arise only when social, organizational, and cultural issues are resolved in tandem with the creation of technology-based services. This is a governance issue, but is facilitated by infrastructure capabilities that can impact the uptake of new interdisciplinary collaborations and exchange. Thus brokering must address both the cyberinfrastructure and computer technology requirements and also the social issues to allow improved cross-domain collaborations. This is best done through use-case-driven requirements and agile, iterative development methods. It is important to start by solving real (not hypothetical) information access and use problems via small pilot projects that develop capabilities targeted to specific communities. Brokering, as a critical capability for connecting systems, evolves over time through more connections and increased functionality. This adaptive process allows for continual evaluation as to how well science-driven use cases are being met. There is a near term, and possibly unique, opportunity through EarthCube and European e-Infrastructure projects to increase the impact and interconnectivity of projects. In the developments described in this presentation, brokering has been demonstrated to be an essential part of a robust, adaptive technical infrastructure and demonstration and user scenarios can address of both the governance and detailed implementation paths forward. The EarthCube Brokering roadmap proposes the expansion of brokering pilots into fully operational prototypes that work with the broader science and informatics communities to answer these questions, connect existing and emerging systems, and evolve the EarthCube infrastructure.
ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enabl... more ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enables the sharing of all geosciences data, information, and knowledge in an open, transparent and inclusive manner. Brokering of data and improvements in discovery and access are a key to data exchange and promotion of collaboration across the geosciences. In this presentation we describe an evolutionary process of infrastructure and interoperability development focused on participation of existing science research infrastructures and augmenting them for improved access. All geosciences communities already have, to a greater or lesser degree, elements of an information infrastructure in place. These elements include resources such as data archives, catalogs, and portals as well as vocabularies, data models, protocols, best practices and other community conventions. What is necessary now is a process for levering these diverse infrastructure elements into an overall infrastructure that provides easy discovery, access and utilization of resources across disciplinary boundaries. Brokers connect disparate systems with only minimal burdens upon those systems, and enable the infrastructure to adjust to new technical developments and scientific requirements as they emerge. Robust cyberinfrastructure will arise only when social, organizational, and cultural issues are resolved in tandem with the creation of technology-based services. This is a governance issue, but is facilitated by infrastructure capabilities that can impact the uptake of new interdisciplinary collaborations and exchange. Thus brokering must address both the cyberinfrastructure and computer technology requirements and also the social issues to allow improved cross-domain collaborations. This is best done through use-case-driven requirements and agile, iterative development methods. It is important to start by solving real (not hypothetical) information access and use problems via small pilot projects that develop capabilities targeted to specific communities. Brokering, as a critical capability for connecting systems, evolves over time through more connections and increased functionality. This adaptive process allows for continual evaluation as to how well science-driven use cases are being met. There is a near term, and possibly unique, opportunity through EarthCube and European e-Infrastructure projects to increase the impact and interconnectivity of projects. In the developments described in this presentation, brokering has been demonstrated to be an essential part of a robust, adaptive technical infrastructure and demonstration and user scenarios can address of both the governance and detailed implementation paths forward. The EarthCube Brokering roadmap proposes the expansion of brokering pilots into fully operational prototypes that work with the broader science and informatics communities to answer these questions, connect existing and emerging systems, and evolve the EarthCube infrastructure.
Abstract The Hierarchical Data Format (HDF) has been a data format standard in National Aeronauti... more Abstract The Hierarchical Data Format (HDF) has been a data format standard in National Aeronautic and Space Administration (NASA)'s Earth Observing System Data and Information System since the 1990s. Its rich structure, platform independence, full-featured application programming interface (API), and internal compression make it very useful for archiving science data and utilizing them with a rich set of software tools.
Over the last 27 years, the National Snow and Ice Data Center has participated in a number of pro... more Over the last 27 years, the National Snow and Ice Data Center has participated in a number of programs that have striven to provide ready access to high-quality observations and long-term geophysical records. In the last 10 years these programs have increasingly involved data archived at multiple, geographically distributed sites. The key lessons we have learned from these experiences are
NSF's Sustainable Digital Data Preservation and Access Network Partners program is an ambitio... more NSF's Sustainable Digital Data Preservation and Access Network Partners program is an ambitious attempt to integrate a wide variety of expertise and infrastructure into a network for providing "reliable digital preservation, access, integration, and analysis capabilities for science." One of the first two DataNet award recipients, the Data Conservancy, is itself a network of widely diverse partners led by the libraries at the Johns Hopkins University. The Data Conservancy is built on existing exemplar scientific projects, communities, and virtual organizations that have deep engagement with their user communities, and extensive experience with large-scale distributed system development. Data Conservancy members embrace a shared vision that data curation is not an end, but rather a means to collect, organize, validate, and preserve data needed to address the grand research challenges that face society. Data Conservancy members holdings encompass the entire range of eart...
This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwav... more This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwave data. It provides a consistent, daily and monthly time series of sea ice concentrations from 09 July 1987 through through most recent processing for both the north and south polar regions on a 25 km x 25 km grid. The NOAA/NSIDC CDR is based on the recommendations from the National Research Council (NRC) (2004). It is produced from gridded brightness temperatures from the Defense Meteorological Satellite Program (DMSP) series of Special Sensor Microwave Imager (SSM/I) passive microwave radiometers: F-8, F-11, and F-13. The NOAA/NSIDC CDR sea ice concentrations are an estimate of the fraction of ocean area covered by sea ice that is produced by combining concentration estimates created using two algorithms developed at the NASA Goddard Space Flight Center (GSFC): the NASA Team algorithm (Cavalieri et al., 1984) and the Bootstrap algorithm (Comiso, 1986). NSIDC applies the individual algo...
The Earth Observing System (EOS) is NASA's response to the congressionally mandated Global Ch... more The Earth Observing System (EOS) is NASA's response to the congressionally mandated Global Change Research Program (GCRP). Through the EOS program, massive amounts of data will be gathered in areas such as climate and hydrological systems, biogeochemical dynamics, ecological systems, earth system history, human interactions, solid earth processes, and solar influences. The purpose of the EOS Data and Information System
ABSTRACT This data set provides a Climate Data Record (CDR) of sea ice concentration from passive... more ABSTRACT This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwave data. It provides a consistent, daily and monthly time series of sea ice concentrations from 09 July 1987 through through most recent processing for both the north and south polar regions on a 25 km x 25 km grid. The NOAA/NSIDC CDR is based on the recommendations from the National Research Council (NRC) (2004). It is produced from gridded brightness temperatures from the Defense Meteorological Satellite Program (DMSP) series of Special Sensor Microwave Imager (SSM/I) passive microwave radiometers: F-8, F-11, and F-13. The NOAA/NSIDC CDR sea ice concentrations are an estimate of the fraction of ocean area covered by sea ice that is produced by combining concentration estimates created using two algorithms developed at the NASA Goddard Space Flight Center (GSFC): the NASA Team algorithm (Cavalieri et al., 1984) and the Bootstrap algorithm (Comiso, 1986). NSIDC applies the individual algorithms to brightness temperature data from Remote Sensing Systems, Inc. (RSS). The data are gridded on the NSIDC polar stereographic grid with 25 x 25 km grid cells and are available in netCDF file format. Each file includes four different sea ice concentration variables: a variable with the primary CDR sea ice concentrations created by NSIDC and three variables with sea ice concentrations created by Goddard. The three Goddard-produced sea ice concentrations are the Goddard NASA Team algorithm sea ice concentrations, the Goddard Bootstrap sea ice concentrations, and a merged version of the two sea ice concentrations. These Goddard-produced sea ice concentrations are included in the data files for a number of reasons. First, the merged Goddard NASA Team/Bootstrap sea ice concentrations are an ancillary data set that is analogous to the NOAA/NSIDC CDR data but that adds late 1978 through mid 1987 data to the record. A different instrument, the Scanning Multichannel Microwave Radiometer (SMMR), was the source for the brightness temperatures from this period. Sea ice concentrations from the extended period are not part of the primary NSIDC-produced CDR record because complete documentation of the SMMR brightness temperature processing method is not available. Second, the separate Goddard NASA Team and Bootstrap sea ice concentrations are provided for reference. Variables containing standard deviation, quality flags, and projection information are also included in the netCDF files.
ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enabl... more ABSTRACT The goal of NSF's EarthCube is to create a sustainable infrastructure that enables the sharing of all geosciences data, information, and knowledge in an open, transparent and inclusive manner. Brokering of data and improvements in discovery and access are a key to data exchange and promotion of collaboration across the geosciences. In this presentation we describe an evolutionary process of infrastructure and interoperability development focused on participation of existing science research infrastructures and augmenting them for improved access. All geosciences communities already have, to a greater or lesser degree, elements of an information infrastructure in place. These elements include resources such as data archives, catalogs, and portals as well as vocabularies, data models, protocols, best practices and other community conventions. What is necessary now is a process for levering these diverse infrastructure elements into an overall infrastructure that provides easy discovery, access and utilization of resources across disciplinary boundaries. Brokers connect disparate systems with only minimal burdens upon those systems, and enable the infrastructure to adjust to new technical developments and scientific requirements as they emerge. Robust cyberinfrastructure will arise only when social, organizational, and cultural issues are resolved in tandem with the creation of technology-based services. This is a governance issue, but is facilitated by infrastructure capabilities that can impact the uptake of new interdisciplinary collaborations and exchange. Thus brokering must address both the cyberinfrastructure and computer technology requirements and also the social issues to allow improved cross-domain collaborations. This is best done through use-case-driven requirements and agile, iterative development methods. It is important to start by solving real (not hypothetical) information access and use problems via small pilot projects that develop capabilities targeted to specific communities. Brokering, as a critical capability for connecting systems, evolves over time through more connections and increased functionality. This adaptive process allows for continual evaluation as to how well science-driven use cases are being met. There is a near term, and possibly unique, opportunity through EarthCube and European e-Infrastructure projects to increase the impact and interconnectivity of projects. In the developments described in this presentation, brokering has been demonstrated to be an essential part of a robust, adaptive technical infrastructure and demonstration and user scenarios can address of both the governance and detailed implementation paths forward. The EarthCube Brokering roadmap proposes the expansion of brokering pilots into fully operational prototypes that work with the broader science and informatics communities to answer these questions, connect existing and emerging systems, and evolve the EarthCube infrastructure.
Uploads
Papers by Ruth Duerr