While 2020 was a challenging year, I am proud of how NASA’s Earth Science Data Systems (ESDS) community came together to ensure that data users around the world had uninterrupted access to NASA Earth science data. The work and innovation over the past year furthered the ESDS goals of leading technology development, advancing open science data systems, setting the standard for the efficient production and stewardship of science-quality data, and leveraging the diversity of Earth science communities.
Our long-term data records played a key role in providing a better understanding of the environmental changes we’ve seen as a result of the ongoing COVID-19 pandemic. In June, NASA joined forces with the Japan Aerospace Exploration Agency and European Space Agency (ESA) to create the COVID-19 Earth Observing Dashboard. Leveraging the collective scientific power of data from this tri-agency constellation of Earth observing satellites, we created a simple-to-use platform to document how changes in human activity are affecting our air, water, and economy. This international collaboration demonstrates how, now more than ever, open data and open science are critical to understanding our changing planet.
New and upcoming high-data-volume missions require that we innovate to ensure that the research community has open access to not just data, but also the tools, software, and cyberinfrastructure needed to efficiently do open science. ESDS has strengthened our 25-plus year commitment to open science by investing in community tools for cloud computing through competitive programs to ensure that data from new missions will be easy to access and analyze. ESDS continues to show leadership in technological innovation by investing in machine learning technologies and the development of training datasets for the new era of data analysis.
This past year has been transformational for our cloud migration efforts. We continue to evolve data and services from EOSDIS Distributed Active Archive Centers (DAACs) to the commercial cloud to enable analyses using Big Data that would be impractical to perform on a local computer. A highlight of 2020 cloud efforts was the successful launch in November of the Sentinel-6 Michael Freilich mission. Thanks to the efforts of ESA and NASA's Physical Oceanography DAAC, this is the first natively cloud-hosted mission, which will allow researchers easy and efficient access to mission data.
On a personal note, I am delighted that Katie Baynes joined ESDS in August as a Program Executive. Katie brings to ESDS an intimate familiarity with Earthdata Cloud and will serve a critical role leading and managing ESDS as my deputy. Finally, we are pleased to welcome our new Earth Science Division director, Dr. Karen St. Germain, who joined in the summer. With this new leadership, we look forward to continuing our successes in the coming year – and in years to come.
ESDS Program Executive
Open Access for Open Science.
This succinct phrase sums up the overarching objective of the ESDS Program. Open data are the foundation of ESDS efforts to fulfill the program’s vision of accelerating scientific advancement for societal benefit through innovative Earth science data stewardship and technology development. The ESDS Program oversees the life cycle of NASA Earth science data – from acquisition through processing and distribution – and seeks to maximize the scientific return from NASA Earth observing (EO) missions and experiments. 2020 was a transformative year for ESDS, and saw the culmination of a strategic process that began in 2019 to establish four foundational ESDS Goals:
- Set the standard for efficient production and stewardship of science-quality data.
- Advance open science data systems for the next generation of missions, data sources, and user needs.
- Lead research and development of technology for management and analysis of complex Earth science data.
- Leverage the diversity of global Earth science communities to advance open science.
These ESDS goals were crafted to complement NASA's Science Mission Directorate (SMD) Data and Computing Strategy goals of developing and implementing capabilities to enable open science ensuring the continuous evolution of data and computing systems, and harnessing community and strategic partnerships for innovation. They also help guide ESDS in fulfilling its vision.
The programs, projects, and initiatives comprising ESDS made great strides over the past year not only fulfilling the strategies necessary to achieve these goals, but also furthering the dissemination of free and open data.
Since 1994, NASA Earth science data have been free and open to all users for any purpose, and since 2015 all data systems software developed through NASA research and technology awards have been made available as Open Source Software (OSS). The adoption of open data policies leads to advances in research, the development of new applications, and the exposure of citizens around the globe to information essential for understanding our planet, managing the environment, and encouraging commercial innovation. The many constituent parts of ESDS make this possible.
NASA’s Earth Observing System Data and Information System (EOSDIS) is a core ESDS capability, and the primary operational system facilitating end-to-end data operations – from data acquisition to distribution – for one of the largest archives of EO data on the planet. The more than 41 petabytes (PB) of data in this collection come from a vast array of sources, including satellites, aircraft, field measurements, and numerous other programs.
EOSDIS Mission Operations, which includes command and control, scheduling, data capture, and initial (Level 0) processing, are managed by NASA’s Earth Science Mission Operations (ESMO) Project. The remaining capabilities of EOSDIS constitute EOSDIS Science Operations, which are managed by NASA’s Earth Science Data and Information System (ESDIS) Project. These capabilities include the generation of higher level (Level 1 to 4) science data products and the archiving and distribution of data products. The 12 discipline-specific EOSDIS DAACs are the primary interfaces between global data users and these data, and create a wide range of resources enabling the full and open use of the EOSDIS data they archive and distribute.
Along with 2020 achievements in data processing and distribution, EOSDIS data played (and continue to play) an integral role in the global response to the ongoing pandemic. The free and open distribution of these data are enabling critical research into the effects on Earth systems caused by global efforts to control the pandemic, and the analysis of these data using machine learning are providing valuable windows into changes in global trade and transport.
The Interagency Implementation and Advanced Concepts Team (IMPACT) is an interdisciplinary team that works to maximize the scientific return of NASA’s missions and experiments through developing interagency collaborations, assessing and evaluating ESDS processes, and deploying strategic and technical expertise for rapid prototyping, development, and testing of advanced concepts in data and information systems for Earth observations. Along with the many IMPACT achievements in 2020, their collaborative work facilitating cloud-based production of Harmonized Landsat Sentinel-2 (HLS) data is a major technological highlight of the past year.
Other ESDS program components include the Data System Evolution Program, which includes ESDS Competitive Programs and the ESDS Geographic Information Systems Team (EGIST); collaborative projects such as the Multi-Mission Algorithm and Analysis Platform (MAAP); and new data-acquisition initiatives such as the Commercial Smallsat Data Acquisition (CSDA) Program. ESDS also supports user working groups and the development of standards for data quality, formats, metadata, discoverability, and usability. Working together, these ESDS Program components compiled a record of accomplishment in 2020 that will serve as a firm foundation for an exciting new era for the open use of Big Data.
The talented individuals responsible for the many ESDS Program accomplishments rose to the challenges of 2020. The annual ESDS Program Highlights shows not only how ESDS is fulfilling its goals, but also the tremendous power of a simple concept – Open Access for Open Science.
Download the full 2020 ESDS Highlights to read more about these accomplishments.
Published January 26, 2021