ESDS Program

Multi-Mission Data Processing System Study, Phase 2: Design Review and Architecture Study

The Multi-Mission Data Processing System Study is being conducted to identify the best model for an open Mission Data Processing System (MDPS) to support upcoming NASA Earth science missions, particularly the coordinated missions comprising NASA's Earth System Observatory (ESO). The study will identify a data processing architecture that not only meets future mission science processing objectives and supports Earth system science, but also promotes open science principles and enables data system efficiencies.

The study comprises several phases, with each phase building on the results of the previous phase. In keeping with NASA open science guidelines and objectives, all phases in the study are open and encourage participation by the broader science and data processing communities. Phase 1: Concept Study was completed in March 2023.

Back to Multi-Mission Data Processing System Study home page.

Phase 2: Design Review and Architecture Study

Phase 1 of the Multi-Mission Data Processing System Study concluded with a recommendation for a MDPS designated Type 2 (Managed Services), Variant 4 (encompassing infrastructure, data, catalog, and analysis and processing services) and written as T2V4.

A detailed analysis of the recommended T2V4 MDPS began in March 2023 and a final report is scheduled for release in September 2024. This follow-on investigation will increase the fidelity of the architecture by establishing the use cases, system requirements, system definition, and potential impact to upcoming missions. Phase 2 will conclude with a final report and a data processing prototype with associated documentation.

Image
Phase 2 is a detailed analysis of the recommended Type 2, Variant 4 (T2V4) Mission Data Processing System (MDPS). It will start with a systems engineering review followed by an analysis of extending the MDPS for multi-mission use and investigating candidate implementations and potential early adopters of the architecture.

On the recommendation and board feedback from the Multi-Mission Data Processing System (MDPS) engineering review, NASA Earth Data Officer Katie Baynes solicited additional use cases for inclusion in the study with a Request for Information (RFI). The solicitation was intended to facilitate the inclusion of a more diverse set of use cases to validate the MDPS architecture in the prototype phase.

There were 14 responses, of which three were selected for inclusion in the study. This was in addition to the existing SBG data processing use case that was incorporated from the outset of the study effort. The three supplemental use cases were:

  • Migration of the existing on-premise Earth Surface Mineral Dust Source Investigation (EMIT) algorithm development environment onto the cloud-based MDPS algorithm development environment and demonstration of the ability to support evolving algorithm development needs
  • Support for the production of a Joint Polar Satellite System (JPSS) Level 1 to Level 3 forward processing data production for one satellite in collaboration with the Atmosphere Science Investigator-led Processing System (SIPS).
  • Demonstration of the ability to support migration of processing job(s) from the Mission Cloud Platform (MCP) compute resources to the High-End Computing (HEC) infrastructure to support bulk reprocessing and similar project needs

The addition of these use cases will enable a more detailed evaluation of the prototype architecture as it moves into the validation phase. 

Phase 2 Study Participants

Steering Team

  • Andrew Bingham (NASA's Jet Propulsion Laboratory)
  • Dana Ostrenga (NASA's Goddard Space Flight Center)

Multimission Implementation

  • Luke Dahl (JPL) (Lead)
  • Eric Chang (JPL)
  • Mike Gangl (JPL)
  • Brian Lee (JPL)
  • Karen Yuen (JPL)

System Architecture Advisory Team

  • Co-Chairs
    • Evelyn Ho (Goddard)
    • Elias Sayfi (JPL)
  • Team Members
    • Kathleen Dejwakh (NASA's Langley Research Center)
    • Jeff Walter (Langley)
    • Sean Harkins (Devseed)
    • Kathryn Saad (NASA Headquarters)
    • Andrew Michaelis (NASA's Ames Research Center)
    • Patrick Quinn (Goddard)
    • Curt Tilmes (Goddard)
    • Hook Hua (JPL)
    • Qing Yue, (JPL)

ESO Mission Representatives

  • Atmosphere Observing System: Navid Golpayegani (Goddard)
  • Mass Change: David Wiese (JPL)
  • Surface Biology and Geology: Michelle Gierach (JPL), George Chang (JPL)
Systems Engineering Review, October 24-25, 2023

A Formal Systems Engineering Review was held October 24-25, 2023, at NASA’s Langley Research Center in Hampton, Virginia.

The goals of the review were to:

  • Review systems engineering artifacts to validate architectural compliance and maturation of the Phase 1 T2V4 MDPS recommendation
  • Demonstrate ability to support ESO mission use cases as provided by ESO project representatives
  • Deliver prioritized development activities to enable an MMO-managed MDPS architecture to support ESO mission processing needs
  • Assess the maturity of the project and the progress made in defining the mission data processing system requirements to support ESO missions

Review Board Members

NASA Earth Science Data Systems (ESDS) Program Executive and Review Board Chair: Cerese Albers

  • ESO Mission Representatives:
    • Atmosphere Observing System Mission: Curt Tilmes
    • Mass Change Mission: Felix Landerer
    • Surface Biology and Geology Mission: Peter Xaypraseuth
  • NASA Centers and Facilities Representatives:
    • Ames Research Center: Jon Jenkins, Robin Fergason (Ex Officio Member)
    • Goddard Space Flight Center: Sean Bailey
    • Jet Propulsion Laboratory: Jennifer Cruz
    • Langley Research Center: Jeff Walter
    • Marshall Space Flight Center: Brent Roberts
  • NASA's Earth Science Division (ESD) Flight Program, Operating Missions, and other Earth Science Missions Representative: Michael Obland
  • NASA's Office of the Chief Science Data Officer (OCSDO): Andrew Mitchell (Ex Officio Member)

Read the Workshop Final Report

Read the Workshop Final Report Executive Summary

Last Updated