Earth Science Data Systems Level of Service Model

Overview

Data archived at NASA’s Earth Science Data Systems (ESDS) data repositories are provided long-term, high-quality data stewardship that includes more services than just data ingest and storage.

However, each individual data product cannot and likely should not have all the same services applied. The typical goal is to apply the appropriate amount of services to a data product in order to optimize the data usability and access while also balancing the resources, time, and effort required.

The Level of Service model is designed to bring consistency to service determinations for data across all NASA ESDS data repositories and to improve communication of the data archival roles and responsibilities, making it easier for data producers and data users to know what to expect with respect to data stewardship of a given data product.

The term Level of Service refers to the quantity and types of services applied to data during archival and preservation. Services include the activities related to data ingest, storage, documentation, distribution, assurance of usability and discovery, user support, outreach, and preservation.

The process of determining what services to provide a data product has previously been carried out independently at each of the NASA Distributed Active Archive Centers (DAACs). Therefore, data producers interacting with different data repositories may not have received the same services for similar data products. This has led to data producer confusion and frustration and highlighted the need for creating a common model.

The primary goals of the Level of Service Model are to:

Provide a framework for clearly communicating information about data stewardship at NASA ESDS data repositories.
Use consistent terminology so that data producers interacting with multiple data repositories can understand the process no matter which data repository they interact with.
Present clear definitions and service level descriptions so that all data producers and users can understand how services are assigned and have realistic expectations of data repository effort.
List ESDS common data stewardship requirements by service level. Data repository-specific services are not included in the model and would need to be specified separately. Improve enterprise-wide transparency, efficiency and cost-effectiveness of the data stewardship process.

How is Service Level Assigned?

Service levels are assigned based on two common data characteristics: the NASA data processing level and the data product category. The NASA data processing level identifies the nature of the data, from raw instrument data (Level 0) to gridded variable data products (Level 3) to merged data or model output (Level 4).

There are six NASA data product categories:

Science Mission Products
NASA-funded Data Products
Facility Created Products
NASA Research Community Products
NASA Applied Science Products
Non-NASA Research Community Products

More information about the data product categories can be found in the Level of Service model document (PDF).

The Level of Service Determination table below identifies which of three service levels (basic, standard, or comprehensive) apply to data of a given processing level and data category. The second table shows service level descriptions.

Table 1. Level of Service Determination

Chart showing data Product categories with rows showing data processing levels.

Service Level Guide for Data Producers

The intent of the ESDS Level of Service model is to specify the service requirements as opposed to suggesting how those requirements are to be met. This leaves room for data repository personnel to determine the best way for them to meet the requirements.

The Level of Service model covers services in six categories, including Ingest, Check, and Archive; Distribution and Access; Documentation; Discoverability and Usability; User Support and Outreach; and Preservation. The requirements directly relevant to data producers are summarized in Table 2. These lists demonstrate what you can expect a DAAC to do with respect to your data product as far as handling data, documenting data, and supporting data into the future.

The basic level requirements are designed to provide a minimal level of data stewardship that makes the data findable and accessible. Even at the basic level there is a high bar on data requirements that ensures appropriate data stewardship. The additional requirements for standard and comprehensive services build on these baseline requirements, increasing the quality of data care and support. These requirements apply only to upcoming/future datasets at this time. Requirements for already published and supported data have not yet been determined.

Table 2. Service Level Descriptions

Service	Basic Services	Standard Services Includes all Basic Services, plus:	Comprehensive Services Includes all Basic and Standard Services, plus:
Data	Assist with data download or delivery Verify file size, file number, file access Check file name, file structure, and file description for consistency and accuracy Confirm accurate data transfers using checksums, as needed Provide Digital Object Identifier (DOI) that resolves to a data product information page (also called a “landing page”) Make data available on a public server in a reasonable time frame Confirm data are accessible via search services and from adata product landing page link Produce an archived copy and confirm accurate replacement in event of system failure Preserve related documentation and software, as available Update technology to continue safe storage and delivery of data into the future Provide metrics to NASA Earth Science Data and Information System (ESDIS)	Check file format for standard compliance and aid with adjustment if needed Publish more complete metadata, as needed Check data for incomplete or inaccurate values and work with data producer to improve Make data available to common subsetting and reformatting tools and machine services,such as OPeNDAP, and verify usability of data in such tools Publish data browse images from producer or create with producer assistance, as appropriate Develop code for near-real time distribution, if appropriate Publish data to cloud server for cloud analysis and use, if available Provide advanced search capabilities through Earthdata Search	Provide data transfer checksums to users Provide data format translation to serve a broader community Provide specialized services to subset, reproject, reformat, or resample data Add metadata to data, as needed, to increase data discovery and use Develop analysis/decision-ready data products more suitable to a broad community Add data to NASA GIBS/Worldview and other enterprise-wide tools Provide additional specialized data access or use tools Make near-real time data available in NASA LANCE Provide data producer with data usage metrics Include data in relevant virtual collections Transition data formats, as needed, to evolve with tool capabilities and standards
Documentation	Verify and publish basic, accurate metadata (includes geospatial, temporal, and science variable information) Provide citation and DOI-resolvable landing page content Produce a simple user guide containing data summary and links to external documentation Provide permanent access to data information	Provide a more detailed user guide, including methodology and data accuracy sections Assign more detailed metadata (services and variable metadata) in standard format Review any data producer-provided documentation for clarity Provide users with algorithm description documents and processing software, as needed Add data validation publication links to the metadata as they become available over time	Develop additional descriptive or informational materials applicable to more user communities to increase data use Develop data recipes or provide open source software help Add links on the landing page or data product information page that direct users to new data quality publications highlighting scientific findings regarding data Increase linkages to internal/external web pages or documents that may improve data access Publicly provide all preservation documentation in an organized manner
User Support and Outreach	Provide users assistance with data access and basic data use questions Announce data publication via web and social media Maintain website information for as long as data are archived	Broadly announce data publication to reach more user communities Provide data users with assistance and direction to FAQs or user forums, as needed Assist users with machine services and other analysis tools Communicate data quality to data users and assist users with appropriate use Highlight data use on web page or in articles	Provide users with assistance for complex problems and direct users to experts, as needed Highlight data in various outreach materials Highlight data in NASA materials, at conferences, in NASA presentations, and in webinars Develop higher-level visualization tools for targeted user communities Provide subscription services to inform users of data product changes or new versions Interact with and support science teams during and after mission or investigation

Earth Science Data Systems Level of Service Model

Earth Science Data Systems Level of Service Model

Overview

How is Service Level Assigned?

Table 1. Level of Service Determination

Service Level Guide for Data Producers

Table 2. Service Level Descriptions

Find Data

By Platform

By Topic

Data Catalog

Data Tools