Identification

Title

Towards predicting optimal compression settings for spatiotemporal earth system datasets

Alternative title(s)

d573432

Abstract

The data storage burden resulting from CESM simulations continues to grow, and lossy data compression methods can alleviate this burden, provided that key climate variables are not altered to the point of affecting scientific conclusions. We aim to facilitate the adoption of lossy compression in the geoscience community by making it easier to identify optimal compression parameter settings, and this dataset was generated to support that effort. In particular, this data was used to develop and evaluate an approach for creating models to predict optimal compression parameter settings and identify features that are useful for determining the compressibility of a particular output variable. We provide a subset of daily 2D atmospheric variables from the CESM1 LENS data compressed with the popular ZFP compressor. We also provide compression metrics for all of the compressed datasets and feature values for the original data (that can be used for model training, for example).

Resource type

dataset

Resource locator

https://gdex.ucar.edu/datasets/d573432/

protocol: https

name: Dataset Description

description: Related Link

function: information

https://gdex.ucar.edu/datasets/d573432/dataaccess/

protocol: https

name: Data Access

description: Related Link

function: download

Unique resource identifier

code

codeSpace

Dataset language

Spatial reference system

code identifying the spatial reference system

Classification of spatial data and services

Topic category

climatologyMeteorologyAtmosphere

Keywords

Keyword set

keyword value

dataset

originating controlled vocabulary

title

reference date

date type

revision

effective date

2021-03-30

Keyword set

keyword value

CESM > NCAR Community Earth System Model

originating controlled vocabulary

title

reference date

date type

revision

effective date

2026-10-28

Keyword set

keyword value

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATURE > SURFACE TEMPERATURE

originating controlled vocabulary

title

reference date

date type

revision

effective date

2026-10-28

Geographic location

West bounding longitude

-180.0

East bounding longitude

180.0

North bounding latitude

90.0

South bounding latitude

-90.0

Temporal reference

Temporal extent

Begin position

1920-01-01T0000+00

End position

1974-10-08T0000+00

Dataset reference date

date type

publication

effective date

2026-11-09

Frequency of update

notPlanned

Quality and validity

Lineage

Conformity

Data format

name of format

version of format

Constraints related to access and use

Constraint set

Use constraints

Creative Commons Attribution 4.0 International License

Limitations on public access

None

Responsible organisations

Responsible party

organisation name

email address

datahelp@ucar.edu

responsible party role

pointOfContact

Metadata on metadata

Metadata point of contact

organisation name

NSF NCAR Geoscience Data Exchange

email address

datahelp@ucar.edu

web address

https://gdex.ucar.edu

name: NSF NCAR Geoscience Data Exchange

description: The Geoscience Data Exchange (GDEX), managed by the Computational and Information Systems Laboratory (CISL) at NSF NCAR, contains a large collection of meteorological, atmospheric composition, and oceanographic observations, and operational and reanalysis model outputs, integrated with NSF NCAR High Performance Compute services to support atmospheric and geosciences research.

function: download

responsible party role

pointOfContact

Metadata date

2026-11-09T23:19:55Z

Metadata language