ESMValGroup / ESMValCore

ESMValCore: A community tool for pre-processing data from Earth system models in CMIP and running analysis scripts.
https://www.esmvaltool.org
Apache License 2.0
40 stars 36 forks source link

Avoid copying input data in CMIP6 CESM2 air pressure level fixes #2454

Open bouweandela opened 1 month ago

bouweandela commented 1 month ago

Description

Use ncdata to fix files in-memory instead of copies on disk.

Related to #2129 and #674


Before you get started

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the ๐Ÿ›  Technical or ๐Ÿงช Scientific review.


To help with the number pull requests:

valeriupredoi commented 1 month ago

very cool @bouweandela :clap: Always nice to see data transfer optimizations, hope you don't mind me turning on the GA see if any issues for older Pythons - I took a look at the failed tests - couple of them due to mocks not called (easy fix) but one fails due to what looks to be a reversal of the lev bounds, can prob fix that for you here, if you don't have time :beer: