search

geoschem / integrated_methane_inversion

Integrated Methane Inversion workflow repository.
https://imi.readthedocs.org
MIT License
26 stars 22 forks source link

[FEATURE REQUEST] Clean-up options #129

Closed djvaron closed 6 months ago

djvaron commented 1 year ago

Name and Institution (Required)

Name: Daniel Varon Institution: Harvard University

New IMI feature or discussion

The IMI currently produces much more output data than needs to be archived in practice. We should introduce options to clean up inversion directories after running the IMI.

A starting point would be an option to automatically remove the data_sensitivities folder, which is used to generate the Jacobian sensitivity files, is generally not needed after that has been done, and tends to be very large.

djvaron commented 1 year ago

We may also want to use some of the encoding options availabe with to_netcdf() in xarray.

EDIT: James East recommends something like ds.to_netcdf('file.nc', encoding={v: {'zlib':True,'complevel':1} for v in ds.data_vars}})

laestrada commented 1 year ago

We may also want to use some of the encoding options availabe with to_netcdf() in xarray.

EDIT: James East recommends something like ds.to_netcdf('file.nc', encoding={v: {'zlib':True,'complevel':1} for v in ds.data_vars}})

Using compression is addressed by #143

msulprizio commented 6 months ago

This is resolved by https://github.com/geoschem/integrated_methane_inversion/pull/184