Modified the remove_duplicate_dims() function so that the subsetter pipeline does not fail on TEMPO ozone profile data when encountering the duplicated "layer" dimension, which is present for variables support_data/ozone_averaging_kernel and support_data/ozone_noise_correlation_matrix.
Overview of work done
Added checks in remove_duplicate_dims() for whether the Dimension and Variable corresponding to the duplicated dimension already exist in the NetCDF. The function directly writes the new variable with no duplicated dimensions rather than keeping it with an altered name that needs to be renamed later in the subsetting procedure.
Overview of verification done
Added a new unit test for TEMPO ozone profile data. Checked that all automated tests passed successfully.
Previously merged commits
add test for ozone profile proxy data
rework duplicate dimension removal to work with TEMPO ozone profile data
pylint update
simplify return of remove_duplicate_dims() andopen_as_nc_dataset()`
remove unused import per pylint
add test data files for TEMPO NO2 and O3PROF (contains duplicate dimension)
clean up comments
Revert "simplify return of remove_duplicate_dims() andopen_as_nc_dataset()`"
This reverts commit e7b709665683824a22cc8013d3935a907dfe78dc.
include Tuple import
update CHANGELOG.md
Revert "Revert "simplify return of remove_duplicate_dims() andopen_as_nc_dataset()`""
This reverts commit 3fe9c2ad16beb559b7a6de2a8fa5794e388b9c78.
Github Issue: #142
Description
Modified the
remove_duplicate_dims()
function so that the subsetter pipeline does not fail on TEMPO ozone profile data when encountering the duplicated "layer" dimension, which is present for variablessupport_data/ozone_averaging_kernel
andsupport_data/ozone_noise_correlation_matrix
.Overview of work done
Added checks in
remove_duplicate_dims()
for whether the Dimension and Variable corresponding to the duplicated dimension already exist in the NetCDF. The function directly writes the new variable with no duplicated dimensions rather than keeping it with an altered name that needs to be renamed later in the subsetting procedure.Overview of verification done
Added a new unit test for TEMPO ozone profile data. Checked that all automated tests passed successfully.
Previously merged commits
add test for ozone profile proxy data
rework duplicate dimension removal to work with TEMPO ozone profile data
pylint update
simplify return of
remove_duplicate_dims() and
open_as_nc_dataset()`remove unused import per pylint
add test data files for TEMPO NO2 and O3PROF (contains duplicate dimension)
clean up comments
Revert "simplify return of
remove_duplicate_dims() and
open_as_nc_dataset()`"This reverts commit e7b709665683824a22cc8013d3935a907dfe78dc.
include Tuple import
update CHANGELOG.md
Revert "Revert "simplify return of
remove_duplicate_dims() and
open_as_nc_dataset()`""This reverts commit 3fe9c2ad16beb559b7a6de2a8fa5794e388b9c78.
PR checklist:
See Pull Request Review Checklist for pointers on reviewing this pull request