L2ss was running out of memory when trying to subset SMAP_RSS and CYGNSS collections
Overview of work done
Loading dataset into memory and then writing to file used up a lot of memory. Make a deep copy of the dataset variable and load into memory then write to file. After writing to file delete the deep copy set. This seem to have free up the variable in memory after use and allow us to work within the 2GB we have for a container in harmony. It is still possible to go over the 2GB limit.
Overview of verification done
Tested local harmony to make sure SMAP_RSS and CYGNSS was able to subset all variables
Description
L2ss was running out of memory when trying to subset SMAP_RSS and CYGNSS collections
Overview of work done
Loading dataset into memory and then writing to file used up a lot of memory. Make a deep copy of the dataset variable and load into memory then write to file. After writing to file delete the deep copy set. This seem to have free up the variable in memory after use and allow us to work within the 2GB we have for a container in harmony. It is still possible to go over the 2GB limit.
Overview of verification done
Tested local harmony to make sure SMAP_RSS and CYGNSS was able to subset all variables
Overview of integration done
Made sure all tests still passes
PR checklist:
See Pull Request Review Checklist for pointers on reviewing this pull request