issues
search
icenet-ai
/
icenet-etl
Infrastructure for storing IceNet predictions and importing them into a database
MIT License
1
stars
0
forks
source link
Speed up NetCDF processing
#21
Closed
jemrobinson
closed
2 years ago
jemrobinson
commented
2 years ago
use multiple inserts
add retries on database failures
do not store xarray as a class attribute
add script for testing locally
Overall run time reduced from ~12hrs to ~3hrs
Closes #20
Overall run time reduced from ~12hrs to ~3hrs
Closes #20