search

akrherz / facets

My work on the FACETS project
Apache License 2.0
1 stars 1 forks source link

HUC12 SWAT generation code is very slow #1

Closed akrherz closed 6 years ago

akrherz commented 6 years ago

Currently running regcm4/swat/model2swat.py on the nrel system and it is processing about 2 years of data per day. This is too slow for my enjoyment. Clearly, recomputing the raster_stats every timestep is not efficient. Perhaps we have enough memory to load up the raster mask for each huc12 and then just use it to sample?

akrherz commented 6 years ago

The work done to speed this up should be centralized in pyIEM

The speed up looks to be about 20x here for this usage case