load input files asynchronously

pnwairfire / bluesky

BlueSky Framework rearchitected as a pipeable collection of standalone modules.

GNU General Public License v3.0

19 stars 11 forks source link

Closed jdubowy closed 2 years ago

jdubowy commented 2 years ago

This is most important when using retry logic.

[x] make FiresManager.loads/load and FiresManager.record_error thread safe <-- didn't require anything, due to have python interperter behavior
[x] update bsp.py to use asyncio to and async/awaits to load files in parallel