johntruckenbrodt / pyroSAR

framework for large-scale SAR satellite data processing
MIT License
494 stars 110 forks source link

auxdata: file locking and VRT source checks #292

Closed johntruckenbrodt closed 4 months ago

johntruckenbrodt commented 5 months ago

This adds file locking to the auxdata download mechanisms and the dem_create function. This way, situations can be avoided where two parallel processes depend on the same file but one tries to use it while the other one has not finished creating it. Locks are applied to downloaded DEM tiles as well as created mosaics.
Furthermore, the source files of a VRT are now checked in dem_create to avoid incomplete mosaics (fixes #196).