SAR-ARD / s1ard

Sentinel-1 ARD Prototype Processor
MIT License
26 stars 6 forks source link

corrupt WBM tiles through concurrent writing in parallel processes #153

Closed johntruckenbrodt closed 6 months ago

johntruckenbrodt commented 1 year ago

In parallel processes WBM tiles might be attempted to be created multiple times causing corrupt files. It needs to be made sure that a WBM tile is only created once and other processes needing it wait until it is finished. Or each process creates its own file and only the first to finish renames it to the final file name.

johntruckenbrodt commented 6 months ago

This has been fixed by requiring pyroSAR 0.25.0 in https://github.com/SAR-ARD/S1_NRB/pull/192. This new version implements file locking for the underlying functions pyroSAR.auxdata.dem_autoload and pyroSAR.auxdata.dem_create.