enram / vptstools

Python library to transfer and convert vertical profile time series data
https://enram.github.io/vptstools/
MIT License
3 stars 1 forks source link

Run with `--modified-days-ago 0` failed silently #68

Open peterdesmet opened 11 months ago

peterdesmet commented 11 months ago

@TheJenne18 ran a full processing with --modified-days-ago 0, using 8 vCPUs en 16GB. The job stopped silently, with no data added to the bucket. The only line in the log file is:

Recreate the full set of bucket files (files modified since 401days). This will take a while!

Which I assume is just the start of the process. Did it fail reading the full inventory in memory? It might be useful to provide more messages, to know at what point the processing failed.