apertif / apercal

GNU General Public License v3.0
3 stars 9 forks source link

Parallel/mixed logging with multiple runs of the pipeline. #228

Open kmhess opened 5 years ago

kmhess commented 5 years ago

Inspecting the apercal.log's for 190326042 there is output that is still being written there for other datasets including 190327042 and 190328001. This mix up appears to be continuing with individual beams as well. From Tammo Jan: Argh. I could imagine that the logging doesn't get cleaned up between runs of the pipeline. In start_pipeline there is an attempt to remove output of parallel loggers but also that is a bit broken.