spotify / luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Apache License 2.0
17.71k stars 2.39k forks source link

Race Condition possibility #3233

Open vasnake opened 1 year ago

vasnake commented 1 year ago

https://github.com/spotify/luigi/blob/18bf067ef9e49488ad56dfd2374ac373e359a8a0/luigi/contrib/simulate.py#L79

Should be shutil.rmtree(path, ignore_errors=True)