Closed HadiKutabi closed 8 months ago
The developer is responsible for ensuring that Task.run creates all outputs. It is documented here: https://github.com/spotify/luigi/blob/master/doc/tasks.rst?plain=1#L158
I suggest closing this issue, since Luigi works as documented.
Working as intended. Thank you @lallea
It is possible that the outputs of a task don't exist but but still assigned as the status DONE.
Here is an example:
If you run this the detailed summary will show that both tasks are successful. However, Task2 cannot be successful because in the run() we only create one of the outputs.
I've traced this error to the worker.py (line 216) and fixed it in a hacky way as follows:
Can someone explain to me if my solution makes sense? or why luigi thinks that the task is successful?
Thanks :)