search

spotify / luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Apache License 2.0
17.86k stars 2.39k forks source link

Task died unexpectedly with exit code -11 #2774

Closed deatinor closed 4 years ago

deatinor commented 5 years ago

Hello, my Luigi pipeline failed with this error.

Do you have an idea what does it mean? I didn't find any documentation regarding this. I have no clue about what could have caused this error.

Thank you!

lallea commented 5 years ago

IIRC, it means that one of your tasks launched a program, which ran into a segmentation fault (signal 11).

Bonsanto commented 5 years ago

@lallea Something similar happened to me. I have a Task that trains a machine learning model using sklearn's GridSearchCV and it runs perfectly when I use luigi 2.7.5 but when I use update to 2.8.9 it shows this exception in every run. Perhaps I am wrong but if it had to do with a segmentation fault, shouldn't it happen with both versions. Am I missing something? Thanks!

lallea commented 5 years ago

Luigi cannot cause a segmentation fault inside a spawned process. Butterfly effects can, however. If your program has wild pointers, a slight change in the environment, or in timing, can trigger a segmentation fault.

Bonsanto commented 5 years ago

I see, nevertheless I can replicate this problem just by changing Luigi's library version. This is why I thought it was related to Luigi.

luizender commented 4 years ago

The same issue for me running with luigi 2.8.11. But I did not test in luigi 2.7.5 to see if its work without any problem.

Someone has any idea what can an I do to fix this problem?

lallea commented 4 years ago

This is almost certainly a symptom of a problem with a program that is started from Luigi, and not with Luigi itself. I suggest closing this issue.

If you want to debug the issue, searching the web for "segmentation fault" yields some starting points, linked below. Segmentation faults happen primarily in C/C++ programs, but can also occur in other languages that link in C libraries.

https://en.wikipedia.org/wiki/Segmentation_fault https://stackoverflow.com/questions/2346806/what-is-a-segmentation-fault https://www.cprogramming.com/debugging/segfaults.html https://kb.iu.edu/d/aqsj

Tarrasch commented 4 years ago

Closing for the reasons provided by @lallea.