TerminatedWorkerError while running benchmarking

[sacmax]

Hi,

When I try to run benchmarking for Silverkite and Prophet( both with my data and the example data in the notebook provided with Greykite), I get the following error: TerminatedWorkerError: A worker process managed by the executor was unexpectedly terminated. This could be caused by a segmentation fault while calling the function or by an excessive memory usage causing the Operating System to kill the worker.

When I set n_jobs=1, the kernel crashes, whereas for any other value of n_jobs , the above error shows up. OS: windows 10 RAM : 16GB Processor: i7

Any suggestions/pointers?

Regards

[al-bert]

Could you share a reproducible example on the sample data? There's a related thread here, if it helps: https://github.com/scikit-learn-contrib/skope-rules/issues/18.

[sacmax]

Could you share a reproducible example on the sample data? There's a related thread here, if it helps: scikit-learn-contrib/skope-rules#18.

The notebook provided with Greykite on benchmarking can be used to reproduce the issue.

[sayanpatra]

@sacmax Can you try the solution in this thread, please? Let us know if it works or not. https://stackoverflow.com/questions/54139403/how-do-i-fix-debug-this-multi-process-terminated-worker-error-thrown-in-scikit-l

[sacmax]

@sacmax Can you try the solution in this thread, please? Let us know if it works or not. https://stackoverflow.com/questions/54139403/how-do-i-fix-debug-this-multi-process-terminated-worker-error-thrown-in-scikit-l

Hi Sayan,

I did exactly as mentioned in the link you shared but I am still getting the same error. I ran "0300_benchmark" notebook included in Greykite. Also note that RAM usage was 5.6gb when I started the run and it went to 5.8gb of total 15.7gb available when this error showed.

Can anyone try running the same notebook on a machine with configuration similar to mine?

Regards,

[sayanpatra]

We will look into it. In the meantime, if you/ anyone has found a solution, please let us know.

[VaradhKaushik]

I am also getting the error:

TerminatedWorkerError: A worker process managed by the executor was unexpectedly terminated. This could be 
caused by a segmentation fault while calling the function or by an excessive memory usage causing 
the Operating System to kill the worker.

The exit codes of the workers are {SIGSEGV(-11)}

While running the benchmarking notebook [.ipynb] from the Greykite documentation as-is RAM usage does not exceed 6.0 GB/32 GB

OS: Linux Mint 20 Processor: i7 IDE: VS Code