VIDA-NYU / alpha-automl

Alpha-AutoML is a Python library for automatically generating end-to-end machine learning pipelines.
https://alpha-automl.readthedocs.io
Apache License 2.0
19 stars 3 forks source link

add queue timeout for 30 seconds #60

Closed EdenWuyifan closed 1 year ago

EdenWuyifan commented 1 year ago

Fix the issue on UNIX system after removing SIGALRM, where the process will be stuck at Queue().get() if the multiprocessing process keeps running.

aecio commented 1 year ago

@EdenWuyifan Were you able to verify that the blocking was indeed the issue?

EdenWuyifan commented 1 year ago

@EdenWuyifan Were you able to verify that the blocking was indeed the issue?

I still cannot recreate the exact issue you mentioned earlier. But this PR will protect this multiprocessing processes anyway.

Can you ask the guy who raise this issue about the problematic scene?

roquelopez commented 1 year ago

The error was caused by the start mode used in multiprocessing (spawn or fork). It's not related to queue. I'm going to close this PR.