Open timothygebhard opened 2 years ago
Hi @timothygebhard,
Yup this is a known issue and pynisher had been updated to fix it, but we need to update quite a few things at once to make this work. This will be done at the start of the october once I can return to working on auto-sklearn.
Btw, turns out we just can't limit memory with MacOS: https://github.com/automl/pynisher#details. The future iterations of auto-sklearn will simply just raise a warning when attempting to limit memory on Mac and that's all we can do.
Best, Eddie
Hi @eddiebergman is there any update on this issue? Is there any workaround? My setup:
Hi @eddiebergman! I got the same issues here, is anyway we can solve this like change memory limit or number of cores?
here is my environment:
Sorry I missed this! No there's been no update, it's a Mac operating system problem that we can't limit memory, your best bet with auto-sklearn the only solution I know of is to set no memory limit, but this can potentially leads to more problems.
Sorry I missed this! No there's been no update, it's a Mac operating system problem that we can't limit memory, your best bet with auto-sklearn the only solution I know of is to set no memory limit, but this can potentially leads to more problems.
@eddiebergman thank you for the reply. The issue is not with setting a memory limit, the issue is that the error makes usage of the library on Mac impossible. Even though you would not use Mac in a production setting, but it reduces the number of people who want to experiment with the library, like me. Ultimately I went with another library, as running auto-sklearn in a docker container while debugging via ssh, is not optimal.
How does one set no memory limit?
+1
Describe the bug
When I try to run the example on multi-output regression from the docs, the
.fit()
routine crashes with aValueError
.To Reproduce
Steps to reproduce the behavior:
.fit()
routine crash.Expected behavior
The code should run through and produce results like in the docs.
Actual behavior, stacktrace or logfile
The
.fit()
routine crashes with the following error message:Environment and installation:
Please give details about your installation:
Additional comments:
When I run the Binder version of the notebook, the problem does not occur. Maybe this means it is a macOS-specific issue? After all,
multiprocessing
is one of those modules that don't always behave the same on Linux and macOS.