actinia-org / actinia-core

Actinia Core is an open source REST API for scalable, distributed, high performance processing of geographical data that uses mainly GRASS GIS for computational tasks (DOI: https://doi.org/10.5281/zenodo.5879231) | Tutorial: https://actinia-org.github.io/actinia-core/ | Docker: https://hub.docker.com/r/mundialis/actinia-core
https://actinia.mundialis.de/
GNU General Public License v3.0
81 stars 23 forks source link

joblib_1_1_0 #377

Closed griembauer closed 1 year ago

griembauer commented 2 years ago

This PR updates the python joblib library to 1.1.0 as it may otherwise lead to errors when multiprocessing in scikit-learn:

--------------------------------------------------------------------------------
LokyProcess-7 failed with traceback:
--------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python3.9/site-packages/joblib/externals/loky/backend/popen_loky_posix.py", line 199, in <module>
process_obj = pickle.load(from_parent)
File "/usr/lib/python3.9/site-packages/joblib/externals/loky/backend/queues.py", line 75, in _setstate_
self._after_fork()
File "/usr/lib/python3.9/multiprocessing/queues.py", line 69, in _after_fork
self._reset(after_fork=True)
File "/usr/lib/python3.9/multiprocessing/queues.py", line 73, in _reset
self._notempty._at_fork_reinit()
AttributeError: '_SafeQueue' object has no attribute '_notempty'
mmacata commented 1 year ago

Resolved in https://github.com/mundialis/actinia_core/pull/393 and https://github.com/mundialis/actinia-docker/pull/17, so closing this.