joblib / joblib-spark

Joblib Apache Spark Backend
Apache License 2.0
240 stars 26 forks source link

joblib-spark doesn't work with joblib 1.4.0 #51

Open thinkall opened 2 months ago

thinkall commented 2 months ago

joblib 1.4.0 just released two days ago, it will break joblib-spark:

        if SafeFunction is None:
            # pylint: disable=protected-access,used-before-assignment
            return self._get_pool().apply_async(
>               PoolManagerMixin._wrap_func_call, (run_on_worker_and_fetch_result,),
                callback=callback, error_callback=callback
            )
E           AttributeError: type object 'PoolManagerMixin' has no attribute '_wrap_func_call'

/usr/lib/miniforge3/envs/pytest/lib/python3.10/site-packages/joblibspark/backend.py:214: AttributeError
cometta commented 2 months ago

i faced similar issue