Failed to load fedlearner operators from /fedlearner/cc/embedding.so
Traceback (most recent call last):
File "follower.py", line 20, in
import fedlearner.trainer as flt
File "/fedlearner/fedlearner/init.py", line 21, in
from fedlearner import trainer
File "/fedlearner/fedlearner/trainer/init.py", line 23, in
from fedlearner.trainer import trainer_worker
File "/fedlearner/fedlearner/trainer/trainer_worker.py", line 32, in
from fedlearner.trainer.data_visitor import DataPathVisitor, \
File "/fedlearner/fedlearner/trainer/data_visitor.py", line 32, in
from fedlearner.data_join.data_block_visitor import DataBlockVisitor
File "/fedlearner/fedlearner/data_join/data_block_visitor.py", line 20, in
import tensorflow_io # pylint: disable=unused-import
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/init.py", line 21, in
from tensorflow_io.core.python.ops.io_info import version as version
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 69, in
core_golang_ops = _load_library('libtensorflow_io_golang.so')
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 67, in _load_library
"{}, from paths: {}\ncaused by: {}".format(filename, filenames, errs))
NotImplementedError: unable to open file: libtensorflow_io_golang.so, from paths: ['/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/libtensorflow_io_golang.so']
caused by: ['dlopen: cannot load any more object with static TLS']
Failed to load fedlearner operators from /fedlearner/cc/embedding.so
Traceback (most recent call last):
File "leader.py", line 20, in
import fedlearner.trainer as flt
File "/fedlearner/fedlearner/init.py", line 21, in
from fedlearner import trainer
File "/fedlearner/fedlearner/trainer/init.py", line 23, in
from fedlearner.trainer import trainer_worker
File "/fedlearner/fedlearner/trainer/trainer_worker.py", line 32, in
from fedlearner.trainer.data_visitor import DataPathVisitor, \
File "/fedlearner/fedlearner/trainer/data_visitor.py", line 32, in
from fedlearner.data_join.data_block_visitor import DataBlockVisitor
File "/fedlearner/fedlearner/data_join/data_block_visitor.py", line 20, in
import tensorflow_io # pylint: disable=unused-import
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/init.py", line 21, in
from tensorflow_io.core.python.ops.io_info import version as version
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 69, in
core_golang_ops = _load_library('libtensorflow_io_golang.so')
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 67, in _load_library
"{}, from paths: {}\ncaused by: {}".format(filename, filenames, errs))
NotImplementedError: unable to open file: libtensorflow_io_golang.so, from paths: ['/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/libtensorflow_io_golang.so']
启动 leader.py follower.py 之后抛出异常栈：
Failed to load fedlearner operators from /fedlearner/cc/embedding.so Traceback (most recent call last): File "follower.py", line 20, in
import fedlearner.trainer as flt
File "/fedlearner/fedlearner/init.py", line 21, in
from fedlearner import trainer
File "/fedlearner/fedlearner/trainer/init.py", line 23, in
from fedlearner.trainer import trainer_worker
File "/fedlearner/fedlearner/trainer/trainer_worker.py", line 32, in
from fedlearner.trainer.data_visitor import DataPathVisitor, \
File "/fedlearner/fedlearner/trainer/data_visitor.py", line 32, in
from fedlearner.data_join.data_block_visitor import DataBlockVisitor
File "/fedlearner/fedlearner/data_join/data_block_visitor.py", line 20, in
import tensorflow_io # pylint: disable=unused-import
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/init.py", line 21, in
from tensorflow_io.core.python.ops.io_info import version as version
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 69, in
core_golang_ops = _load_library('libtensorflow_io_golang.so')
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 67, in _load_library
"{}, from paths: {}\ncaused by: {}".format(filename, filenames, errs))
NotImplementedError: unable to open file: libtensorflow_io_golang.so, from paths: ['/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/libtensorflow_io_golang.so']
caused by: ['dlopen: cannot load any more object with static TLS']
Failed to load fedlearner operators from /fedlearner/cc/embedding.so
Traceback (most recent call last):
File "leader.py", line 20, in
import fedlearner.trainer as flt
File "/fedlearner/fedlearner/init.py", line 21, in
from fedlearner import trainer
File "/fedlearner/fedlearner/trainer/init.py", line 23, in
from fedlearner.trainer import trainer_worker
File "/fedlearner/fedlearner/trainer/trainer_worker.py", line 32, in
from fedlearner.trainer.data_visitor import DataPathVisitor, \
File "/fedlearner/fedlearner/trainer/data_visitor.py", line 32, in
from fedlearner.data_join.data_block_visitor import DataBlockVisitor
File "/fedlearner/fedlearner/data_join/data_block_visitor.py", line 20, in
import tensorflow_io # pylint: disable=unused-import
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/init.py", line 21, in
from tensorflow_io.core.python.ops.io_info import version as version
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 69, in
core_golang_ops = _load_library('libtensorflow_io_golang.so')
File "/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/init.py", line 67, in _load_library
"{}, from paths: {}\ncaused by: {}".format(filename, filenames, errs))
NotImplementedError: unable to open file: libtensorflow_io_golang.so, from paths: ['/usr/local/lib/python3.7/site-packages/tensorflow_io/core/python/ops/libtensorflow_io_golang.so']