bert serving start can not start right

[ares5221]

Prerequisites

Please fill in by replacing [ ] with [x].

• [ ] Are you running the latest bert-as-service? yes
• [ ] Did you follow the installation and the usage instructions in README.md?
• [ ] Did you check the FAQ list in README.md?
• [ ] Did you perform a cursory search on existing issues?

System information

Some of this information can be collected via this script.

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04): ununtu18.04
• TensorFlow installed from (source or binary):binary
• TensorFlow version:1.10
• Python version:3.6
• bert-as-service version:
• GPU model and memory:
• CPU model and memory:

---

Description

Please replace YOUR_SERVER_ARGS and YOUR_CLIENT_ARGS accordingly. You can also write your own description for reproducing the issue.

I'm using this command to start the server:

bert-serving-start YOUR_SERVER_ARGS

and calling the server via:

bc = BertClient(YOUR_CLIENT_ARGS)
bc.encode()

Then this issue shows up:

I:VENTILATOR:[i:i: 67]:freeze, optimize and export graph, could take a while... I:GRAPHOPT:[gra:opt: 53]:model config: /home/liujiefei/pythonworkspace/06bertserver/02bertapp/chinese_L-12_H-768_A-12/bert_config.json I:GRAPHOPT:[gra:opt: 56]:checkpoint: /home/liujiefei/pythonworkspace/06bertserver/02bertapp/chinese_L-12_H-768_A-12/bert_model.ckpt I:GRAPHOPT:[gra:opt: 60]:build graph... I:GRAPHOPT:[gra:opt:132]:load parameters from checkpoint... I:GRAPHOPT:[gra:opt:136]:optimize... I:GRAPHOPT:[gra:opt:144]:freeze... I:GRAPHOPT:[gra:opt:149]:write graph to a tmp file: /tmp/tmpuy7sitnv I:VENTILATOR:[i:i: 75]:optimized graph is stored at: /tmp/tmpuy7sitnv I:VENTILATOR:[i:_ru:129]:bind all sockets I:VENTILATOR:[__i:_ru:133]:open 8 ventilator-worker sockets I:VENTILATOR:[i:_ru:136]:start the sink I:SINK:[__i:_ru:306]:ready I:VENTILATOR:[i:_ge:222]:get devices Exception in thread Thread-1: Traceback (most recent call last): File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner self.run() File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init.py", line 115, in run self._run() File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(*args, kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(*args, *kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(args, kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/zmq_decor.py", line 27, in wrapper return func(*args, **kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init.py", line 143, in _run device_map = self._get_device_map() File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init__.py", line 228, in _get_device_map num_all_gpu = len(GPUtil.getGPUs()) File "/home/liujiefei/.local/lib/python3.6/site-packages/GPUtil/GPUtil.py", line 102, in getGPUs deviceIds = int(vals[i]) ValueError: invalid literal for int() with base 10: 'Failed to initialize NVML: Driver/library version mismatch' ...

[SlimenBouras]

same problem here

[Scarlett796]

I have the same problem，have you solved it?

[18166035475]

I have the same problem，have you solved it?

[ares5221]

same problem here

try latest version

[ares5221]

I have the same problem，have you solved it?

try latest version