search

jina-ai / serve

☁️ Build multimodal AI applications with cloud-native stack
https://jina.ai/serve
Apache License 2.0
21.13k stars 2.22k forks source link

Server error popping up while running jina backend #4206

Closed Vidit-Ostwal-zz closed 2 years ago

Vidit-Ostwal-zz commented 2 years ago

While running the backend file of Jina this file Link

TimeoutError('no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f052ce70430>> add "--quiet-error" to suppress the exception details

Environment

image

image

image

Vidit-Ostwal-zz commented 2 years ago

The whole error

`DeprecationWarning: `convert_image_buffer_to_blob` is renamed to `convert_buffer_to_image_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `normalize_image_blob` is renamed to `set_image_blob_normalization` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `convert_image_uri_to_blob` is renamed to `convert_uri_to_image_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `convert_audio_uri_to_blob` is renamed to `convert_uri_to_audio_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `resize_image_blob` is renamed to `set_image_blob_size` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
⠋ 0/5 waiting segmenter encoder indexer ranker gateway to be ready...E0122 22:37:34.537460300     139 socket_utils_common_posix.cc:223] check for SO_REUSEPORT: {"created":"@1642871254.537307700","description":"Protocol not available","errno":92,"file":"src/core/lib/iomgr/socket_utils_common_posix.cc","file_line":202,"os_error":"Protocol not available","syscall":"getsockopt(SO_REUSEPORT)"}
⠇ 1/5 waiting segmenter encoder indexer ranker to be ready...DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py:22)
⠹ 1/5 waiting segmenter encoder indexer ranker to be ready...2022-01-22 22:37:42.917243: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
⠼ 1/5 waiting segmenter encoder indexer ranker to be ready...UserWarning: `layer.apply` is deprecated and will be removed in a future version. Please use `layer.__call__` method instead. (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer_v1.py:1694)
⠴ 1/5 waiting segmenter encoder indexer ranker to be ready...UserWarning: `tf.layers.flatten` is deprecated and will be removed in a future version. Please use `tf.keras.layers.Flatten` instead. (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/keras/legacy_tf_layers/core.py:336)
⠹ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@115[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
         ranker@115[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
        encoder@115[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
        indexer@115[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
⠙ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61772 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        indexer@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61447 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61122 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
⠋ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61772 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        indexer@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61447 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61122 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
⠏ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61772 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        indexer@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61447 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@115[W]:TimeoutError('no response from sock tcp://0.0.0.0:61122 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
      segmenter@115[E]:TimeoutError('no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f052ce70430>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:60797 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
        indexer@115[E]:TimeoutError('no response from sock tcp://0.0.0.0:61447 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f052cd3ba90>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:61447 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
        encoder@115[E]:TimeoutError('no response from sock tcp://0.0.0.0:61122 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f052cc3b8e0>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:61122 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
         ranker@115[E]:TimeoutError('no response from sock tcp://0.0.0.0:61772 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f052caa3b20>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:61772 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
           Flow@115[E]:Flow is aborted due to ['segmenter', 'encoder', 'indexer', 'ranker'] can not be started.
DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses (raised from /usr/lib/python3/dist-packages/apport/report.py:13)
Traceback (most recent call last):
  File "app.py", line 24, in <module>
    main()
  File "app.py", line 15, in main
    with f:
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1118, in __enter__
    return self.start()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1167, in start
    self._wait_until_all_ready()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1251, in _wait_until_all_ready
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart`
JoanFM commented 2 years ago

Hello, can you make sure to remove all the processes that Jina had previously started and to set environment variable JINA_LOG_LEVEL=DEBUG before running the app?

Vidit-Ostwal-zz commented 2 years ago

I am using WLS for the first time, can you tell me the command with which i can set the environment variable

JoanFM commented 2 years ago

u can try to run in the same shell.

export JINA_LOG_LEVEL=DEBUG; python app.py

Vidit-Ostwal-zz commented 2 years ago

Got this log @JoanFM 

`DeprecationWarning: `convert_image_buffer_to_blob` is renamed to `convert_buffer_to_image_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `normalize_image_blob` is renamed to `set_image_blob_normalization` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `convert_image_uri_to_blob` is renamed to `convert_uri_to_image_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `convert_audio_uri_to_blob` is renamed to `convert_uri_to_audio_blob` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
DeprecationWarning: `resize_image_blob` is renamed to `set_image_blob_size` with the same usage, please use the latter instead. The old function will be removed soon. (raised from /home/eagleye/.local/lib/python3.8/site-packages/jina/types/document/converters.py:24)
        indexer@1949[D]:setting up sockets...
        indexer@1949[D]:control over tcp://0.0.0.0:53865
        indexer@1949[D]:input 0.0.0.0:53866
        indexer@1949[D]:input tcp://0.0.0.0:53866 (ROUTER_BIND) output tcp://0.0.0.0:53867 (ROUTER_BIND) control over tcp://0.0.0.0:53865 (PAIR_BIND)
⠋ 0/5 waiting segmenter encoder indexer ranker gateway to be ready...        gateway@1954[D]:setting up sockets...
        gateway@1954[D]:control over ipc:///tmp/tmp3d9uqbg5
        gateway@1954[D]:input 0.0.0.0:54517
        gateway@1954[D]:input tcp://0.0.0.0:54517 (ROUTER_BIND) output tcp://0.0.0.0:54518 (ROUTER_BIND) control over ipc:///tmp/tmp3d9uqbg5 (PAIR_BIND)
E0122 23:14:59.505798400    1954 socket_utils_common_posix.cc:223] check for SO_REUSEPORT: {"created":"@1642873499.505585100","description":"Protocol not available","errno":92,"file":"src/core/lib/iomgr/socket_utils_common_posix.cc","file_line":202,"os_error":"Protocol not available","syscall":"getsockopt(SO_REUSEPORT)"}
        gateway@1929[D]:ready and listening
⠦ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@1938[D]:setting up sockets...
      segmenter@1938[D]:control over tcp://0.0.0.0:53215
      segmenter@1938[D]:input 0.0.0.0:53216
      segmenter@1938[D]:input tcp://0.0.0.0:53216 (ROUTER_BIND) output tcp://0.0.0.0:53217 (ROUTER_BIND) control over tcp://0.0.0.0:53215 (PAIR_BIND)
⠏ 1/5 waiting segmenter encoder indexer ranker to be ready...DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py:22)
⠸ 1/5 waiting segmenter encoder indexer ranker to be ready...         ranker@1952[D]:setting up sockets...
         ranker@1952[D]:control over tcp://0.0.0.0:54191
         ranker@1952[D]:input 0.0.0.0:54192
         ranker@1952[D]:input tcp://0.0.0.0:54192 (ROUTER_BIND) output tcp://0.0.0.0:54193 (ROUTER_BIND) control over tcp://0.0.0.0:54191 (PAIR_BIND)
⠙ 1/5 waiting segmenter encoder indexer ranker to be ready...2022-01-22 23:15:03.703563: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
⠹ 1/5 waiting segmenter encoder indexer ranker to be ready...UserWarning: `layer.apply` is deprecated and will be removed in a future version. Please use `layer.__call__` method instead. (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer_v1.py:1694)
⠼ 1/5 waiting segmenter encoder indexer ranker to be ready...UserWarning: `tf.layers.flatten` is deprecated and will be removed in a future version. Please use `tf.keras.layers.Flatten` instead. (raised from /home/eagleye/.local/lib/python3.8/site-packages/tensorflow/python/keras/legacy_tf_layers/core.py:336)
⠇ 1/5 waiting segmenter encoder indexer ranker to be ready...2022-01-22 23:15:04.359608: W tensorflow/core/framework/cpu_allocator_impl.cc:80] Allocation of 201326592 exceeds 10% of free system memory.
⠹ 1/5 waiting segmenter encoder indexer ranker to be ready...        encoder@1947[D]:setting up sockets...
        encoder@1947[D]:control over tcp://0.0.0.0:53540
        encoder@1947[D]:input 0.0.0.0:53541
        encoder@1947[D]:input tcp://0.0.0.0:53541 (ROUTER_BIND) output tcp://0.0.0.0:53542 (ROUTER_BIND) control over tcp://0.0.0.0:53540 (PAIR_BIND)
⠹ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@1929[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
         ranker@1929[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
      segmenter@1929[D]:waiting for ready or shutdown signal from runtime
         ranker@1929[D]:waiting for ready or shutdown signal from runtime
        encoder@1929[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
      segmenter@1929[D]: Cancel runtime
        encoder@1929[D]:waiting for ready or shutdown signal from runtime
         ranker@1929[D]: Cancel runtime
        encoder@1929[D]: Cancel runtime
      segmenter@1929[D]:Sending TERMINATE command for the 1th time
        encoder@1929[D]:Sending TERMINATE command for the 1th time
         ranker@1929[D]:Sending TERMINATE command for the 1th time
        indexer@1929[W]:<class 'jina.peapods.runtimes.zmq.zed.ZEDRuntime'> timeout after waiting for 600000ms, if your executor takes time to load, you may increase --timeout-ready
        indexer@1929[D]:waiting for ready or shutdown signal from runtime
        indexer@1929[D]: Cancel runtime
⠸ 1/5 waiting segmenter encoder indexer ranker to be ready...        indexer@1929[D]:Sending TERMINATE command for the 1th time
⠙ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53215 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
      segmenter@1929[D]:Sending TERMINATE command for the 2th time
        encoder@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53540 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@1929[D]:Sending TERMINATE command for the 2th time
         ranker@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:54191 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@1929[D]:Sending TERMINATE command for the 2th time
        indexer@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53865 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        indexer@1929[D]:Sending TERMINATE command for the 2th time
⠋ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53215 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
      segmenter@1929[D]:Sending TERMINATE command for the 3th time
        encoder@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53540 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@1929[D]:Sending TERMINATE command for the 3th time
         ranker@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:54191 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@1929[D]:Sending TERMINATE command for the 3th time
        indexer@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53865 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        indexer@1929[D]:Sending TERMINATE command for the 3th time
⠏ 1/5 waiting segmenter encoder indexer ranker to be ready...      segmenter@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53215 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
        encoder@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53540 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
         ranker@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:54191 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
      segmenter@1929[E]:TimeoutError('no response from sock tcp://0.0.0.0:53215 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f09b0cb07c0>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:53215 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
        encoder@1929[E]:TimeoutError('no response from sock tcp://0.0.0.0:53540 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f09b0a62940>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:53540 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
         ranker@1929[E]:TimeoutError('no response from sock tcp://0.0.0.0:54191 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f09b0b1c610>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:54191 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
        indexer@1929[W]:TimeoutError('no response from sock tcp://0.0.0.0:53865 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ')
      segmenter@1929[D]: terminating the runtime process
        encoder@1929[D]: terminating the runtime process
         ranker@1929[D]: terminating the runtime process
        encoder@1929[D]: runtime process properly terminated
⠋ 1/5 waiting segmenter encoder indexer ranker to be ready...        encoder@1929[D]: Joining the process
        indexer@1929[E]:TimeoutError('no response from sock tcp://0.0.0.0:53865 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f09f1024cd0>>
 add "--quiet-error" to suppress the exception details
Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 746, in recv_message
    msg_data = sock.recv_multipart()
  File "/home/eagleye/.local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 625, in recv_multipart
    parts = [self.recv(flags, copy=copy, track=track)]
  File "zmq/backend/cython/socket.pyx", line 781, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 817, in zmq.backend.cython.socket.Socket.recv
  File "zmq/backend/cython/socket.pyx", line 191, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/socket.pyx", line 186, in zmq.backend.cython.socket._recv_copy
  File "zmq/backend/cython/checkrc.pxd", line 22, in zmq.backend.cython.checkrc._check_rc
zmq.error.Again: Resource temporarily unavailable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 356, in close
    self._cancel_runtime()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/peas/__init__.py", line 243, in _cancel_runtime
    self.runtime_cls.cancel(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 485, in cancel
    ZEDRuntime._retry_control_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 455, in _retry_control_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/runtimes/zmq/zed.py", line 445, in _retry_control_message
    send_ctrl_message(
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 638, in send_ctrl_message
    raise ex
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 635, in send_ctrl_message
    r = recv_message(sock, timeout)
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/peapods/zmq/__init__.py", line 750, in recv_message
    raise TimeoutError(
TimeoutError: no response from sock tcp://0.0.0.0:53865 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct?
        encoder@1947[D]:Handled #0 during flush of socket
         ranker@1952[D]:Handled #0 during flush of socket
      segmenter@1938[D]:Handled #0 during flush of socket
      segmenter@1929[D]: runtime process properly terminated
        encoder@1947[D]:Handled #0 during flush of socket
         ranker@1952[D]:Handled #0 during flush of socket
      segmenter@1938[D]:Handled #0 during flush of socket
        indexer@1929[D]: terminating the runtime process
        encoder@1947[D]:Handled #0 during flush of socket
         ranker@1952[D]:Handled #0 during flush of socket
      segmenter@1938[D]:Handled #0 during flush of socket
         ranker@1929[D]: runtime process properly terminated
      segmenter@1929[D]: Joining the process
        encoder@1947[D]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
         ranker@1952[D]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
      segmenter@1938[D]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
         ranker@1929[D]: Joining the process
        indexer@1929[D]: runtime process properly terminated
         ranker@1952[D]: Process terminated
      segmenter@1938[D]: Process terminated
        indexer@1929[D]: Joining the process
        indexer@1949[D]:Handled #0 during flush of socket
        indexer@1949[D]:Handled #0 during flush of socket
      segmenter@1929[D]: Successfully joined the process
        indexer@1949[D]:Handled #0 during flush of socket
         ranker@1929[D]: Successfully joined the process
      segmenter@1929[D]:terminated
         ranker@1929[D]:terminated
        indexer@1949[D]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
      segmenter@1929[D]:waiting for ready or shutdown signal from runtime
         ranker@1929[D]:waiting for ready or shutdown signal from runtime
        indexer@1949[D]: Process terminated
      segmenter@1929[D]:shutdown is already set. Runtime will end gracefully on its own
      segmenter@1929[D]:terminated
         ranker@1929[D]:shutdown is already set. Runtime will end gracefully on its own
      segmenter@1929[D]: Joining the process
         ranker@1929[D]:terminated
      segmenter@1929[D]: Successfully joined the process
         ranker@1929[D]: Joining the process
        indexer@1929[D]: Successfully joined the process
         ranker@1929[D]: Successfully joined the process
        indexer@1929[D]:terminated
        indexer@1929[D]:waiting for ready or shutdown signal from runtime
        indexer@1929[D]:shutdown is already set. Runtime will end gracefully on its own
        indexer@1929[D]:terminated
        indexer@1929[D]: Joining the process
        indexer@1929[D]: Successfully joined the process
        encoder@1947[D]: Process terminated
        encoder@1929[D]: Successfully joined the process
        encoder@1929[D]:terminated
        encoder@1929[D]:waiting for ready or shutdown signal from runtime
        encoder@1929[D]:shutdown is already set. Runtime will end gracefully on its own
        encoder@1929[D]:terminated
        encoder@1929[D]: Joining the process
⠙ 4/5 waiting encoder to be ready...        encoder@1929[D]: Successfully joined the process
           Flow@1929[E]:Flow is aborted due to ['segmenter', 'encoder', 'indexer', 'ranker'] can not be started.
        gateway@1929[D]:waiting for ready or shutdown signal from runtime
        gateway@1929[D]: Cancel runtime
        gateway@1929[D]: Wait to shutdown
        gateway@1954[D]:#sent: 0 #recv: 0 sent_size: 0 Bytes recv_size: 0 Bytes
           JINA@1954[D]:all gateway tasks are cancelled
        gateway@1954[D]:Received message is empty.
        gateway@1954[D]: Process terminated
        gateway@1929[D]: Joining the process
        gateway@1929[D]: Successfully joined the process
        gateway@1929[D]:terminated
        gateway@1929[D]: Joining the process
        gateway@1929[D]: Successfully joined the process
           Flow@1929[D]:Flow is closed!
           Flow@1929[D]:Flow is closed!
DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses (raised from /usr/lib/python3/dist-packages/apport/report.py:13)
Traceback (most recent call last):
  File "app.py", line 24, in <module>
    main()
  File "app.py", line 15, in main
    with f:
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1118, in __enter__
    return self.start()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1167, in start
    self._wait_until_all_ready()
  File "/home/eagleye/.local/lib/python3.8/site-packages/jina/flow/base.py", line 1251, in _wait_until_all_ready
    raise RuntimeFailToStart
jina.excepts.RuntimeFailToStart`
JoanFM commented 2 years ago

Hello @Vidit-Ostwal ,

can u please share the exact code u are running?

Vidit-Ostwal-zz commented 2 years ago

@JoanFM app.py content

from jina import DocumentArray, Flow
from jina.types.document.generators import from_files

def check_query(resp):
    for d in resp.docs:
        print(f"{d.uri}, {len(d.chunks)}")
        for m in d.matches:
            print(f'+- {m.uri}: {m.scores["cosine"].value:.6f}, {m.tags}')

def main():
    docs = DocumentArray(from_files("data/*.mp3"))

    f = Flow.load_config("flow.yml")
    with f:
        f.post(on="/index", inputs=docs)
        f.post(on="/search", inputs=docs, on_done=check_query)
        f.protocol = "http"
        f.cors = True
        f.block()

if __name__ == "__main__":
    main()

Flow.yml content

jtype: Flow
version: "1"
with:
    port_expose: 45678
executors:
    - name: "segmenter"
      uses: AudioSegmenter
      uses_with:
          window_size: 4
          stride: 2
      py_modules:
          - executors.py
    - name: "encoder"
      uses: "jinahub://VGGishAudioEncoder"
      uses_with:
          traversal_paths: ["c"]
          load_input_from: "waveform"
          min_duration: 4
      install_requirements: "True"
      volumes:
          - "./models:/workspace/models"
    - name: "indexer"
      uses: "jinahub://SimpleIndexer"
      uses_with:
          match_args:
              limit: 5
              traversal_rdarray: ["c"]
              traversal_ldarray: ["c"]
      install_requirements: "True"
    - name: ranker
      uses: MyRanker
      py_modules:
          - executors.py
Vidit-Ostwal-zz commented 2 years ago

@JoanFM any solution?

JoanFM commented 2 years ago

Can u show how I can get the executors.py and fhe data folder?

JoanFM commented 2 years ago

I have seen where u took the code.

I feel like u should be able to work if u keep the versions of the Executors.

Can you try with:

 "jinahub://SimpleIndexer/v0.11"
 "jinahub://VGGishAudioEncoder/v0.4"
Vidit-Ostwal-zz commented 2 years ago

Can u show how I can get the executors.py and fhe data folder?

https://github.com/Vidit-Ostwal/Jina-example

Vidit-Ostwal-zz commented 2 years ago

I tried running it with version including, but got the same error indexer@122[E]:TimeoutError('no response from sock tcp://0.0.0.0:61536 after timeout=5000ms, please check the following: is the server still online? is the network broken? are "port" correct? ') during <bound method BasePea.close of <jina.peapods.peas.BasePea object at 0x7f6d19bd3a30>> add "--quiet-error" to suppress the exception details

JoanFM commented 2 years ago

have u checked if u have other processes listening in those ports?

Vidit-Ostwal-zz commented 2 years ago

most probably it's not, as I am for the first time trying making my local computer as a server for an app,But I can still check it once Can you tell me how can i check them?

JoanFM commented 2 years ago

You can try with this command:

netstat -ltnp

Vidit-Ostwal-zz commented 2 years ago

image Got this as the result @JoanFM

JoanFM commented 2 years ago

may u try to increase the timeout_ctrl for each executor to 60000 ms?

JoanFM commented 2 years ago

Btw, what is the OS u are running on?

Vidit-Ostwal-zz commented 2 years ago

Running in windows using WSL

bwanglzu commented 2 years ago

@Vidit-Ostwal i'll try to build your example locally (on mac) to see if it works. have you pushed your latest code into the repo here? https://github.com/Vidit-Ostwal/Jina-example.git

Vidit-Ostwal-zz commented 2 years ago

@bwanglzu Yes

bwanglzu commented 2 years ago

had a pairing session with @Vidit-Ostwal , I managed to run his project on a fresh python environment on mac os and it worked The error is comes from the incompatibility between latest Jina (2.6.4) against WSL.

Vidit-Ostwal-zz commented 2 years ago

Shall I close this issue?

Vidit-Ostwal-zz commented 2 years ago

Shall I close this issue?

@bwanglzu @JoanFM