Service is registering with Service Discovery too soon and starts accepting requests. Which causes number of exceptions to be thrown and start accepting connections to process requests.
grpc.aio._call.AioRpcError: <AioRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses |Gateway: Communication error with deployment ner_t at address(es) {'0.0.0.0:61970', '0.0.0.0:60456', '0.0.0.0:51350', '0.0.0.0:58728'}. Head or worker(s) may be down."
debug_error_string = "{"created":"@1675092791.749754057","description":"Error received from peer ipv4:0.0.0.0:52000","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"failed to connect to all addresses |Gateway: Communication error with deployment ner_t at address(es) {'0.0.0.0:61970', '0.0.0.0:60456', '0.0.0.0:51350', '0.0.0.0:58728'}. Head or worker(s) may be down.","grpc_status":14}"
>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/venv/lib/python3.8/site-packages/marie_server/executors/ner/mserve_torch.py", line 32, in text_ner_post
async for resp in c.post(
File "/opt/venv/lib/python3.8/site-packages/marie/clients/mixin.py", line 358, in post
async for result in c._get_results(
File "/opt/venv/lib/python3.8/site-packages/marie/clients/base/grpc.py", line 271, in _get_results
raise ConnectionError(my_details)
ConnectionError: failed to connect to all addresses |Gateway: Communication error with deployment ner_t at address(es) {'0.0.0.0:61970', '0.0.0.0:60456', '0.0.0.0:51350', '0.0.0.0:58728'}. Head or worker(s) may be down.
Service is registering with
Service Discoverytoo soon and starts accepting requests. Which causes number of exceptions to be thrown and start accepting connections to process requests.