rpc error, grpc error, connect to grpc: connection refused

[thachnv92]

Describe the bug I have 3 servers:

• Server 1: Run docker compose to run 1 master node
• Server 2: Run docker compose to run 2 worker nodes
• Server 3: Install mongoDB
• docker image use latest version

I setup crawlab Ok, all thing is work fine.

Yesterday, all task get status is Error, with message: "Task ended with an error: grpc error: stream not found"

I check logs of container worker node and get logs as below:

I check master node, It's OK. I try to check connection from both server A and 2 worker node container in server A to grpc :9666, all thing is Ok. Telnet OK and curl connection OK.

I try to create one more worker node is worker_node_3, and run task on it, It's Ok. Then, I must remove old worker node and re-create to fix this issue temporary.

[tikazyq]

Hi @thachnv92,

Have you tried upgrading to the newest version and restart all master and worker nodes to see if it works okay?

[thachnv92]

Many thanks, I forgot to update this.

It need to more time to retry connect grpc to master node.