Open ShaniHakir opened 3 months ago
This Issue started today out of no where, only with bulk/large campaigns load average and memory seems normal on the server. using version 0.10.x redis on the same server
This might be related
Mar 21 10:33:00 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: #011 raise ConnectionError("Error %s while writing to socket. %s." % Mar 21 10:33:00 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: #011redis.exceptions.ConnectionError: Error 104 while writing to socket. Connection reset by peer. Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] Exception ignored in: <function AsyncResult.__del__ at 0x7f6293a02310> Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] Traceback (most recent call last): Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/celery/result.py", line 385, in __del__ Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self.backend.remove_pending_result(self) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/celery/backends/asynchronous.py", line 175, in remove_pending_result Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self.on_result_fulfilled(result) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/celery/backends/asynchronous.py", line 183, in on_result_fulfilled Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self.result_consumer.cancel_for(result.id) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/celery/backends/redis.py", line 139, in cancel_for Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self._pubsub.unsubscribe(key) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/redis/client.py", line 3280, in unsubscribe Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] return self.execute_command('UNSUBSCRIBE', *args) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/redis/client.py", line 3155, in execute_command Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self._execute(connection, connection.send_command, *args, **kwargs) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/redis/client.py", line 3159, in _execute Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] return command(*args, **kwargs) Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/redis/connection.py", line 686, in send_command Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] self.send_packed_command(self.pack_command(*args), Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] File "/usr/lib/python3/dist-packages/redis/connection.py", line 678, in send_packed_command Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] raise ConnectionError("Error %s while writing to socket. %s." % Mar 21 10:45:20 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:45:20+0300 [stderr#error] redis.exceptions.ConnectionError: Error 104 while writing to socket. Connection reset by peer. Mar 21 10:52:30 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: 2024-03-21T10:52:30+0300 [twisted.web.wsgi._WSGIResponse#critical] WSGI application error Mar 21 10:52:30 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: #011 raise ConnectionError("Error %s while writing to socket. %s." % Mar 21 10:52:30 VIVA-JASMIN-s-4vcpu-8gb-intel-fra1-01 jasmin-restapi[473916]: #011redis.exceptions.ConnectionError: Error 104 while writing to socket. Connection reset by peer.
This Issue started today out of no where, only with bulk/large campaigns load average and memory seems normal on the server. using version 0.10.x redis on the same server
This might be related