Currently, the executed task runs are monitored using the evening send and receive methods provided by Celery. This implementation needs to be changed as it might pose a possible vulnerability for scaling in the future. We send event logs over receivers which if exceed the required size, cannot be transferred over events. Hence, to combat the same, we will remove the task monitor setup and implement these actions as background tasks.
uniqueg
commented
1 year ago
Currently, the executed task runs are monitored using the evening send and receive methods provided by Celery. This implementation needs to be changed as it might pose a possible vulnerability for scaling in the future. We send event logs over receivers which if exceed the required size, cannot be transferred over events. Hence, to combat the same, we will remove the task monitor setup and implement these actions as background tasks.