Update Task Status to "Errored" on Celery Timeout Exceedance

[vineetshar]

Description: Currently, when a parsing task exceeds the approved time limit, Celery terminates the task but does not update its status to "Errored." This leads to tasks appearing incomplete or stuck without indicating the timeout failure, which can hinder error tracking and debugging.

Proposed Solution:

• Implement logic to detect when a task is killed due to exceeding the time limit and update its status to "Errored."
• Ensure that all tasks handle timeouts gracefully, providing clear feedback on task status for easier monitoring and troubleshooting.

Tasks:

• [ ] Add error handling in the task code to catch Celery timeouts and update the task status to "Errored."
• [ ] Implement logging for timeout events to aid in debugging and tracking task failures.
• [ ] Test to verify that tasks exceeding the time limit are properly marked as "Errored" in the system.

Acceptance Criteria:

• Tasks that exceed the Celery time limit are automatically marked as "Errored."
• Logging is in place to capture details of timeout occurrences.

[Pratik-Sharma-Dev]

Can i work on this?

[vineetshar]

@Pratik-Sharma-Dev sure, have you gone through the codebase? what's your plan of action?