frappe / press

Full service cloud hosting for the Frappe stack - powers Frappe Cloud
https://frappe.cloud
GNU Affero General Public License v3.0
279 stars 195 forks source link

Scheduler Stops and Deployment Candidate Task Stuck at "Upload - Build Context" #2297

Open esitehoster opened 1 day ago

esitehoster commented 1 day ago

After running Frappe Press for 3–4 days, the scheduler unexpectedly stops, and when attempting to run a deployment candidate, the task list gets stuck at the "Upload - Build Context" step. The following behavior is observed:

During Execution: The task list halts at "Upload - Build Context", showing a completion time but not proceeding to the next step (Setup Prerequisites - Install Essential Packages). In the Background: Despite the task list appearing stuck, the deployment process sometimes completes all tasks (e.g., builds the image and uploads it to DigitalOcean). Job Status: When querying the job status and clicking the get job status action button, it returns a success message, indicating that the tasks were completed. image image

Deployment Candidate Task List: The task list remains stuck at the "Upload - Build Context" step and does not reflect the actual state of the deployment. image

Steps to Reproduce Use Frappe Press to build and deploy a candidate to DigitalOcean. Allow the process to run for 3–4 days. Attempt to create or run a deployment candidate. Observe the scheduler stopping and the task list getting stuck at "Upload - Build Context". Expected Behavior The deployment process should progress smoothly through all tasks without hanging at any step. The task list should accurately reflect the status of the deployment. Actual Behavior The task list becomes stuck at "Upload - Build Context" while some processes are completed successfully in the background. The scheduler stops working after a few days, requiring manual intervention. and to re-start its hard there is no document how to restart

Environment Details Frappe Press Version: (please specify) OS/Hosting Platform: (e.g., Ubuntu 22.04 on AWS) Docker Registry: DigitalOcean

Additional Notes The scheduler stopping further disrupts the workflow. Uploaded Image Size : 2.06 GB

Suggested Fixes Investigate why the task list is not updating correctly. Ensure the scheduler runs consistently without interruptions. Improve task handling and status updates for deployment candidate