openaddresses / batch

OpenAddresses/Machine based AWS Batch based ETL Processing
https://batch.openaddresses.io/
MIT License
6 stars 5 forks source link

Job is stuck; not logging or timing out #380

Open bertday opened 6 months ago

bertday commented 6 months ago

Describe the bug Run 2984 (fetching North Carolina addresses, parcels, and buildings as part of PR openaddresses/openaddresses#7093) seems to be stuck. The data-pls action has been running for close to 12 hours. Looking at one of the three jobs, it looks like it ran for about ~45 minutes and then stopped writing logs:

https://batch.openaddresses.io/job/353101/log

Also noticed that the count of pending jobs at the top of the page seems to be out of step with the number of pending jobs listed in the table (screenshot attached).

To Reproduce Steps to reproduce the behavior:

Go to http://batch.openaddresses.io/run/2984

Expected behavior

I would expect the run to have completed or timed out by now. I would also expect the count of pending jobs to be 3.

Screenshots Screenshot 2024-03-26 at 11 36 07 AM

Screenshot 2024-03-26 at 11 35 53 AM

Desktop (please complete the following information):

Additional context n/a