DalgoT4D / DDP_backend

Django app for the DDP platform
GNU Affero General Public License v3.0
11 stars 38 forks source link

error locking tasks for deployment #808

Open fatchat opened 1 month ago

fatchat commented 1 month ago
 lock_tasks_for_pending_deployment - : failed to lock blocks for deployment 4e78a7df-e94a-463d-9dd4-70f043f63b0f, ignoring

lock_tasks_for_pending_deployment - : failed to lock blocks for deployment d68b82b2-b24b-4100-94fb-5c390c31b1b0, ignoring
Ishankoradia commented 1 month ago

Someone else was running it, so the system user couldn't lock it in the webhook

Image

Ishankoradia commented 1 month ago

I am guessing something similar for the other deployment.

Image

Ishankoradia commented 1 month ago

In both cases, can't say who triggered the pipeline (can say who did not triggered the pipeline). Would be nice to the orguser_id

fatchat commented 1 month ago

ok so it's not an error because the tasks are already locked

inwebhook_api.lock_tasks_for_pending_deployment we are catching the exceptions thrown by prefect_service.lock_tasks_for_deployment ... so why is grafana seeing them

Ishankoradia commented 1 month ago

Hmmm, no idea. I need to check the alerting logic.

fatchat commented 1 month ago

Yes... not urgent it's just annoying because we get the emails