flows crashing without logs.

[deepanshu-zluri]

First check

• [X] I added a descriptive title to this issue.
• [X] I used the GitHub search to find a similar issue and didn't find it.
• [X] I searched the Prefect documentation for this issue.
• [X] I checked that this issue is related to Prefect and not one of its dependencies.

Bug summary

1. flows go to crashed state but they dont add the kubernetes log for the job created by the flow
2. flows go to crashed state after a duration of 6 hours on self-hosted orion but keep running in the background
3. some flows show running status for long hours but actually the job is already ended/deleted in the middle . this chokes up the queue and task concurrency as well

Reproduction

-

Error

No response

Versions

prefect version - 2.7.8

Additional context

No response

[desertaxle]

Thanks for the issue @deepanshu-zluri! Do you have any more information or an example we can use to reproduce this issue?

[blakete]

Are there any internal logging locations I should check when my flows crash with no logs? As of now the reason why my flows are crashing is a black box. Thanks!