PrefectHQ / prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
https://prefect.io
Apache License 2.0
15.84k stars 1.55k forks source link

Flow Run page becomes unresponsive with complex long-running flows #9774

Open j-tr opened 1 year ago

j-tr commented 1 year ago

First check

Bug summary

We occasionally have flows that run with multiple thousand tasks for multiple days. When viewing these flows or tasks from these flows, the UI becomes unresponsive as soon as the canvas for the flow graph visualization appears and the browser crashes shortly after. This makes it impossible to browse log messages for these flows.

The flow run visualization could be deactivated by default for flows with a large number of tasks or long-running flows.

Reproduction

Let a flow with a large number of tasks run for a long time.

Error

freeze, very high cpu usage, browser crash, no specific error message.

Browers

Prefect version

cloud

Additional context

No response

zhen0 commented 1 year ago

@brandonreid - any thoughts on this one? Does it make sense to add something like a toggle for flow runs that go over the number of task runs we can confidently support?