search

flyteorg / flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
https://flyte.org
Apache License 2.0
5.42k stars 581 forks source link

[Housekeeping] Remove unused index on execution error code #5675

Open katrogan opened 3 weeks ago

katrogan commented 3 weeks ago

Describe the issue

See https://github.com/flyteorg/flyte/blob/38883c721dac2875bdd2333f4cd56e757e81ea5f/flyteadmin/pkg/repositories/models/execution.go#L56

indicies slow down writes and come with an I/O overhead. We should clean up any that are unused

What if we do not do this?

Impact on perf for writes to executions table in flyteadmin

Related component(s)

flyteadmin

Are you sure this issue hasn't been raised already?

Have you read the Code of Conduct?

katrogan commented 3 weeks ago

cc @eapolinario

runllm[bot] commented 3 weeks ago

The issue you described pertains to removing an unused index on the execution error code in the execution model to improve write performance. According to the execution model, the ErrorCode field is indexed, which can indeed slow down write operations due to the additional I/O overhead.

Would you like more detail on how to identify and remove this index, or any other specific aspect of this issue?

Sources:

This is an AI-generated response and your feedback is appreciated! Please leave a 👍 if this is helpful and 👎 if it is not.

Mention @runllm to ask follow-up questions. See runllm.com for more!