flyteorg / flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
https://flyte.org
Apache License 2.0
5.73k stars 649 forks source link

[BUG] Local and remote caching behaviour should not differ #5837

Open fg91 opened 3 weeks ago

fg91 commented 3 weeks ago

Describe the bug

As a user, I would expect that the caching behaviour is the same when executing a workflow in a cluster vs executing it locally as a python script.

In practice, there are situations where the behaviour differs:

Expected behavior

Additional context to reproduce

No response

Screenshots

No response

Are you sure this issue hasn't been raised already?

Have you read the Code of Conduct?

fg91 commented 3 weeks ago

In case anyone observes another situation where the behaviour differs, feel free to add to this issue.

popojk commented 6 hours ago

take