search

flyteorg / flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
https://flyte.org
Apache License 2.0
5.81k stars 661 forks source link

flyte binary vs core #5729

Open sorushsaghari opened 2 months ago

sorushsaghari commented 2 months ago

Discussed in https://github.com/flyteorg/flyte/discussions/5728

Originally posted by **sorushsaghari** September 7, 2024 I have tried to find the real difference between flyte-core and binary helm charts. but there is no official hints about them. i dont know which one to choose. could you please help me ?
welcome[bot] commented 2 months ago

Thank you for opening your first issue here! 🛠

kumare3 commented 2 months ago

@sorushsaghari the idea is always great to start with flyte-binary the difference is scale. If you want to go beyond a thousand workflows concurrently, it might be better to consider flyte-core as this will deploy multi replicas of admin, catalog etc and make singular deploy of propeller. you can also scale out propeller independently.

But, remember you can start with flyte-binary and when you hit scale upgrade to flyte-core.

@davidmirror-ops can we have a doc that explains this?