search

ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
34.16k stars 5.8k forks source link

[Docs] [Jobs] Add pros and cons of different ways of submitting a job #30305

Open architkulkarni opened 2 years ago

architkulkarni commented 2 years ago

There are a few ways of submitting jobs. We should agree on the pros/cons of these approaches and how we want to recommend them, and add a summary to the documentation.

Original comment below

    Not a blocker for this PR, but I think we should also have brief description & pros and cons of each job submission model? For example, driver is the best for local dev, users should have ssh access to the head node. Job submission is the best when you submit a script outside the cluster and track the progress. Client is the best when you have jupyter outside the cluster. Something like that

Originally posted by @rkooo567 in https://github.com/ray-project/ray/issues/29608#issuecomment-1314691364

0x2b3bfa0 commented 1 year ago

Tangentially related to https://github.com/ray-project/ray/issues/30892#issuecomment-1409403828

rkooo567 commented 1 year ago

this is awesome @architkulkarni !