microsoft / ray-on-aml

Turning AML compute into Ray cluster
Other
77 stars 12 forks source link

Publish 0.22 to pipy #14

Closed edgBR closed 1 year ago

edgBR commented 2 years ago

Hi,

The last version that can be installed from PyPI is 0.21, this one does not have incorporated the ray start arguments which is kind of a need if you are running ray interactively (as you will have to play with the system config to not saturate the disk space of a compute instances, which is limited to 120GBs)

Could you please publish it there?

BR E

Joseph-Sarsfield commented 1 year ago

Agreed, would be useful to have this feature on pypi.

james-tn commented 1 year ago

Hi, thanks for the feedback. I'll look into this and will have something out soon.

Joseph-Sarsfield commented 1 year ago

ray init kwargs would be helpful as well

chnldw commented 1 year ago

@Joseph-Sarsfield maybe the package could remove ray.init and let consumer to init as ray.init is not required to setup Ray cluster.

james-tn commented 1 year ago

What do you think about the use of just ray client instead of using the CI as the head node? Ray client now can run code just like you're on head node. It's easier to configure the remote cluster (e.g. avoid issue with python version mismatch). So I will deprecate the use of CI as the direct head node in the next release.

james-tn commented 1 year ago

Checkout the new version. All options are there