search

ray-project / kuberay

A toolkit to run Ray applications on Kubernetes
Apache License 2.0
1.29k stars 412 forks source link

[Feature] Support to generate PersistentVolumeClaim for Pod #59

Open chenk008 opened 3 years ago

chenk008 commented 3 years ago

Search before asking

Description

We need mount PersistentVolume into Pod in some cases. For now, we can add volumes which refer to PersistentVolumeClaim in PodSpec, but we need to create PersistentVolumeClaim manually.

I am looking up some way to create PersistentVolumeClaim automaticly.

Use case

Some ray job need to save file on persistent storage, we need to mount some disk (e.g. aws EBS, aliyun EBS) into Pod.

Related issues

No response

Are you willing to submit a PR?

Jeffwan commented 3 years ago

What kind of volumes you need? Read-Many or EBS per pod like template with index? We handle the exact same problem in distributed training use case

chenk008 commented 3 years ago

@Jeffwan We prefer EBS per pod like template with index.

feilengcui008 commented 3 years ago

Currently we create head/worker pods directly, bu not using workloads like statefulset/deployment。Statefulset/deployment may be more suitable for this case and other functions like rolling upgrade.

Jeffwan commented 3 years ago

@feilengcui008 For normal case, it's true. The major blocker issue for us to adopt sts or deployment is we plan to enable autoscaler soon and we need to fine grain control the pods to be deleted. In this case, both sts and deployment won't work