ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.37k stars 5.65k forks source link

[gcp][autoscaler] Manual GC of user ssh key #39557

Open rickyyx opened 1 year ago

rickyyx commented 1 year ago

What happened + What you expected to happen

We are adding new key pair to the project every time when a key-pair is not found locally: we should either:

  1. Do GC when we are done
  2. Or do overwrite instead of appending for ray specific ssh key value pairs

Versions / Dependencies

master

Reproduction script

Keep running the gcp launcher on the same GCP project would eventually result in a large commonInstanceMetadata on the project that's too large.

Issue Severity

None

rkooo567 commented 1 year ago

cc @rickyyx we added P1.5 for now, but feel free to reassign the priority