[Feature]: Need resource utilization by RBAC's - Database

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications

https://milvus.io

Apache License 2.0

29.39k stars 2.82k forks source link

[Feature]: Need resource utilization by RBAC's - Database #31217

Open amaypatil opened 6 months ago

amaypatil commented 6 months ago

Is there an existing issue for this?

[X] I have searched the existing issues

Is your feature request related to a problem? Please describe.

A Milvus cluster can have multi-tenancy with multiple orgs, each Org having dedicated DB. There is no way currently to find resource utilization for each DB's (orgs)

Describe the solution you'd like.

Proxy should be extended to support DB level utilization data.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

xiaofan-luan commented 6 months ago

Is there an existing issue for this?

[x] I have searched the existing issues

Is your feature request related to a problem? Please describe.

A Milvus cluster can have multi-tenancy with multiple orgs, each Org having dedicated DB. There is no way currently to find resource utilization for each DB's (orgs)

Describe the solution you'd like.

Proxy should be extended to support DB level utilization data.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

What kind of utilzation you are looking for? Storage, cpu, memory or what? and tenant is seperated by DB is that correct?

amaypatil commented 6 months ago

Yes, resource metrics- vCore/cpu, memory. And yes, tenants are separated by DB. Also, long term - a queue mechanism for user/db will also help to restrict usage of resources across milvus cluster. currently resource group is tied to pods.

xiaofan-luan commented 6 months ago

but is it more easy to get from K8s operator or something? Unless you use resource group