InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
17 stars 7 forks source link

Add validation to Playground as the backendConfig's resource requests should not be greater than limits #135

Open kerthcet opened 1 week ago

kerthcet commented 1 week ago

What would you like to be cleaned:

Make sure the resources are qualified. https://github.com/InftyAI/llmaz/blob/8637aa93cad2bc7a3636655b426ab4f818077671/api/inference/v1alpha1/config_types.go#L48-L52

Why is this needed:

kerthcet commented 1 week ago

/help

kerthcet commented 1 week ago

/good-first-issue

googs1025 commented 3 days ago

i will try to fix this in these day /assign

googs1025 commented 1 day ago

I want to confirm one thing: how do we ensure resource eligibility validation? For example: limit >= request?

googs1025 commented 1 day ago

I want to confirm one thing: how do we ensure resource eligibility validation? For example: limit >= request?

Apologies, I didn't see the title clearly. The title already indicates it.😓