InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes
Apache License 2.0
13 stars 5 forks source link

Prompts managements #90

Open kerthcet opened 3 weeks ago

kerthcet commented 3 weeks ago

What would you like to be added:

For inference scenarios, prompts management is an important part of it.

Why is this needed:

Easy to use for inference users.

Completion requirements:

This enhancement requires the following artifacts:

The artifacts should be linked in subsequent comments.

kerthcet commented 3 weeks ago

/kind feature