InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
31 stars 10 forks source link

Serverless support #192

Open kerthcet opened 3 weeks ago

kerthcet commented 3 weeks ago

What would you like to be added:

Some of the options:

Why is this needed:

Completion requirements:

This enhancement requires the following artifacts:

The artifacts should be linked in subsequent comments.