Is support of text generative feature of Localai is available in kubernetes environment ? if any performance testing performed in kubernetes environment

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

https://localai.io

MIT License

23.75k stars 1.82k forks source link

Is support of text generative feature of Localai is available in kubernetes environment ? if any performance testing performed in kubernetes environment #1634

Closed harshsing2891 closed 8 months ago

harshsing2891 commented 8 months ago

Is your feature request related to a problem? Please describe.

Describe alternatives you've considered

Additional context

lunamidori5 commented 8 months ago

Hello @harshsing2891 please fill out this post for this issue, thank you!

harshsing2891 commented 8 months ago

Is your feature request related to a problem? Please describe.

Describe alternatives you've considered

Additional context

harshsing2891 commented 8 months ago

comment updated