search

InftyAI / Llmaz

⚒ A building block for users to build/serve their own LLM from A to Z on Kubernetes.
https://InftyAI.com
Apache License 2.0
3 stars 4 forks source link

what is the difference than text-generation-webui #20

Open panpan0000 opened 7 months ago

panpan0000 commented 7 months ago

aka: target comparison with https://github.com/oobabooga/text-generation-webui

kerthcet commented 7 months ago

Took a glance of the text-generation-webui, it's a great project but seems more dedicated to model serving, what llmaz hopes to solve including both the serving and fine tuning, prompt management and other stuff around LLMs. And llmaz is building on top of kubernetes, that's the biggest difference I think.