Support loading local models - Githubissues

InftyAI / llmaz-dashboard

A web console for llmaz.

https://github.com/InftyAI/llmaz

Apache License 2.0

3 stars 5 forks source link

Support loading local models #4

Open kerthcet opened 1 year ago

kerthcet commented 1 year ago

[ ] Can be aliased
[ ] Can be used to predict, maybe via llmlite
[ ] Also support endpoints, like chatGPT, huggingface