louisgv / local.ai

🎒 local.ai - Run AI locally on your PC!
https://localai.app
GNU General Public License v3.0
619 stars 54 forks source link

Type drop down - does it work? #66

Closed step21 closed 1 year ago

step21 commented 1 year ago

I noticed that the models show the type, but that this actually is a dropdown. I was expecting this to be a field, like tokenizer. Are there actually instances where it is possible to change the type there?

louisgv commented 1 year ago

@step21 the types are deterministic atm since the backend only support those model type. If you would like to add additional type, the steps are:

  1. Add that model into the backend (either as a top-up implementation/trait of local.ai backend OR as a PR to the llm rust crate
  2. Add that model as an enum: https://github.com/louisgv/local.ai/blob/main/models/_shared.ts#L1-L8
  3. Add a known model with that type