search

TabbyML / tabby

Self-hosted AI coding assistant
https://tabby.tabbyml.com/
Other
18.28k stars 771 forks source link

feature request: allow specifying custom model source #2421

Closed Kamilcuk closed 2 weeks ago

Kamilcuk commented 2 weeks ago

Please describe the feature you want

Currently I believe tabby hardcodes location of models at https://github.com/TabbyML/registry-tabby/blob/main/models.json .

Additional context

I would want to download models from https://hf-mirror.com/ because huggingface is blocked, would be great if I could specify it.

Thanks for makin tabby, it's great!

Please reply with a 👍 if you want this feature.

wsxiaoys commented 2 weeks ago

Hi - registry can be customized by forking it and being specified as your_github_username/model_name

See https://tabby.tabbyml.com/docs/faq/ "How can I convert my own model for use with Tabby?"

Users are free to fork the repository to create their own registry. If a user's registry is located at https://github.com/USERNAME/registry-tabby, the model ID will be USERNAME/model.

Kamilcuk commented 2 weeks ago

For others: it looks like you can specify the repository and url to models.json at https://github.com/TabbyML/tabby/blob/4c59530d62048575dc60632555879bff7342aeaa/crates/tabby-common/src/registry.rs#L28 .