search

TabbyML / tabby

Self-hosted AI coding assistant
https://tabby.tabbyml.com/
Other
21.32k stars 959 forks source link

Failed to fetch model 'TabbyML/DeepseekCoder-6.7B' due to 'Invalid mirror <modelscope.cn> #1136

Open verigle opened 9 months ago

verigle commented 9 months ago

Describe the bug I use mirror of , but when it running , error is that

thread 'main' panicked at /root/workspace/crates/tabby-download/src/lib.rs:74:25:
Failed to fetch model 'TabbyML/DeepseekCoder-6.7B' due to 'Invalid mirror <modelscope.cn> for model urls: ["https://huggingface.co/TheBloke/deepseek-coder-6.7B-base-GGUF/resolve/main/deepseek-coder-6.7b-base.Q8_0.gguf"]'

Information about your version 0.7.0-rc.1

Information about your GPU V100

Additional context I use docker compose to run it 

image: tabbyml/tabby:0.7.0-rc.1
command:  serve --model TabbyML/DeepseekCoder-6.7B  --device cuda
TABBY_DOWNLOAD_HOST: modelscope.cn
wsxiaoys commented 9 months ago

Hi, unfortunately, not all models have mirrored to modelscope.cn, you might refer https://github.com/TabbyML/registry-tabby/blob/main/models.json for details.

verigle commented 9 months ago

thank you for your reply, can i download it manually then put it on a directory？

wsxiaoys commented 9 months ago

Yes - as long as it’s organized in same way described in https://github.com/TabbyML/tabby/blob/main/MODEL_SPEC.md

then you can pass the local directory path to —model