-
**Describe the bug**
I followed the guide in this doc: https://tabby.tabbyml.com/docs/quick-start/installation/apple/
after i installed tabby use brew, and when i run below command:
tabby serve --d…
-
Hi,
I'm trying to reproduce the section "[How do I run it locally?](https://huggingface.co/blog/personal-copilot#how-do-i-run-it-locally)" from this blog post:
[Personal Copilot: Train Your Own …
-
I run the docker compose up command and all was installed correctly.
I entered the ollama docker container and installed llama2 but when I run devika, no LLM is found for ollama.
Should I configure …
suoko updated
2 months ago
-
### System Info
```
docker exec -it text-generation-inference text-generation-launcher --env
```
```
(base) ➜ huggingface-text-generation-inference docker exec -it 401ba897d58aa498e6fffa0e71…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
Similar to [this](https://github.com/abetlen/llama-cpp-python) repository for [llama-cpp](https://github.com/ggerganov/llama.cpp), is anyone aware of efforts to do the same for starcoder-cpp?
More …
-
Currently building StarCoder GPT variant fails if smooth quant applied.
Is it planned to be supported? Any advice on how to build it?
ttim updated
7 months ago
-
First of all, thank you for your work! I used ggml to quantize the starcoder model to 8bit (4bit), but I encountered difficulties when using GPU for inference. If you can provide me with an example, I…
-
Hi, Can you give some advice about how to inference finetuned Starcoder model with this code? Since lora finetune changed some of layers of the model, some of the code in starcoder.cpp should be chang…
-
### sqlcoder
目前sqlcoder在text2sql领域表现不错,在很多数据应用开发中被广泛使用,希望官方可以提供推理支持