-
**Describe the bug**
Getting segmentation fault on mac M1
```
~ tabby serve --device metal --model TabbyML/StarCoder-7B
2024-04-06T07:43:21.506323Z INFO tabby::serve: crates/tabby/src/serve.r…
-
**Describe the bug**
StartCoder inference with AutoTP doesn't work.
I get the following error:
```
File "[...]/venv38/lib64/python3.8/site-packages/transformers/models/gpt_bigcode/modeling_gpt_b…
Epliz updated
6 months ago
-
Support for [starcoder](https://github.com/bigcode-project/starcoder/tree/main)
-
它有两种接口`/v1/completions`和`/v1/chat/completions`,前者自定义渠道也不能用,不知道该如何添加渠道?
```
curl --request POST \
--url https://api.fireworks.ai/inference/v1/completions \
-H 'Accept: application/json' \
-H…
-
With StarCoder, I am observing a pass@1 score of 58.9 instead of 43.5 as reported in the OctoCoder paper.
Script used:
```
accelerate launch main.py \
--model $MODEL_DIR \
--tasks humanevalfixd…
-
**Is your feature request related to a problem? Please describe.**
Code models tend to generate long responses, but without token streaming the chat interface ends up feeling unresponsive.
…
-
Hi!
Curious to know some more details about FIM and its effect on the pre-trained model.
Here's a paragraph from the SantaCoder paper:
> FIM for cheap
We observe a minor drop in performance of…
-
starcoder's format for inference in code completion is PSM, + prefix + + suffix +
what's that for starcoder2?
from the paper, we could only see that
![image](https://github.com/bigcode-pro…
-
Is it possible to integrate converter scripts for the GPTBigCodeForCausalLM architecture from the transformers libary?
This would enable integration of models like Starcoder / Santacoder.
With t…
-
Could we pass number of litdata workers for through pretraining for the data preprocessing part?
Or is there a way to pass it using config?
With over 100 files who are 1gb each, the script starts …