-
Can I deploy the model locally in a non-Internet environment and use StarCoder via the VS Code plugin? If so, how should I do it?
-
It’s important to avoid ever using claims that are dependent on thousands of variables changing each day, such as, “With a context length of over 8,000 tokens, the StarCoder models can process more in…
-
-
Hot take: it would be easier and better to support a low weight gecko style coding LLM than to deal with general extension support, to then get Intellisense for Web, which is very limited even in gith…
-
There are several projects aiming to make inference on CPU efficient.
The first part is research:
- Which project works better,
- And compatible with Refact license,
- And doesn't bloat the dock…
-
### Your current environment
python3 python -m vllm.entrypoints.api_server --model TheBloke/CodeLlama-7B-Python-AWQ --quantization awq
### How would you like to use vllm
I want to host offline envi…
-
Hello, I have a few questions about OctoCoder.
For this part in the paper:
> For instruction tuning our models, we select 5,000 random samples from COMMITPACKFT across the 6 programming languages…
-
Hello, I'm going to fine-tune on WizardCoder-15B-V1.0 , do I need this code:
```
if "starcoder" in model_args.model_name_or_path:
tokenizer.add_special_tokens(
{
…
iawen updated
11 months ago
-
Hi @loubnabnl and @ArmelRandy
Thank you for your work on StarCoder.
I was interested in fine-tuning the StarCoder LLM for a pythonic library that hasn't been exposed to the Code LLM yet.
I was …
-
Is it possible to integrate [StarCoder](https://github.com/bigcode-project/starcoder) as an [LLM Model](https://python.langchain.com/en/latest/modules/models.html) or an [Agent](https://python.langcha…