-
I am using the image `nvcr.io/nvidia/tritonserver:24.10-py3-sdk`. I am using the following command:
```
genai-perf profile -m starcoder --url http://vllm-starcoder2-7b:8080 --service-kind openai --e…
-
Is StarCoder-15b an instruct model itself? If not, how does it is utilized in concept, instruction, and response generation?
-
Hi I'm trying to use WhiteFox on LLVM optimizations.
Please correct me if I'm wrong, I don't seem to see the code that _executes LLVM and refines prompts using its feedback_? Can you provide some i…
-
### System Info
model: [bigcode/starcoderbase-3b](https://huggingface.co/bigcode/starcoderbase-3b)
Python 3.10.12
CUDA Version: 12.2
tensorrt_llm version: 0.8.0.dev2024011601
basic image: nvcr.…
-
hey您好，看到你在huggingface上做的 starcoder3b-instruct模型，试了下符合预期，想了解下您这边finetune的过程，可否分享下
-
### Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
### Describe the bug and reproduction steps
When I create a local LLM service with llama.cpp, I have verif…
-
I'm a big fan of the fauxpilot project, and would love to see fauxpilot integrated with it.
StarCoder: A State-of-the-Art LLM for Code
https://huggingface.co/blog/starcoder
Would be awesome to…
-
the numbers I got for Codellama are different from what I saw in Table 3.
This leads to the need to re-produce the numbers for StarCoder also.
```
Fortran2Cpp/data/StarCoder2/readable_format_…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue]…
-
### System Info
nvidia A100 80G
centos7 x86_64
### Who can help?
@ncomly-nvidia @kaiyux @juney-nvidia
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
…