-
./local-ai --models-path models/ --context-size 4000 --threads 4
9:09PM DBG no galleries to load
9:09PM INF Starting LocalAI using 4 threads, with models path: models/
9:09PM INF LocalAI version: v…
-
### Anything you want to discuss about vllm.
I run into the below error when using meta-llama/CodeLlama-7b-Instruct-hf with `vllm==0.4.0, torch==2.1.2`, the code works perfectly with` vllm==0.2.1`, b…
-
Hello, I am a student in Korea working on a 6 week project.
I want to fine-tune a CodeLlama model using your paper's methodology for the Code Repair task. How do you estimate the GPU resources and …
-
### Is your feature request related to a problem? Please describe.
Hello!
The issue is related to the use of `Together AI` models, such as `CodeLlama-34b` and `Llama-3-70b-chat-hf`.
Despite that …
-
Hello,
Tensor assertion error is raised if you try to train the model. It starts with the following:
```bash
0%| | 0/10 [00:00
-
你好,除了tabnine、codeium、copilot之外,目前还有deepseek-coder、codellama、qwen2.5-coder、sqlcoder、codegeex4、codegemma可以通过ollama以及各种OpenAI-API-compatible风格的平台部署。能否提供基于OpenAI-API-compatible或者Ollama的自动化补全呢?
现在找到相关的插…
-
**I am using wsl 2 with ubuntu-22.04, this is the gpu information**
![image](https://github.com/facebookresearch/codellama/assets/1501241/fd964023-2df8-43ae-8d7e-96f7fc359f7d)
**when i run "sudo …
fhlkm updated
8 months ago
-
Model CodeLlama-7b found in /Users/zhangyixin/models.
Model Mistral-7b found in /Users/zhangyixin/models.
Model CodeLlama-34b not found in /Users/zhangyixin/models. Would you like to download it? (y…
-
请问每一列分别代表什么?我看到写的overall是0.789但是首页标注着一列是median
CodeLlama-13b-Instruct-hf_lora 0.789 sft train by our this project,only used spider train dataset, the same eval way in this project with lora SFT. The …
-
Hi! I am trying to use the tool but somehow the code completion is not working. The chat functionality works just fine so I am quite sure I configured the connectors properly. Unfortunately, I couldn…