-
I am using Ollama. I successfully installed it but now I am getting this error when I attempt a generation. Any idea where the issue stems from?
![Screenshot 2024-04-08 084507](https://github.com/w…
-
It would be nice to have also:
- [ ] gemini-pro: https://blog.google/technology/ai/google-gemini-ai/
Official SDK: https://github.com/google/generative-ai-python
- [ ] copilot Bing: https://copil…
-
### 🚀 The feature
Support for GPT4ALL.
### Motivation, pitch
Open AI is very much costly when it comes to experimentation and hence it is sometimes better to use open-source LLMs. One way of using…
-
### What is the issue?
I just setup Ollama on a fresh machine and am running into an issue starting Ollama on larger models.
I am running Ubuntu 22.04.4 LTS with 2 Nvidia Tesla P40 GPUs with Drive…
-
### System Info
```
text-generation-launcher --env
2024-04-01T20:49:45.871764Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.75.0
Commit …
spew updated
2 months ago
-
` ollama run deepseek-coder:6.7b-base-q3_K_S`
`Error: llama runner process has terminated`
is worse than expected, I've supposed correct ggml/guff engine/library is bundled to the model in this packa…
Huge updated
4 months ago
-
## Test on _llm-vscode-inference-server_
I use project [llm-vscode-inference-server](https://github.com/wangcx18/llm-vscode-inference-server), which inherits from [vllm](https://github.com/vllm-proje…
-
### Before submitting your bug report
- [ ] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [ ] I'm not able to find an [open issue](ht…
-
When trying to load the server along with codellma model, I got this error
`ERROR: [Errno -2] Name or service not known
`
I simply used this command :
`python3 -m llama_cpp.server --model c…
-
### System Info
pytorch 2.1.0+cu121
4xA4000 GPUs
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### 🐛 Describe the bug
I am trying to run examples/finetuning.py…