-
## Overview
## Tasklist
- [ ] Can this be solved via llama.cpp? (e.g. compiled for Vulkan and ROCm)
- [x] https://github.com/janhq/cortex.llamacpp/issues/9
- [ ] [https://github.com/janhq/jan/issues…
-
We should move our test and examples using llama3.1 to llama3.2.
Ollama already supports 1B and 3B versions, while 11B and 90B will be available very soon.
GROQ supports all the models in preview mo…
-
```
Traceback (most recent call last):
File "/Users/xxx/Project/voice-assistant/main.py", line 155, in
llm = LlamaCpp(
^^^^^^^^^
File "/Users/xxx/miniconda/envs/VoiceAI/lib/pyt…
-
I tried running this application in windows and ubuntu but getting the same error.
Can someone suggest whats wrong here?
File "/home/soft/.local/share/virtualenvs/DocQA-YcyGHhWa/lib/python3.9/s…
-
### 🚀 The feature
We want to integrate with Ollama: https://github.com/jmorganca/ollama
Goal is to build an experiment, like the LlamaCpp example: https://github.com/hegelai/prompttools/blob/main/…
-
would this work with oobabooga webui?
-
Hello!
I'm trying to get some answer from CodeGemma 2B gguf, but JVM crashes shortly after start, without producing any model output
GGUF file downloaded from HuggingFace
OS:Windows 10
Code:
…
32kda updated
3 weeks ago
-
### Describe the bug
I tried both the manual install and the one click install for Linux. My OS is a fresh install of Ubuntu 24.04. I've previously used this model on Windows 10 with text-generation-…
-
### Describe the bug
After downloading a model I try to load it but I get this message on the console:
Exception: Cannot import 'llama-cpp-cuda' because 'llama-cpp' is already imported. Switching to…
-
Hello guys, i try to run mpt-7b model , and i am getting this code, i appreciate any help, here is the detail
Node.js v19.5.0
node_modules\llama-node\dist\llm\llama-cpp.cjs:82
this.inst…