-
I'm seeing this most of the time now. I'v deleted all the old sessions , created an empty session and added one .org file. Also created a directory collection. I'm using the recommended model for Oll…
-
If I create a gguff from unsloth, if I then try loading it with llama.cpp it errors on : llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.ffn_norm.weight' not found
Does this…
-
### 📦 Environment
Vercel
### 📌 Version
1.14.3
### 💻 Operating System
Windows
### 🌐 Browser
Chrome
### 🐛 Bug Description
The Auto Generate isn't using the correct language to…
-
### What is the issue?
I'm trying to run models on my internal Intel GPU.
Here's the software env:
1. activate a virtual env in Anaconda
2. already installed ipex-llm[cpp], ipex-llm[xpu]
3. sta…
-
we need to expose an GRPC endpoint for DataAI service . It is one of the ways that other microservice can communicate with DataAI service .
-
### Issue description
There is an error when generating response, which looks like Vulkan related issue. But ollama run the same model , which works well, Thanks for your time! Best Regarded!
### Ex…
-
Trying out a few ollama models. But they fail with
`Model "ollama/qwen2" does not support tools, but some tools were supplied to generate(). Please call generate() without tools if you would like …
-
I encountered the following problem while running a local search from Google Colab:
command:
```console
python -m graphrag.query --root ./ragtest --method local \
"What are the differences betwe…
-
### What is the issue?
I'm testing for the multiple requests that can be handled in my system.
For Gemma2, when executing a single request, the respond is perfect.
But for multiple requests, the r…
-
**Describe the bug**
I am getting this error to convert the model 'Gemma2' with SFT trainer to pytorch after training , Lm.head weights are missing
![image](https://github.com/user-attachments/asset…