-
Does it work, if I train Gemma 2 with my dataset, push it to Hugging Face and then download the GGUF-file to import it into Ollama?
-
Gemma2 has released. Is it supported ?
-
### System Info
This is the current version installed from github, text-generation-launcher 2.1.1-dev0
### Information
- [ ] Docker
- [X] The CLI directly
### Tasks
- [X] An official…
-
**The bug**
When using the Phi3.5 mini, eval and text generation takes several times longer than with Gemma2 2B It, even though they are similarly small models.
On top of that, I am experiencing Use…
-
设备:intel n97
内存:8gb
ipex-llm版本:0811
现象:能够正常加载并运行gemma:2b,但是提问没有回答,也没有报错信息。
如果是使用qwen2:1.5b是能够正常回答的。
![99dd79b9f5f5e8d2df0d5543cf29965](https://github.com/user-attachments/assets/47504fb7-2a73-470…
-
Hi
I can run Llama3, Qwen or other models on Ollama with ipex-llm. However, I cannot run Gemm2 on Ollama with ipex-llm. It shows unknown model architecture: 'gemma2'. Does it mean this model is no…
-
### Background & Description
I think the backend should be updated to support for gemma2.
### API & Usage
_No response_
### How to implement
Update the backend.
-
**Describe the bug**
When evaluating a RAG I am getting an error that my tests for context-faithfullness, context-relevance must a question va:
```
[FAIL] Error: Invariant failed: context-faithfu…
-
### Issue description
There is an error when generating response, which looks like Vulkan related issue. But ollama run the same model , which works well, Thanks for your time! Best Regarded!
### Ex…
-
### Description
When using LLM openai interface directly, everything else is available except for chat of GRAPHRAG Collection , which is not available.
there is the error:
/home/master/.local/lib/p…