-
Hello, I get the error in the title when finetuning Phi3.5.
I believe I'm on the latest unsloth (installed from git wit pip).
Context: finetuning Phi3.5 with code that already works with other u…
beniz updated
2 months ago
-
Gemma2 is incredible model. With AQLM, it will fit into 12GB GPU.
-
I had to create a screenshot because it's not selectable text and I can't copy&paste it.
It was running f…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubunt…
-
Hello, thanks for this great work!
When I am doing inference using the model, I can succeed for only one inference.
Then I would run into this error. Not sure if there is any fix on this?
Thanks!
…
-
Hello,
I had error then exec simple test with Gemma on keras_nlp: Input dims must be =1
tensorflow lib 2.17.0 (try 2.16.0)
python 3.11
script:
import os
os.environ["KAGGLE_USERNAME"] = ""
os.…
-
这是看了这视频得来的技巧，安装了ollama，希望作者把ollama的支持加下？
[Ollama+Gemma2:9b本地开源大模型输出OpenAI兼容API作为本地翻译引擎工作流](https://www.bilibili.com/video/BV1paxYeHEEF/?vd_source=7351bb1ce0a307c41b60b64ca036a240#reply243857593457)
…
-
when expanding the number of query heads for GQA architecture, it needs to clone vectors interleaving way not just repeating.
-
### Describe the issue as clearly as possible:
I wrote this as a query on Discord, but I now have it operating as a bug so have made this.
When running the [multiple choices](https://outlines-dev.…
-
I'm trying to get gemma to identify images. I have tried serval ways to load in the image and its not seeing it.
Model is: gemma2:27b
I have also tried with jyan1/paligemma-mix-224
```
im…