-
Any possibility to fix this maybe some version of vllm?
(LLMRayActor pid=1005) WARNING 11-15 15:19:28 gemma2.py:351] Some weights are not initialized from checkpoints: {'layers.18.mlp.gate_up_proj.…
-
### Your current environment
The output of `python collect_env.py`
```2024-11-21 16:41:21.863442: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly differ…
-
I would be very grateful for the support of the BGE-Multilingual-Gemma2, an LLM-based multilingual embedding model.
https://huggingface.co/BAAI/bge-multilingual-gemma2
-
### Description of the bug:
hi @pkgoogle ,
i try to use convert_gemm2_to_tflite.py to treansfer model. i can see 2 error when i transfer.
- this one i can change loader.py to solve it.
```
…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
- `llamafactory` version: 0.9.1.dev0
- Platform: Linux-3.10.0-957.el7.x86_64-x86_64-with-glibc2.35
- Py…
-
https://storage.googleapis.com/deepmind-media/gemma/gemma-2-report.pdf
-
Hello Sir and Madam,
Do you plan to add the gemma2:2b example?
This model is very small and smart.
Best regards, Evgeny
-
### What is the issue?
`ollama run gemma2:2b`
pulling manifest
Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/gemma2/manifests/2b": write tcp [2601:19b:0:b8a0:915f:c8c:3de4…
-
### System Info
I tried the following systems, both with the same exception:
- ghcr.io/huggingface/text-generation-inference:sha-6aebf44 locally with docker on nvidia rtx 3600
- ghcr.io/huggingface…
-
@danielhanchen Hi Daniel, thanks for your work!
having an error just like in the issue #275, but this time while trying to save tuned version of unsloth/gemma-2-9b-it-bnb-4bit.
>> model.save_p…