-
I used [llm_inference](https://github.com/googlesamples/mediapipe/tree/main/examples/llm_inference) sample with `gemma-2b-it-cpu-int4.bin` on Pixel 8 Pro emulator.
The prefill speed seems to be in…
-
Training Gemma encountered the following exception, but training Mistral did not.
```
python -m mlx_lm.lora \
--model google/gemma-2b-it \
--train \
--data /Users/danny/mlx_demo/dat…
-
Hello, I have installed ollama on my device and downloaded the Gemma 2b on the device.
I can use it through terminal, but I want to know if I can use it with your app ?
-
Hello. Please add support for Google's open source Gemma AI, which was launched this week.
It has 2 models, 2b and 7b.
Both are great and 2b version can be easily run in both mobile and desktop with…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
### On the Tesla T4 the model "hangs" after loading the model (the vram usage spikes normal…
-
-
### Feature request
I see [llama](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py#L829-L835) will remove tuple past key values in 4.43.
### Moti…
-
Hi,
I'm experiencing issues while running GEMMA2 on Ollama. Specifically, I'm encountering the following problems:
Error on Message Generation:
Whenever a new chat is created, every message…
-
Thanks for a great project!
I might be misunderstanding or missing some limitation that doesn't allow for certain fields to be specified in a standalone config file, but there seem to be many serve…