-
Environment:
- On a fresh install of Ollama + ollamac, using Gemma 2 9b
- macOS: 14.6.1 (23G93)
- M1 Pro, 32GB
Scenario 1 Steps:
- Start Ollama
- Open Ollamac (fresh install)
- Pick any mo…
-
I have looked around for a script that could convert MaxText Gemma and Gemma 2 checkpoints to Hugging Face format but i have not find anything related. This may related to https://github.com/google/ma…
-
Currently our configs have:
```
output_dir: /tmp/alpaca-gemma-finetune
checkpointer:
checkpoint_dir: /tmp/gemma-2b/
output_dir: /tmp/gemma-2b
metric_logger:
log_dir: ${output_dir}
…
-
### Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
None
### OS Platform and Distribution
Android 14
### MediaPipe Tasks SDK version
0.10.1…
-
https://huggingface.co/google/recurrentgemma-2b-it
Support for recurrent gemma
-
I tried to run this with Gemma 2 27b it and found that it doesn't quite work. I verified that everything works with qwen/qwen-1_8b-chat.
I get this error message:
```Assertion error: All scores…
-
Achieving Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, vLLM)
https://lmsys.org/blog/2024-07-25-sglang-llama3/
gemma 2 update
https://huggingface.co/google/gemma-2-2b
…
-
Whenever I try to load it, it crashes Chrome.
This is on a Pixel 6a with 6Gb of RAM.
- Context is set to 1K.
- 16 bit WebGPU is available.
- Using latest version of WebLLM from CDN.
To make…
-
Can any colleague help with the example of interference with the Gemma model in CTranslate2? Unfortunately, there is no information about this model in the documentation.
Thx
-
When I run
```
docker run -t --rm \
--gpus all \
-v ${CKPT_PATH}:/tmp/ckpt \
${DOCKER_URI} \
python scripts/run.py \
--device=cuda \
--ckpt=/tmp/ckpt \
--variant="…