-
Very interesting new open source model just dropped, called JetMoE. It looks like the current SOTA as far as compute efficiency goes.
It has a very interesting model architecture:
> **Model Deta…
-
Thank a lot for your great work!
I deployed gemma-2b locally. I would like to understand how to have multiple rounds of dialog effectively.
I searched the internet and found that I could type in p…
-
- Start LLM
- Close laptop
- Sleep 8 hours
- Open laptop
- Issue command to LLM
-
Collecting pygemma==0.1.3
Using cached pygemma-0.1.3.tar.gz (4.0 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml)…
-
`llm_inference` on local is throwing the below error for `gemma-2b-it-cpu-int8.bin` only `gpu` backend type is supported?
```
calculator_graph.cc:892] INVALID_ARGUMENT: CalculatorGraph::Run() fail…
-
After deplyed google/gemma-7b-it, there always is error response when sending any message.
Response:
`Of course! Here are some creative ideas for a 10-year-old's birthday party:`
-
I found that the current version of LongLM can not load Gemma 1 or Gemma 2 model successfully. I wrote a minimum test to help reproduce the issue:
```python
# transfromers version 4.38.2
# this exa…
-
Will there be MPS support for the Gemma models? It would enable access to a larger community.
-
I'm having an issue with Gemma model. I used swift playground. Here is sample code to reproduce below error:
```
import UIKit
import Tokenizers
func testTokenizer() async throws -> Tokenizer…
-
Some models (eg. [Google's Gemma family](https://huggingface.co/google/gemma-2b)) require authorisation before use. This authorisation is free, immediate, and automatic, but must be done for each user…