mustafaaljadery gemma-2B-10M issues - Githubissues

mustafaaljadery / gemma-2B-10M

Gemma 2B with 10M context length using Infini-attention.

930 stars 57 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

LoRA fine tuning code ?

#12 sandeep-krutrim opened 2 months ago
0
implementation for pytorch gemma InifiniTransformer is copied without attribution

#11 wompwompsquared opened 2 months ago
0
Can you say more on memory usage eg is it useful with 24G?

#9 danbri opened 2 months ago
0
```generate()``` in main.py seems only processes the last 2048 tokens of the input prompt ?

#8 MrYxJ opened 3 months ago
0
Can I limit the context window to say like 100k?

#7 happy15 opened 3 months ago
0
Host a demo on Huggingface Spaces with free A100s (ZeroGPU)

#6 yvrjsharma opened 3 months ago
0
TypeError: GemmaModel.forward() got an unexpected keyword argument 'cache_position'

#5 DewEfresh opened 3 months ago
9
Some Errors...

#4 Aniforka opened 3 months ago
7
How run it?

#3 umaruu02 opened 3 months ago
2
can't install flash_attn

#2 Aniforka closed 3 months ago
5
Update README.md

#1 eltociear closed 3 months ago
0