MDK8888 GPTFast issues - Githubissues

MDK8888 / GPTFast

Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

Apache License 2.0

662 stars 63 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Update README.md

#29 MDK8888 closed 3 weeks ago
0
GPTQ

#28 MDK8888 closed 3 weeks ago
0
Set requirements to more flexible version

#27 nicolas-dufour opened 2 months ago
1
Help run GPTFast on Mistral-7B-v0.1 (or v.02) for CausalML

#26 Rinocerbul opened 2 months ago
1
Help to run GPTFast on Mixtral-8x7B-Instruct-v0.1

#25 davideuler opened 3 months ago
2
Update README.md

#24 MDK8888 closed 3 months ago
0
Doesn't work on kaggle notebooks - ValueError: Unable to compare versions for numpy>=1.17: need=1.17 found=None. This is unusual. Consider reinstalling numpy.

#23 c1505 opened 3 months ago
0
Model Config settings for Llama-based architectures

#22 jamesoneill12 opened 3 months ago
8
GPTFast 0.2.1: function argmax_variation() is not used

#21 alvatar0404 opened 3 months ago
0
Update README.md

#20 MDK8888 closed 3 months ago
0
minor fixes for pyyaml

#19 MDK8888 closed 3 months ago
0
Update README.md

#18 MDK8888 closed 3 months ago
0
Added Static KV Caching for all Huggingface Models

#17 MDK8888 closed 3 months ago
0
Possible to use with a VL model like LLAVA?

#16 aliencaocao opened 3 months ago
2
ERROR: No matching distribution found for triton==2.1.0

#15 Zephyruss1 closed 3 months ago
2
Help to understand

#14 apirrone opened 4 months ago
6
Update setup.py

#13 eltociear closed 4 months ago
0
Update PyTorch to 2.2

#12 AndreaPi closed 3 months ago
2
Update README.md

#11 MDK8888 closed 4 months ago
0
Update README.md

#10 MDK8888 closed 4 months ago
0
Update README.md

#9 MDK8888 closed 4 months ago
0
added examples

#8 MDK8888 closed 4 months ago
0
Update README.md

#7 MDK8888 closed 4 months ago
0
Update README.md

#6 MDK8888 closed 4 months ago
0
Update README.md

#5 MDK8888 closed 4 months ago
0
Update README.md with documentation

#4 MDK8888 closed 4 months ago
0
Update README.md

#3 MDK8888 closed 4 months ago
0
updated requirements.txt

#2 MDK8888 closed 4 months ago
0
updated requirements.txt

#1 MDK8888 closed 4 months ago
0