SolidRusT srt-model-quantizing issues - Githubissues

SolidRusT / srt-model-quantizing

Collection of scripts for quantizing data models

MIT License

0 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Llama 3.1 Quantization - Expected all tensors to be on the same device

#3 vackosar closed 1 month ago
1
Quantizing MAmmoTH2-8B-Plus

#2 vackosar closed 1 month ago
4
parameterize AWQ pipeline

#1 OB-SPrince closed 5 months ago
0