cyan2k molmo-7b-bnb-4bit issues - Githubissues

cyan2k / molmo-7b-bnb-4bit

4bit bitsandbytes quants of the best 7B vlms

Apache License 2.0

20 stars 3 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

problem with image normalization

#6 zoldaten opened 1 month ago
2
ValueError: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model.

#5 zoldaten opened 1 month ago
1
learning resources to quantize hugging face model?

#4 wbste opened 1 month ago
0
Assertion `-sizes[i] <= index && index < sizes[i] && "index out of bounds"` failed

#3 maxruby opened 1 month ago
4
Error with attention mask

#2 Julianvaldesv closed 1 month ago
2
modified inference script and custom preprocessing script

#1 BBC-Esq closed 1 month ago
3