search

GAIR-NLP / anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
https://huggingface.co/spaces/ethanchern/Anole
618 stars 33 forks source link

feature: quantization added #21

Open dhruv1710 opened 1 month ago

dhruv1710 commented 1 month ago

Dynamic quantization added to the Linear and LSTM layers, converted to 8bit.

JoyBoy-Su commented 1 month ago

Thanks for your contribution! Maybe we can add a -q option to choose whether or not quantize the model.

dhruv1710 commented 1 month ago

That's a good feature, I'll add that

CoffeeShifter commented 1 week ago

You never did

That's a good feature, I'll add that