ctranslate2 now has more quants, can we please add?!

michaelfeil / hf-hub-ctranslate2

Connecting Transformers on HuggingFace Hub with CTranslate2

https://michaelfeil.github.io/hf-hub-ctranslate2/

MIT License

36 stars 2 forks source link

ctranslate2 now has more quants, can we please add?! #20

Open BBC-Esq opened 1 year ago

BBC-Esq commented 1 year ago

Can you please add support for the following quantizations that ctranslate2 added:

int8_float32 int8_bfloat16 float32 bfloat16

BBC-Esq commented 1 year ago

Does anyone respond? Can Hf-hub incorporate additional quantizations? This would make the library even more awesome!

michaelfeil commented 1 year ago

How are they not support right now?

BBC-Esq commented 1 year ago

I will have to double check since it's been over a month since I sent that message. Honestly, I've been moving on to other things. But, I will double check and close this issue out in the next three days.