Unable to load hugging face's CT2 model

occ-ai / obs-polyglot

Realtime local AI translation services for OBS based on CTranslate2

https://obsproject.com/forum/resources/polyglot-real-time-local-translation-ai-service-for-obs.1818/

GNU General Public License v2.0

46 stars 5 forks source link

Unable to load hugging face's CT2 model #6

Open lil-sussy opened 5 months ago

lil-sussy commented 5 months ago

I have tried every single Hugging Face CTranslate 2 models under 6GB and I always get the same error : "Failed to load CT2 model. This model cannot be used as a sequence to sequence model.". Once I even got "someexception.json needs to be defined" or smth. Please help.

royshil commented 4 months ago

@lil-sussy i'vw now implemented a simple method for loading models which doesnt require you to have files. it will download everything it needs and set it up automatically