search

ggerganov / ggml

Tensor library for machine learning
MIT License
10.3k stars 947 forks source link

NLLB-200 support #137

Open kaspar030 opened 1 year ago

kaspar030 commented 1 year ago

It would be great to have ggml support for Facebook's No Language Left Behind 200x200 translation model:

https://ai.facebook.com/research/no-language-left-behind/

https://huggingface.co/facebook/nllb-200-3.3B

zhangp365 commented 8 months ago

NLLB-200 is a great model. It would be wonderful if GGML could support this model.

bil-ash commented 8 months ago

Yes, I would also like to use ggml for inferencing nllb models. @ggerganov Is conversion/inference possible as of today? If not any ETA?

ggerganov commented 8 months ago

Try looking for community help in llama.cpp - we've already implemented several architectures there