young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Apache License 2.0
2.38k stars 254 forks source link

is it hard to support BLOOM? #44

Closed tiendung closed 1 year ago

young-geng commented 1 year ago

I imagine that it would not be too difficult to add it, but given its big size and now that there are many smaller models outperforming it, I don't think adding BLOOM will be on our priority list soon.