search

young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Apache License 2.0
2.38k stars 254 forks source link

Checksum for recovered models? #21

Closed koreyou closed 1 year ago

koreyou commented 1 year ago

Hello and thank you for setting up an excellent repo! I was wondering if you can provide checksum (say md5sum) for models that was recovered from the original LLaMa weights and the diff file? (I am especially interested in Koala) This way, people can be confident that they have managed to recover a sane model.

Thanks!

young-geng commented 1 year ago

This might be difficult as the floating point value of the recovered checkpoint depend on the specific library version and hardware platform. Although these differences mostly likely will not affect model performance, they can certainly make the checksum value different.