search

AI-Hypercomputer / maxtext

A simple, performant and scalable Jax LLM!
Apache License 2.0
1.47k stars 275 forks source link

script to convert llama, mistral, mixtral checkpoints to huggingface format #837

Closed jwyang-google closed 1 week ago

jwyang-google commented 1 week ago

We should add nightly e2e tests for this as well, especially since we have been prone to change our maxtext checkpoint format so this may become out of date without tests

Makes sense. I will take a look at how to add the test soon

jwyang-google commented 1 week ago

I messed up the commits. I will close this and open a new PR on this.