axolotl-ai-cloud / axolotl

Go ahead and axolotl questions
https://axolotl-ai-cloud.github.io/axolotl/
Apache License 2.0
7.46k stars 803 forks source link

Gemma2 Support #1719

Closed hammoudhasan closed 2 months ago

hammoudhasan commented 2 months ago

⚠️ Please check that this feature request hasn't been suggested before.

🔖 Feature description

With the release of Google's new models Gemma2 9B and Gemma2 27B, it would be very useful to have those models incorporate to the training framework of Axolotl.

✔️ Solution

Integrate the new model by providing configuration scripts and incorporating the Gemma2 template.

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

hammoudhasan commented 2 months ago

Seems to be implemented now.