search

google-gemini / gemma-cookbook

A collection of guides and examples for the Gemma open models from Google.
https://ai.google.dev/gemma/
Apache License 2.0
668 stars 123 forks source link

Continued pretraining of Gemma models #46

Closed amankumarhal closed 2 months ago

amankumarhal commented 2 months ago

Description of the feature request:

Hi, I have domain-specific dataset, and I was wondering if there could be a codebase for additional/continued pretraining of gemma-2 models.

What problem are you trying to solve with this feature?

Making generative models adapt to domain-specific data.

Any other information you'd like to share?

No response

windmaple commented 2 months ago

That'd be great! Please follow the steps and send PR.