search

google / gemma_pytorch

The official PyTorch implementation of Google's Gemma models
https://ai.google.dev/gemma
Apache License 2.0
5.26k stars 503 forks source link

How to fine-tune Gemma with pytorch? #38

Closed solitude-alive closed 7 months ago

solitude-alive commented 7 months ago

How to fine-tune Gemma with pytorch? There seems to be fine-tuning code on Huggingface, but it cannot be used directly.

Thanks

suryabhupa commented 7 months ago

I'm not aware of the best tools for finetuning with pytorch right now, perhaps @pengchongjin has seen some good colabs or tools around?

pengchongjin commented 7 months ago

This is a duplicated issue of https://github.com/google/gemma_pytorch/issues/8.

Close this one.