search

google / generative-ai-docs

Documentation for Google's Gen AI site - including the Gemini API and Gemma
https://ai.google.dev
Apache License 2.0
1.46k stars 494 forks source link

Update distributed_tuning.ipynb #437

Closed windmaple closed 1 month ago

windmaple commented 1 month ago

Link to Colab tutorial for Gemma distributed finetuning

Description of the change

Originally Colab didn't work for Gemma dist finetuning. But Colab team figured it out and created a copy of the tutorial that works on Colab TPU.

review-notebook-app[bot] commented 1 month ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

pcoet commented 1 month ago

The linter is complaining about the Colab link. It might be a false positive, but we should update the link to not use the Colab sandbox (colab.sandbox.google.com).

windmaple commented 1 month ago

Fixed

pcoet commented 1 month ago

Thanks. It looks like the notebook on GitHub is not the same one we're opening in Colab, but I'm sure that's for a reason. I'll squash/merge.

windmaple commented 1 month ago

Right. Colab team had to fork it to do some hacking due to its lower version of TPU v2. Kaggle offers TPU v3.