search

jean-zay-users / jean-zay-doc

Collaborative documentation for and from Jean Zay users. Official Jean Zay documentation: http://www.idris.fr/eng/jean-zay/
https://jean-zay-doc.readthedocs.io/en/latest/
MIT License
106 stars 34 forks source link

example scripts for LLM #100

Closed cerisara closed 1 month ago

cerisara commented 2 months ago

Recent (2023) scripts for finetuning and inference of LLM on Jean Zay. Recent (2024) scripts for pretraining an LLM on Jean Zay, either with DeepSpeed or Megatron-DS.

lesteve commented 1 month ago

Thanks for the PR! I guess originally the doc was intended to be stand-alone with some examples inside the repo, but I think it's fine to have external links like this one.

Apparently there was a readthedocs issue that I fixed. Can you push a commit into your branch to double-check the rendering of your PR?

lesteve commented 1 month ago

Hmmm maybe you need to merge main into your branch for the build to work properly? I don't know ...

cerisara commented 1 month ago

yes sorry, I forget the pull from upstream ;-) should work now... Thanks !

lesteve commented 1 month ago

OK thanks for the PR (you got number #100 by the way :wink:)! I am going to merge this and probably reorder a bit afterwards, because this part is supposed to be about the content of the doc and there is a section which is more about external links below.