search

karpathy / build-nanogpt

Video+code lecture on building nanoGPT from scratch
3.17k stars 410 forks source link

Running codes on Windows issues #45

Open gerardaristizabalpla4 opened 1 month ago

gerardaristizabalpla4 commented 1 month ago

Thanks so much Andrej for making these incredible videos!!!!

Could you please make them google collab friendly? I'm getting RuntimeErrors in the fineweb.py code and compile won't work for Windows because Triton can't be installed in Windows.

Thanks so much!!

dustinwloring1988 commented 3 weeks ago

Use the fineweb.py from this https://github.com/karpathy/build-nanogpt/pull/4

gerardaristizabalpla4 commented 3 weeks ago

Thanks! Yes, I already did that :) Also, scaled_dot_product_attention won't work because Triton can't be installed in Windows.