search

jankrepl / mildlyoverfitted

Paper implementations from scratch and machine learning tutorials
MIT License
340 stars 124 forks source link

Training guide #9

Open Tursunali-Kholdorov opened 2 years ago

Tursunali-Kholdorov commented 2 years ago

Please provide traing guide too. Any other sources about this are also welcome!

jankrepl commented 2 years ago

Please provide traing guide too. Any other sources about this are also welcome!

Hey @Tursunali-Kholdorov ! Thank you for your interest!

What video are you referring to specifically?

Tursunali-Kholdorov commented 2 years ago

Hello @jankrepl . GPT in PyTorch

jankrepl commented 2 years ago

Hello @jankrepl . GPT in PyTorch

Unfortunately, the video is only about the "inference". However, if you want to train your GPT just use https://huggingface.co/docs/transformers/index or https://github.com/karpathy/minGPT.

AndyKHT commented 2 years ago

Please provide training guide for Vision_transformer, the "Cat" example.

jankrepl commented 10 months ago

Please provide training guide for Vision_transformer, the "Cat" example.

The Vision transformer video is only about inference too.