search

rasbt / LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167
Other
32.85k stars 3.95k forks source link

Improve DDP on Windows #376

Closed rasbt closed 1 month ago

rasbt commented 1 month ago

See #375 for details

ngbrown commented 1 month ago

Works great now.