Lightning-AI / lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
Apache License 2.0
1.07k stars 60 forks source link

[inplace][distributed] support `torch.distributed` common ops with `async_op=False` #624

Open crcrpar opened 1 week ago