Lightning-AI / lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
Apache License 2.0
1.15k stars 77 forks source link

Transform writer's guide #1202

Open t-vi opened 5 days ago

t-vi commented 5 days ago

Having written a few "new-style" transforms between a few people, we might compile a guide:

(feel free to add)

cc @borda @apaz-cli @riccardofelluga

t-vi commented 18 hours ago

use of scopes (see also https://github.com/Lightning-AI/lightning-thunder/issues/935 )