Update nvFuser repro script logic - Githubissues

Lightning-AI / lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

Apache License 2.0

1.16k stars 77 forks source link

Update nvFuser repro script logic #1015

Closed riccardofelluga closed 1 week ago

riccardofelluga commented 1 month ago

🐛 Bug

New changes are about to be introduced in nvFuser that will break the repro script generation.

The PR is #2831 and it will require changing this function here https://github.com/Lightning-AI/lightning-thunder/blob/c92e8a895d3f5e1df3b3731e08171d66ab13634f/thunder/examine/__init__.py#L247

and possibly the fusion definition wrapper here: https://github.com/Lightning-AI/lightning-thunder/blob/c92e8a895d3f5e1df3b3731e08171d66ab13634f/thunder/executors/nvfuserex_impl.py#L402

cc @carmocca @apaz-cli

riccardofelluga commented 1 week ago

Closed by #1231