Add `TensorProxy.grad` attribute and proxify `Tensor.grad`

Lightning-AI / lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

Apache License 2.0

1.15k stars 77 forks source link

Add `TensorProxy.grad` attribute and proxify `Tensor.grad` #1070

Closed shino16 closed 3 days ago

shino16 commented 1 month ago

Part of #1055. This is necessary to trace Optimizer.step.

shino16 commented 1 week ago

I'm sorry for missing a comment! This is ready for review and approval (hopefully).