orobix / fwdgrad

Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
MIT License
96 stars 8 forks source link

Feature/update functorch #11

Closed belerico closed 1 year ago

belerico commented 1 year ago

Update functorch version: now installing PyTorch >= 1.13 is enough to have functorch installed. This lets us use standard PyTorch function instead of custom ones, like softmax and cross-entropy