search

etrommer / torch-approx

GPU-accelerated Neural Network layers using Approximate Multiplications for PyTorch
https://etrommer.de/torch-approx
MIT License
7 stars 3 forks source link

Refactor ApproxConv2d operator into torch.autograd.Function #8

Closed etrommer closed 2 years ago

etrommer commented 2 years ago

ApproxConv2d operator is currently composed from several separate Autograd Functions. Refactoring those into a single one will likely reduce problems with excessive memory consumption due to smaller number of tensors that need to be tracked