HazyResearch / safari

Convolutions for Sequence Modeling
Apache License 2.0
848 stars 70 forks source link

What is the suggested way to implement an autograd version of nn.functional.conv1d? #24

Open penguinshin opened 1 year ago

penguinshin commented 1 year ago

Suppose I want to use fftconv_fwd to implement nn.functional.conv1d - how would I go about doing this? Is there already a function in safari that operates on pytorch tensors and computes a differentiable version of both the convolution as well as the concatenation of the filters? In particular, I'm looking for > 100K kernel size