search

Blealtan / efficient-kan

An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
MIT License
3.92k stars 349 forks source link

WIP: 2d convolution with KANs #11

Closed kabachuha closed 4 months ago

kabachuha commented 4 months ago

Based on the custom Conv2d python implementation.

WIP points: -> The tensor size matching needs improving for it to be able to work -> Add striding -> Add dilation

Indoxer commented 4 months ago

Doesn't this convolution have the same weights for each input channel?

Indoxer commented 4 months ago

I also created 2d convolution KAN (https://github.com/Indoxer/LKAN), but I used KAN linear layers multiple times, so maybe doing it all in one class will boost performance, I must try

kabachuha commented 4 months ago

@Indoxer great! I will try it out