search

Blealtan / efficient-kan

An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
MIT License
3.49k stars 306 forks source link

Can MLP replace transformer? #13

Closed taotangSeek closed 1 month ago

taotangSeek commented 1 month ago

Hello author, I would like to know if the efficient implementation of MLP can replace the MLP module in transformer. What are the disadvantages and advantages?

akaashdash commented 1 month ago

https://github.com/akaashdash/kansformers