search

KindXiaoming / pykan

Kolmogorov Arnold Networks
MIT License
14.73k stars 1.35k forks source link

KAN for Vision Transformer #191

Closed chenziwenhaoshuai closed 2 months ago

chenziwenhaoshuai commented 4 months ago

We are trying to use KAN on ViT to replace MLP for training on ImageNet, and we welcome co-builds! Vision-KAN

hk-zh commented 4 months ago

Interesting idea! I've come up with a title for you. Kansformer: What KAN I say?

hbwzj commented 4 months ago

效果咋样

jloveric commented 4 months ago

Probably TransformerKan

chenziwenhaoshuai commented 4 months ago

We are training on ImageNet1k, you can follow my github Vision KAN repo to see the progress, and I'd appreciate it if you could give me a star!