search

chenziwenhaoshuai / Vision-KAN

KAN for Vision Transformer
MIT License
145 stars 6 forks source link

Lion optimizer #11

Open jloveric opened 1 month ago

jloveric commented 1 month ago

Try with the lion optimizer. I've found these much better for piecewise polynomial networks, then again, maybe it won't be a huge benefit in convolutional models...

chenziwenhaoshuai commented 1 month ago

I'll try it later，thank you！