search

engichang1467 / KAN-Mixer

Source code of KAN-Mixer
2 stars 0 forks source link

Apply Dual PathNorm #5

Open engichang1467 opened 3 months ago

engichang1467 commented 3 months ago

Apply Dual PathNorm on PatchEmbedding to see if there will be significant improvements.

Reference:

engichang1467 commented 3 months ago

Currently, Dual PathNorm implementation isn't compatible with the current code base. It's not the priority now, but we will look into it later.