search

cilix-ai / kernel-transformer

A vision transformer model based on sliding kernel self attention mechanism. Swin Transformer's evil twin.
MIT License
0 stars 0 forks source link

More details #1

Open Zhiwu6 opened 2 months ago

Zhiwu6 commented 2 months ago

I would like to know more details about this kernel-Transformer. Has there been a paper published on this?

yuelinxin commented 2 months ago

No, this is recurrently just a rough idea, it works very similarly as Swin Transformer, but with some added details in representation and flexibility of architecture.