maxvanspengler / hyperbolic_learning_library

An extension of the PyTorch library containing various tools for performing deep learning in hyperbolic space.
MIT License
137 stars 9 forks source link

Tutorial on Hyperbolic Vision Transformers #38

Closed diegogcerdas closed 1 month ago

diegogcerdas commented 1 year ago

Hello,

I would like to contribute to a tutorial on Hyperbolic Vision Transformers by Ermolov, A. et al (2022).

The paper describes a vision transformer with output embeddings mapped to the Poincare ball and optimized with a modified pairwise cross-entropy loss. It is peer-reviewed and accepted at CVPR 2022.

Thank you!

maxvanspengler commented 1 year ago

That would be great @diegogcerdas! Thank you for contributing and please let us know if there is anything you could use some help with.

maxvanspengler commented 1 year ago

Whoops, accidently hit close instead of comment. My bad!