search

maxvanspengler / hyperbolic_learning_library

An extension of the PyTorch library containing various tools for performing deep learning in hyperbolic space.
MIT License
104 stars 7 forks source link

Tutorial on Hyperbolic Vision Transformers #38

Open diegogcerdas opened 10 months ago

diegogcerdas commented 10 months ago

Hello,

I would like to contribute to a tutorial on Hyperbolic Vision Transformers by Ermolov, A. et al (2022).

The paper describes a vision transformer with output embeddings mapped to the Poincare ball and optimized with a modified pairwise cross-entropy loss. It is peer-reviewed and accepted at CVPR 2022.

Thank you!

maxvanspengler commented 10 months ago

That would be great @diegogcerdas! Thank you for contributing and please let us know if there is anything you could use some help with.

maxvanspengler commented 10 months ago

Whoops, accidently hit close instead of comment. My bad!