search

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
https://arxiv.org/abs/2202.06709
Apache License 2.0
798 stars 77 forks source link

Can I get a guideline for hessian eigenvalue visualization? #42

Closed gihyunkim closed 5 months ago

gihyunkim commented 5 months ago

Hi, I am Ph.D/M.S. integrated student at Yonsei University. I am very interested in your research and I am looking into your code. However, I couldn't find the code about hessian eigenvalue and recognized that you don't share it right now.

It would be very pleasure if you give me the code or guideline to write about hessian eigenvalue visualization.

my email: kkh9314@yonsei.ac.kr

Thank you.

xxxnell commented 5 months ago

Hi @gihyunkim,

Thank you for reaching out. I've just sent the pseudocode for implementing the Hessian eigenvalue spectrum. Alternatively, you can also check out Issue #12.