KMnP / vpt

❄️🔥 Visual Prompt Tuning [ECCV 2022] https://arxiv.org/abs/2203.12119
Other
1k stars 91 forks source link

value definition for prompts #11

Closed founderlin closed 1 year ago

founderlin commented 2 years ago

https://github.com/KMnP/vpt/blob/94e5be7bddf7a398729c127928a50384b42e95f5/src/models/vit_prompt/vit_mae.py#L34

Hello! The value defined in the line above seems not distinctly elaborated in the paper. Could you explain the reason why you define the value in this way? Many thx in advance.

KMnP commented 2 years ago

Hi, thanks for your question.

That val is used for prompt initialization with xavier_uniform initialization (Appendix A.1)

founderlin commented 1 year ago

I found the Appendix after typing the question. Many thx.