Delay-Xili / SDNet

An official codebase of paper "Revisiting Sparse Convolutional Model for Visual Recognition"
MIT License
123 stars 6 forks source link

Question on step parameter $t$ #2

Closed Alienge closed 1 year ago

Alienge commented 1 year ago

Recently, I tried to reimplement the code referring to this excellent work. But some confusion has troubled me. In your paper, $A$ denote convolution operation. For example, let $A$ $\in$ $R^{3\times 64 \times 7 \times 7}$. In calculating $t$ , you mentioned that the dominant eigenvalue is related to $t$. But referring to $A$, $A^{T}A$ $\in$ $R^{3\times64\times7\times7}$, the result of dominant eigenvalue $\lambda \in R^{3\times64} $. Therefore $t\in R^{3\times64}$. But in Appendices A, the $tA^{*}(x-A(y^{l}))$ in FISTA iteration has encountered the dimension error. $$z^{L} = T_{\lambda t}{y^{l}+tA^{*}(x-A(y^{l}))}$$ I am looking forward to your reply. Thx.

LEFTazs commented 1 year ago

I think that the dominant eigenvalue must be a scalar, so t should also be a scalar, that's why you got a dimension error.

Alienge commented 1 year ago

I think that the dominant eigenvalue must be a scalar, so t should also be a scalar, that's why you got a dimension error.

Yep. I think that should also be a scalar. But referring to power iteration to get the dominant eigenvalue, it carries out the following calculation to estimate the dominant eigenvector. $$v^{k+1} = A^{T}(A(v^{k}))$$ The multi-dimensional kernel $A$ can be viewed as the number of $3 \times 64$ kernel($7\times7$). Therefore, $A^{T}A \in R^{3\times64\times7\times7}$. Or another option, the multi-dimensional kernel $A$ can be viewed as the number of $64$ kernel($3\times7\times7$). $A^{T}A \in R^{64\times64\times7\times7}$. Getting the dominant eigenvalue from above is a vector. Or $A^{T}A \in R^{64\times64}$ get a scalar value. That is a good option to get a dominant eigenvalue? I confused. So how about your views

liuyiming199721 commented 1 year ago

我认为主导特征值必须是标量,所以 t 也应该是标量,这就是为什么你有尺寸错误。

老哥,这个人是老外吧?方便交个朋友创个群嘛?

Alienge commented 1 year ago

我认为主导特征值必须是标量,所以 t 也应该是标量,这就是为什么你有尺寸错误。

老哥,这个人是老外吧?方便交个朋友创个群嘛? yep, LEFTazs should not be Chinese. I release my code version referring to the paper. Any advice for it? The link is CODE

liuyiming199721 commented 1 year ago

我认为主导特征值必须是标量,所以 t 也应该是标量,这就是为什么你有尺寸错误。

老哥,这个人是老外吧?方便交个朋友创个群嘛? yep, LEFTazs should not be Chinese. I release my code version referring to the paper. Any advice for it? The link is CODE

我怎么才能联系到您们?可以互相交换SDNet代码,留个facebook或者微信或者line或者电报或者其他的联系方式,我会想办法加你们的。谢谢

liuyiming199721 commented 1 year ago

How can I get in touch with you? You can exchange SDNet codes with each other, leave a facebook or wechat or line or telegram or other contact information, I will find a way to add you. thank you

liuyiming199721 commented 1 year ago

How can I get in touch with you? You can exchange SDNet codes with each other, leave a facebook or wechat or line or telegram or other contact information, I will find a way to add you. thank you

liuyiming199721 commented 1 year ago

I think that the dominant eigenvalue must be a scalar, so t should also be a scalar, that's why you got a dimension error.

How can I get in touch with you? You can exchange SDNet codes with each other, leave a facebook or wechat or line or telegram or other contact information, I will find a way to add you. thank you

Alienge commented 1 year ago

I think that the dominant eigenvalue must be a scalar, so t should also be a scalar, that's why you got a dimension error.

How can I get in touch with you? You can exchange SDNet codes with each other, leave a facebook or wechat or line or telegram or other contact information, I will find a way to add you. thank you

The code is in a work-in-progress. so it's not available for large-scale discussions right now. I will continue to improve the code. If I have an opportunity to get perfect implementation, I will raise a new issue to get more people see it. Currently, I think it is a good idea to communicate with the Github Issue. If you insist to communicate with me, I think the mail is a good choice. EMAIL: zhichaowu543@G.mail.com. [Delete dot]

Alienge commented 1 year ago

I think the related paper has the interpretation $A$. So the $t$ is solved. This issue will be closed soon.