kaist-cp / cs500

Moved to https://cp-git.kaist.ac.kr/jeehoon.kang/cs500
25 stars 7 forks source link

Indexes systolic array video #68

Closed HaritzPuerto closed 5 years ago

HaritzPuerto commented 5 years ago

Hi, can someone explain to me the indexes in the video of the systolic array?

If we multiply WX we would get something like: y11 = ... y12 = w11x12+w12x22+w13x32 which is clearly different to the video and the resulting matrix would be 2x3 = (2x3)x(3x3) W is 2x3 and X is 3x3 image

I think in the video they are calculating XW^{T} (3x3) x (3x2) = (3x2) matrix like in the video, 3 rows, 2 columns. But I think this is really confusing and misleading

Any ideas? Thank you!

jshuhnow commented 5 years ago

I think you're seeing an old version. It's corrected as WX^T, from WX. #59 For the video, it describes convolution in Neural Networks, not matrix multiplication.

HaritzPuerto commented 5 years ago

Convolution?? Omg I thought they were doing matrix multiplication in the video... I mean, in the lecture notes the video is on top of the Systolic Array algorithm implementation so I thought both do the same thing... Thank you!!

jshuhnow commented 5 years ago

For the record, convolution is WX^T. The computation of both matrix multiplication and convolution are essentially the same. One can just transpose X to use the other function. (i.e. for the purpose of cache row exploitation)

HaritzPuerto commented 5 years ago

anyway, in the video they are doing WX^T and that should return a 2x3, however, they obtain a 3x2, right? W is 2x3 and X^T is 3x3 Thanks

jeehoonkang commented 5 years ago

The video computes (WX^T)^T, but the lecture note computes WX^T.

CauchyComplete commented 5 years ago

@iriszero What do you mean by the convolution is WX^T ? Could you tell me more?

jshuhnow commented 5 years ago

@CauchyComplete I think it's totally off-topic from this class. I meant convolution used in neural networks.

jeehoonkang commented 5 years ago

At this stage of the semester, I'd like to close tech-related issues.