PiLab-CAU / ComputerVision-2401

Computer Vision Course 2024-01
Apache License 2.0
9 stars 3 forks source link

[Lecture13][0619] About the role of reg layer in RPN #66

Open choigiheon opened 1 week ago

choigiheon commented 1 week ago
image

I understand the role of the cls layer, but I don't understand the role of the reg layer. Since the anchor boxes predefined, isn't it enough to just determine whether object exists or not? If it is determined that an object exists, the RPN does give the corresponding region proposal. Otherwise it doesn't.

Does the reg layer adjust the values of the anchor boxes to more accurate region proposals, like R-CNN? If so, wouldn't this be redundant since the following Fast R-CNN also performs the same operation afterwards?

Thank you.

yjyoo3312 commented 6 days ago

@choigiheon Thank you for the comment!

Yes, as you assumed, the regression layer predicts more accurate box proposals through bounding box regression. Although it may seem redundant, training a region proposal network without bounding box regression is challenging because anchor boxes alone cannot adequately capture the object region.

Have a nice vacation!