Is there a reason for not using 4 ReLUs in the bottleNeckPSP class? In utils.py#614, you are using self.cb3 = conv2DBatchNorm instead of another conv2DBatchNormRelu?:
--> three ReLUs + another ReLU for bottleNeckPSP
--> three ReLUs + an identity for bottleNeckIdentifyPSP):
Am I right that you are computing the ReLU for the third conv plus for the identity together; so you first add them and then do the ReLU operation utils.py#630
Is there a reason for not using 4 ReLUs in the bottleNeckPSP class? In utils.py#614, you are using
self.cb3 = conv2DBatchNorminstead of anotherconv2DBatchNormRelu?: --> three ReLUs + another ReLU for bottleNeckPSP--> three ReLUs + an identity for bottleNeckIdentifyPSP):
Am I right that you are computing the ReLU for the third conv plus for the identity together; so you first add them and then do the ReLU operation utils.py#630
Are you saving one ReLU operation in that way?