Raschka-research-group / coral-cnn

Rank Consistent Ordinal Regression for Neural Networks with Application to Age Estimation
https://www.sciencedirect.com/science/article/pii/S016786552030413X
MIT License
341 stars 62 forks source link

About the monotonicity of the predict layer in the coral network #30

Open Tony-958 opened 3 years ago

Tony-958 commented 3 years ago

Hi, Sorry to bother. I had a problem when understanding the monotonicity of the coral network's predict layer. Here's the only statement I found modifying the bias layer adding to the fc result: self.linear_1_bias = nn.Parameter(torch.zeros(self.num_classes-1).float()) Is it enough to restrict the monotonicity ? Or is there any other statement restricting the monotonicity of the biases?

rasbt commented 3 years ago

I would call it "guaranteeing" monotonicity :). Yeah, it's the bias and the weight sharing together with the loss function. Regarding the changes compared to a regular network, maybe this overview helps? https://github.com/Raschka-research-group/coral-cnn/blob/master/github-images/differences-at-a-glance.pdf

Tony-958 commented 3 years ago

Yeah, that helps. Thank you so much.