Open Hutai opened 2 years ago
Hey, seems like it's not really needed. Do you mind making a pull request fixing it?
If not, wouldn't the code implementation of Cross Unit look like this?
My bad, the correct way to implement it would be
if (l < self.cross_layer):
cur_d1 += torch.matmul(pre_d2, self.weights_shared[l])
cur_d2 += torch.matmul(pre_d1, self.weights_shared[l])
Do note that this implementations assume that there are more layers after the cross connection layers.
Thanks for pointing out the typo, will have a revamp of this repo in the near future to double check for any mistake
For code: https://github.com/yqchau/Recommender-Systems/blob/main/model/CoNet/model.py#L93-L94 is it necessary to add cur_dx?