search

wujcan / SGL-TensorFlow

173 stars 42 forks source link

Question about the projection #18

Closed hotchilipowder closed 2 years ago

hotchilipowder commented 2 years ago

Hello, Have you ever tried to add projection (e.g., MLP) like SimCLR? I have add such projections, but it doesn't work. The performance is not good and the convergence is relatively slow. Are there any suggestions for projection function in SGL?

wujcan commented 2 years ago

Hello, Have you ever tried to add projection (e.g., MLP) like SimCLR? I have add such projections, but it doesn't work. The performance is not good and the convergence is relatively slow. Are there any suggestions for projection function in SGL?

We empirically find adding projection will not facilitate the performance. The possible reason is that for CF task, ID is the only feature for each node, but it has no concrete semantics. So performing transformation may not contribute to learning better features.

hotchilipowder commented 2 years ago

Thank you for your reply.