ju-ki
commented
2 years ago - lightly (projection_mlp): SimSiamProjectionHead( (layers): Sequential( (0): Linear(in_features=512, out_features=512, bias=True) (1): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True) (2): ReLU() (3): Linear(in_features=512, out_features=512, bias=True) (4): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True) (5): ReLU() (6): Linear(in_features=512, out_features=512, bias=True) (7): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True) ) ) (prediction_mlp): SimSiamPredictionHead( (layers): Sequential( (0): Linear(in_features=512, out_features=128, bias=True) (1): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True) (2): ReLU() (3): Linear(in_features=128, out_features=512, bias=True) ) ) )