search

omoindrot / tensorflow-triplet-loss

Implementation of triplet loss in TensorFlow
https://omoindrot.github.io/triplet-loss
MIT License
1.12k stars 283 forks source link

Loss goes to 0 but embeddings are bad #27

Open FSet89 opened 6 years ago

FSet89 commented 6 years ago

I trained a network with the triplet loss over a small dataset with 6 different identities and about 1000 total images. I noticed that the loss goes to 0 after 100 steps. However, the performances are not good: the embeddings seem just noise. I used a small learning rate (1e-4) and a simple network with 6 convolutions (conv+BN+relu) and 3 pooling. This happens both with batch hard and batch all. What could be the problem?

omoindrot commented 6 years ago

What are you measuring when you say "performance is not good"?

If you are looking at embeddings on a separate test set, it is possible that the model overfits with 6 identities. Maybe you could add regularization or increase the number of identities / images?

FSet89 commented 6 years ago

It seems that the embeddings are very similar, no matter what image is fed. I will try to increase the dataset.