search

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.57k stars 199 forks source link

hard negative sample selection #108

Open mactavish91 opened 2 years ago

mactavish91 commented 2 years ago

Hello, the author, great work! I am curious about the process of selecting hard negative samples in the ITC task. Will the samples that are very similar to the positive samples also be positive samples instead of hard negative samples? e.g.young woman get out of the car near the road./young woman with a broken car calling for help.

LiJunnan1992 commented 2 years ago

For ITM, samples that are similar to positives will be considered as hard negatives

mactavish91 commented 2 years ago

For ITM, samples that are similar to positives will be considered as hard negatives

@LiJunnan1992 Is there a high probability that this is a false negative sample?