search

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.45k stars 193 forks source link

hard negative sample selection #108

Open mactavish91 opened 1 year ago

mactavish91 commented 1 year ago

Hello, the author, great work! I am curious about the process of selecting hard negative samples in the ITC task. Will the samples that are very similar to the positive samples also be positive samples instead of hard negative samples? e.g.young woman get out of the car near the road./young woman with a broken car calling for help.

LiJunnan1992 commented 1 year ago

For ITM, samples that are similar to positives will be considered as hard negatives

mactavish91 commented 1 year ago

For ITM, samples that are similar to positives will be considered as hard negatives

@LiJunnan1992 Is there a high probability that this is a false negative sample?