Closed zyn213 closed 9 months ago
Thanks for your interest. We select Roberta following the referformer for a fair comparison.
We did try clip text encoder while we didn’t find a significant performance improvement in our experiments.
I see. Thank you so much!
Hi! May I ask why you chose Roberta as your text encoder? Why didn't you use the text encoder from CLIP or Bert? Thank you!