search

dropreg / R-Drop

867 stars 107 forks source link

Can I use R-Drop in Semantic Search? #27

Closed ralgond closed 2 years ago

ralgond commented 2 years ago

Can R-Drop encode query and documents into embeddings for semantic search?

Thanks

apeterswu commented 2 years ago

Hi @ralgond ,

R-Drop is only a simple training trick for DNNs. If your search problem is defined as a multiclass classification with softmax, it can be used smoothly. Encoding is not a matter of R-Drop.