search

arcee-ai / DALM

Domain Adapted Language Modeling Toolkit - E2E RAG
https://www.arcee.ai
Apache License 2.0
300 stars 39 forks source link

how to use title question and passage all together while training retriever only #91

Closed mujhenahiata closed 5 months ago

shamanez commented 5 months ago

we are using in-batch negative contrastive loss. So, it is better not to compare the title question to the passage. Because it will make it easier for the model to learn.