fani-lab / RePair

Extensible and Configurable Toolkit for Query Refinement Gold Standard Generation Using Transformers
5 stars 5 forks source link

Addition of dense and hybrid retrieval methods (rankers) #14

Closed hosseinfani closed 1 year ago

hosseinfani commented 1 year ago

It's good to study the effect of rankers in finding refined queries. As seen in toy results, in sparse retrievals, bm25 compared to qld yields to more relevant docs and hence better ir metrics and more refined queries in the final datasets.

yogeswarl commented 1 year ago

We have added Dense retriever Colbert to our pipeline