search

som-shahlab / Clinfo.AI

This is Clinfo.AI Demo Instruction
MIT License
26 stars 8 forks source link

Great work! Consider using a dense retriever? #1

Closed Andy-jqa closed 2 months ago

Andy-jqa commented 10 months ago

First, thank you for sharing this great study!

I see that the current retrieval uses keyword generation and lexical search by Entrez. Have you considered using dense vectors to perform the retrieval?

We just released MedCPT, which is a zero-shot biomedical IR model pre-trained by 255M query-article click logs in PubMed search. You can download MedCPT at: https://huggingface.co/ncbi/MedCPT-Query-Encoder and https://huggingface.co/ncbi/MedCPT-Article-Encoder.

Best, Qiao

Ale9806 commented 2 months ago

Hey Andy, amazing work! I will add integration with MedCPT soon!

Ale9806 commented 2 months ago

Hello @Andy-jqa we have added support for dense retrievers using MedCPT, thanks a lot!