naver / splade

SPLADE: sparse neural search (SIGIR21, SIGIR22)
Other
710 stars 79 forks source link

Whether the SPLADE model supports the distinction of 'is_q'? #48

Closed xyCaicaicai closed 4 months ago

xyCaicaicai commented 6 months ago

I noticed relevant content in the code regarding it, but there is no specific model path provided for 'is_q'.

Regards

thibault-formal commented 5 months ago

Hi @xyCaicaicai SPLADE definitely supports this distinction (having separate query/doc encoders). This is triggered when model_type_or_dir_q is defined in the init dict (see for instance: https://github.com/naver/splade/blob/main/conf/train/model/separate_distilbert_mlmflops.yaml)

You can find a trained model here for instance: https://huggingface.co/naver/efficient-splade-VI-BT-large-doc

Best