search

ArvinZhuang / DSI-QG

The official repository for "Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation", Shengyao Zhuang, Houxing Ren, Linjun Shou, Jian Pei, Ming Gong, Guido Zuccon and Daxin Jiang.
MIT License
108 stars 16 forks source link

Reproduce hit@10 is zero #8

Open bit-pku-zdf opened 1 year ago

bit-pku-zdf commented 1 year ago

Hi，I want to evaluate the DSI performance, use the command , image , and train 5000steps ,hits@10 is zero,Could you push the right evaluation result.Thank you !

ArvinZhuang commented 1 year ago

Hi @bit-pku-zdf, the original DSI indeed performs very badly on cross-lingual retrieval tasks, this is actually expected. For the full run results, you can check our paper (table2).

bit-pku-zdf commented 1 year ago

Get it, Thanks~