search

ArvinZhuang / DSI-QG

The official repository for "Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation", Shengyao Zhuang, Houxing Ren, Linjun Shou, Jian Pei, Ming Gong, Guido Zuccon and Daxin Jiang.
MIT License
114 stars 19 forks source link

Would you mind release the model parameters and docT5query generated database? #9

Closed Rui-Fang closed 1 year ago

Rui-Fang commented 1 year ago

I'm working on the model compression following this work, but finetuning two T5-Large is very expensive (for me). Is it possible to release the model parameters, and the query database generated by docT5Query? That can be a great help to me and many others.

Sorry if this is a bit abrupt. Thank you so much!

ArvinZhuang commented 1 year ago

Hi @Rui-Fang , thanks for raising this up! Im not 100% sure I can find those model checkpoints as it has been a while and I have changed my institution (I lost access right to the machine), but I will try to help as much as I can. I will take a look this week.

Rui-Fang commented 1 year ago

Hi @Rui-Fang , thanks for raising this up! Im not 100% sure I can find those model checkpoints as it has been a while and I have changed my institution (I lost access right to the machine), but I will try to help as much as I can. I will take a look this week.

Thanks!!

ArvinZhuang commented 1 year ago

Hi @Rui-Fang, unfortunately, I couldn't find my DSI model checkpoints.. I only have the multilingual docT5query model, do you want this model?

Rui-Fang commented 1 year ago

Yes! Thank you very much.

ArvinZhuang commented 1 year ago

Hi @Rui-Fang I have uploaded a mt5-base QG model on huggingface, check out the usage here. I'm also uploading a large model, you will find it under the organization repo later. Please note the prompt used for this model is slightly different from the prompt used in this repo, if you want to use this huggingface checkpoints to do the query generation with the code in this repo, please change the prompt in this line to match prompt in the model card.

Rui-Fang commented 1 year ago

Hi @Rui-Fang I have uploaded a mt5-base QG model on huggingface, check out the usage here. I'm also uploading a large model, you will find it under the organization repo later. Please note the prompt used for this model is slightly different from the prompt used in this repo, if you want to use this huggingface checkpoints to do the query generation with the code in this repo, please change the prompt in this line to match prompt in the model card.

Got it, Thanks!