How can I build AAR-ANCE index?

RUC-NLPIR / FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

https://arxiv.org/abs/2405.13576

MIT License

891 stars 69 forks source link

How can I build AAR-ANCE index? #32

Closed Ciao-CA closed 2 weeks ago

Ciao-CA commented 3 weeks ago

when I run index_builder.py，I got an error ValueError: You have to specify either decoder_input_ids or decoder_inputs_embeds I guess it may due to ANCE's T5 based(encoder-decoder), and I don't find where decoder is in index_builder.py. So I wonder how I can solve this question, thanks! ance

ignorejjj commented 3 weeks ago

Sorry, there is a bug when determining the model type in multi gpu setting, which may result in inability to properly recognize T5-based models.

We have fixed it, you can try it again.

Note: For ANCE, you should set pooling_method to cls.