search

capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval
https://capreolus.ai
Apache License 2.0
95 stars 32 forks source link

About issue #168 #187

Closed Pourbahman closed 2 years ago

Pourbahman commented 2 years ago

Dear Andrew,

I checked https://github.com/capreolus-ir/capreolus/blob/master/docs/reproduction/PARADE.md but I think I asked my question in a wrong way. I try to ask it more clear.

I need the ranked list of test data and train data as a result of running your code like the ranked list can be generated using BM25 approach. Would you please guide me about it how I can generate them?

Thanks in advance, Kind Regards

andrewyates commented 2 years ago

Running the code will produce the ranked list and save it in <results path>/pred/<dev or test>/<run file>.

Pourbahman commented 2 years ago

Thanks Andrew. According to the path <results path>/pred/<dev or test>/<run file> your code generates ranked list for test and dev set but it does not generate the ranked list for train data. Would you please tell me in which lines of your code you generate ranked list for test and dev set? (I want to generate the ranked list for train data, too).

After training the model, I want to see the train data as evaluation data like test data. So, I think maybe you did the shuffling at the time of training. So, I think I should use train data in eval mode. Would you please guide me about it , too?

Also, would you please tell me how I can reduce the number of training step to see the results in a GPU with low RAM?

andrewyates commented 2 years ago

Yes, you can find documentation here: https://capreolus.ai/en/latest/