littlewine / ZeCo2

MIT License
3 stars 0 forks source link

what is `part_range`, and what is its function? #2

Open dayuyang1999 opened 1 year ago

dayuyang1999 commented 1 year ago

Dear authors,

I am trying to reproduce your method with multiple slices of index, I saw your main function python_pipeline include a parameter part_range which I believe is related to slices.

Can you explain how this was used?

Best, Dayu

littlewine commented 1 year ago

Hi and sorry for the delayed response. I haven't looked into it really, but your assumption sounds correct to me - it seems to have to do with FAISS and colbert. All I am doing in python_pipeline is to parse the arguments and prepare them so that the retrieve and rerank functions work as expected.

Basically, you can see that the same argument parsing happens here