search

LinWeizheDragon / FLMR

The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
71 stars 4 forks source link

Something about evaluate #33

Closed lzhptr closed 1 month ago

lzhptr commented 1 month ago

What does the Ks parameter mean? Why does the documentation say "Enable --Ks 1 5 10 20 50 100 500: max(Ks) needs to be 500 to match the performance reported in the PreFLMR paper"

LinWeizheDragon commented 1 month ago

Despite being closed, I'd respond to this question for other audiences. The engine chooses some hyperparameters (e.g. threshold for centroid search) based on the max Ks, in this case, 500. If max(Ks) = 100, the result is slightly worse than what was reported in the paper.

lzhptr commented 1 month ago

Despite being closed, I'd respond to this question for other audiences. The engine chooses some hyperparameters (e.g. threshold for centroid search) based on the max Ks, in this case, 500. If max(Ks) = 100, the result is slightly worse than what was reported in the paper.

Thank you very much!