search

rmit-ir / polyfuse

Fusion for TREC run files with popular fusion techniques
MIT License
22 stars 5 forks source link

Any way to do cross validate? #3

Closed w32zhong closed 2 years ago

w32zhong commented 2 years ago

If not, are we planning to add k-fold cross-validation? like being able to specify a --k option to generate validated results?

JMMackenzie commented 2 years ago

What would the use-case of cross-validation be here? For setting parameter values?

I suspect you would be better served by simply generating splits and scripting this yourself; it's not a problem specific to polyfuse. That said, perhaps if there is a compelling use-case, someone might be able to help :-)

w32zhong commented 2 years ago

Thanks for your comments! I tried to use it for my research because I was performing fusion for old data.