mitre / quaerite

Search relevance evaluation toolkit
Other
73 stars 14 forks source link

Bake crossfold validation into the Genetic Algorithm code #10

Closed tballison closed 5 years ago

tballison commented 5 years ago

The GA should use crossfold validation as the default. I propose a default n of 5. Users can choose to change the n, including to 1 or 0, which would be testing on training -- a horror -- but users should be allowed to choose it on the theory that they know what they're doing... The key thing is that this should NOT be the default.