Right now, we are reading these values from the model config and using default ones if not defined.
As these values can be different for some tasks (ColBERTv2 use 180 usually but 300 for BEIR for example), it might be cool to be able to set it and override the config values.
@raphaelsty any opinion?
Right now, we are reading these values from the model config and using default ones if not defined. As these values can be different for some tasks (ColBERTv2 use 180 usually but 300 for BEIR for example), it might be cool to be able to set it and override the config values. @raphaelsty any opinion?