search

stanford-futuredata / ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)
MIT License
3.07k stars 388 forks source link

Finetuning nway parameter #245

Closed slawekgarcarz closed 1 year ago

slawekgarcarz commented 1 year ago

Hello,

Is it possible to set nway parameter in the config to a value higher than 2? When I tried using more examples per query for fine-tuning from provided ColBERTv2 checkpoint I'm getting following assertion error:

File "../colbert/training/lazy_batcher.py", line 69, in collate assert len(passages) == self.nway * self.bsize AssertionError

okhat commented 1 year ago

Of course! But you need the json file to have enough negatives per line

slawekgarcarz commented 1 year ago

Oh, sorry. I get it now. Thank you!