Feat: add suport for custom code

stanford-futuredata / ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

MIT License

2.67k stars 355 forks source link

Feat: add suport for custom code #306

Closed liuqi6777 closed 4 months ago

liuqi6777 commented 4 months ago

Hello, we’re from @jina-ai. We leverage ColBERT to train our customized variant of ColBERT (alibi variant), designed to accommodate longer contexts.

This PR aims to integrate custom code within the ColBERT repository.

bclavie commented 4 months ago

Hey, this looks good to me! Both in the new capabilities it adds (much nicer than to hardcode relevant models) & how it preserves existing behaviour whenever possible. Thanks for this (and I spied Jina-ColBERT on huggingface the other day, very exciting, well done!).

@okhat any objections to merging?