search

luyug / COIL

NAACL2021 - COIL Contextualized Lexical Retriever
Apache License 2.0
148 stars 28 forks source link

Describe C-COIL approach #6

Open joshdevins opened 3 years ago

joshdevins commented 3 years ago

Just wondering if you could add somewhere a description of your MS MARCO submission "C-COIL + RoBERTa" from 14/07/2021. Which modifications to COIL have you made and what was the motivation?

luyug commented 3 years ago

I have planned to write a tutorial on that submission but have been distracted by other projects. I hope to get it done as soon as possible, at least by the end of the week. Let's leave this issue open; feel free to ping me if you don't hear from me.

hguan6 commented 2 years ago

Hi Luyu. Can you send a copy of your C-COIL initializer paper to my email: hguan6@asu.edu? I suppose your coCondenser can also be used to initialize COIL. Did you try coCondenser+COIL? Does it improve COIL?

joshdevins commented 2 years ago

Or add it to the repo/README: https://github.com/luyug/COIL/tree/main/examples/c-coil

luyug commented 2 years ago

Hello, thanks for reminding me on this! C-COIL is actually Condenser + COIL and the Condenser paper is no longer under review. https://arxiv.org/abs/2104.08253

We have not done experiments with coCondenser initialized COIL, partly because coCondenser can achieve okay performance on its own being a dense retriever and partly because of our limited GPU resource. I think such experiments are definitely interesting but the question is whether we can build better software/infrastructure to support COIL.

joshdevins commented 2 years ago

Maybe just link to https://github.com/luyug/COIL/tree/main/examples/c-coil from the main README then since there's no mention of C-COIL there. Then we can close this issue probably.