capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval
https://capreolus.ai
Apache License 2.0
95 stars 32 forks source link

Integrating LCE #199

Closed nimasadri11 closed 2 years ago

nimasadri11 commented 2 years ago

Sending this PR for @crystina-z 's review. Still waiting for the script to finish to make sure there are no bugs. As such, please do not merge yet.

lgtm-com[bot] commented 2 years ago

This pull request introduces 3 alerts when merging 4b9e2247754e1b548d425b4c867d6dcd1d69f735 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 3 alerts when merging bac04a02d67203a305c2fc0d623f751fb8dc7063 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts when merging 3e0c979af32603e65ebdc85201cbf983fe852873 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts when merging e9cf9a670f81c2bf784e96a0f2eee4763233cfbd into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts and fixes 1 when merging 2ec75ad6dbd0b6e09d1d1ac332dac1902775b738 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts and fixes 1 when merging c3edfe84dbeeceea17f9c7029c7a73058f7773b8 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

fixed alerts:

crystina-z commented 2 years ago

the PR looks good to me now. have run the LCE with nneg=4 and 7 at commit bac04a0, got score MRR@10 0.397 and 0.405 respectively. Running on the latest commit now.

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts and fixes 1 when merging d068d012a5615cf4bea6f02ca0004fc562c898e8 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 2 alerts and fixes 1 when merging 319155f7899b67456392e05b4b002d16126b24b4 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request introduces 3 alerts and fixes 1 when merging 1b405b763912b00540dfdea0e9fad20bb13d7913 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

new alerts:

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request fixes 1 alert when merging 0600a9aae5dceefe735bc214f88cdd256cbceea0 into e10928f5fa87ef2ac9eaabe28f1f2dc0e142b0de - view on LGTM.com

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request fixes 1 alert when merging dd3a1dfdf3c855be151e0f8a6878d2e2bc0a0caf into 2ba1b7e380cc3f6d6751f826ce8899841a1a56f9 - view on LGTM.com

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request fixes 1 alert when merging 0600a9aae5dceefe735bc214f88cdd256cbceea0 into 2ba1b7e380cc3f6d6751f826ce8899841a1a56f9 - view on LGTM.com

fixed alerts:

lgtm-com[bot] commented 2 years ago

This pull request fixes 1 alert when merging 27b081ec1a37d2af6afa6b61eb1cb7cc4ec9db1c into 2ba1b7e380cc3f6d6751f826ce8899841a1a56f9 - view on LGTM.com

fixed alerts:

crystina-z commented 2 years ago

the model with monoELECTRA (nneg=31) is put on huggingface - https://huggingface.co/crystina-z/monoELECTRA_LCE_nneg31 with MRR@10 = 0.412