search

castorini / ura-projects

0 stars 1 forks source link

Quick repro on OpenAI-ada regressions #19

Closed lintool closed 3 months ago

lintool commented 8 months ago

I need a quick independent check that these work:

https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-msmarco-passage-openai-ada2.md https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-dl19-passage-openai-ada2.md https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-dl20-passage-openai-ada2.md

It's just a matter of copy/pasting a bunch of commands and verifying the output - and then sending a PR updating the repro log. These should run fine on student Linux environment.

Also read our paper: https://arxiv.org/abs/2308.14963

techandy42 commented 8 months ago

I will look into this.

Melissa1412 commented 8 months ago

Will take a look at this.

lintool commented 3 months ago

No longer needed.