search

oriyor / ret-robust

Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
MIT License
59 stars 1 forks source link

Code #1

Closed ZhengxiangShi closed 8 months ago

ZhengxiangShi commented 1 year ago

Amazing work! May I kindly ask whether there is a plan to release the code?

Thanks, Zhengxiang

oriyor commented 1 year ago

Hi Zhengxiang,

Thanks for reaching out!

Of course all code will be made publicly available, but I'm now on some personal time off so it may take a few weeks. Is there a specific part you are more interested in?

ZhengxiangShi commented 12 months ago

It is fine. Have a nice holiday.

kerkathy commented 10 months ago

Hi @oriyor This work is indeed outstanding! Since I'm also interested in this field, may I kindly ask the expected date of your code release? Thank you again.

oriyor commented 9 months ago

Hi @oriyor This work is indeed outstanding! Since I'm also interested in this field, may I kindly ask the expected date of your code release? Thank you again.

Hi @kerkathy, thanks for reaching out and for taking an interest in our work! I think that around the end of December, but if there is a specific part you are interested it might already be available in other projects. What exactly are you interested in?

kerkathy commented 9 months ago

Hi @oriyor , Since you mentioned that you were following the in-context RALMs from Ram et. al (2023), should I directly follow the code in https://github.com/AI21Labs/in-context-ralm ? And actually I wanted to reproduce the work and play around a bit, so I'm curious about the few shot prompt and the hyperparamter in RALM you set to make it work. Also, if you can kindly share how you preprocess the data, that'll be even more great!

Thank you :)

oriyor commented 8 months ago

Hi! I pushed the majority of the code. To run the NQ experiments, please see the reasoning-on-cots project. Instructions on how to run experiments are here and NQ prompts are here. I will add the remaining configs and prompts during the next few days.

Please let me know if anything isn't working as expected :)

kerkathy commented 8 months ago

@oriyor That's awesome, thank you!

oriyor commented 8 months ago

Closing after the code release. Plz let me know if there are any additional issues.