search

sleeepeer / PoisonedRAG

[USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
https://arxiv.org/abs/2402.07867
MIT License
73 stars 10 forks source link

How to build beir_results? #6

Closed ShiJiawenwen closed 1 month ago

ShiJiawenwen commented 1 month ago

Hello, thanks for your interesting work! I have some code questions after I run your code. If I want to transfer to other dataset, is the first thing to generate beir results, right? But I can not find the code? Can you help me to solve this? Many thanks.

sleeepeer commented 1 month ago

Thanks! Will upload the code soon in the next week.

sleeepeer commented 1 month ago

Hi! Thanks for pointing it out! I've uploaded evaluate_beir.py in the latest commit, which is what we used to generate beir_results for beir datasets. If you want to use your own datasets, please modify this file to load your dataset and prepare it as the beir format (corpus, queries, qrels), and use evaluate_beir.py to generate results for it.

ShiJiawenwen commented 1 month ago

Many thanks!

sleeepeer commented 1 month ago

You are welcome! Feel free to reopen this issue or email me if you have further questions!