search

gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

add rewrite task #9

Open faneshion opened 5 months ago

faneshion commented 5 months ago

The rewrite task is to convert each input question into a list of queries, which are more friendly to search systems.

youngbeauty250 commented 4 months ago

There is almost no direct evaluation for rewriting. Most of it is done indirectly using search metrics such as NDCG and Recall and answer metrics such as Accuracy to assess rewriting. So what do we do with the results of external searches?