search

Marker-Inc-Korea / AutoRAG

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
https://auto-rag.com/
Apache License 2.0
2.82k stars 221 forks source link

[QA Creation]If QA Data already exists, handle cases where answer(generation_gt) is Unanswerable in Corpus #730

Open bwook00 opened 2 months ago

bwook00 commented 2 months ago

Is your feature request related to a problem? Please describe. If QA Data already exists, handle cases where answer(generation_gt) is Unanswerable in Corpus

Describe the solution you'd like If QA Data already exists, implement a feature to check if it is answerable with data in the corpus

bwook00 commented 2 months ago

Since unanswerable questions don't have retrieval_gt, I think we should delete them until we deal with unanswerable questions.

bwook00 commented 2 months ago

I think we should check if it is answerable based on the "Question", whether it has only Q, Q-A, or both.