[QNA-Issue] Ambiguity in meaning of "Mahabharat" (epic or battle) in datasets_used/QA_dataset.csv/Q22

Palakgarg155 / Multilingual-RAG-Evaluations

Apache License 2.0

1 stars 0 forks source link

[QNA-Issue] Ambiguity in meaning of "Mahabharat" (epic or battle) in datasets_used/QA_dataset.csv/Q22 #1

Closed arjunvenkatraman closed 2 months ago

arjunvenkatraman commented 2 months ago

File: datasets_used/QA_dataset.csv Question #: 22 Issue: The questions asks who was the king at the beginning of the Mahabharata - this may be correctly answered as Shantanu or Dhritarashtra depending on whether the meaning of the word Mahabharat is taken as the battle or the epic

aditisinghh17 commented 2 months ago

Our knowledge base uses Mahabharata in the context of the epic, so the correct answer would be Shantanu.