soilwise-he / soil-health-knowledge-graph

Repository for the soil health knowledge graph
MIT License
1 stars 0 forks source link

Produce a QA dataset for validating the knowledge graph #9

Open wbcbugfree opened 5 months ago

wbcbugfree commented 5 months ago

For validation, some questions should be designed to query the knowledge graph. These questions should cover every part of the report and need to have clear answers in the report. These questions should be centered primarily on soil health-related concepts and the relationship between these concepts. Some techniques can be used to speed up this process, such as using LLMs to translate natural language questions to SPARQL queries. Besides, domain experts should also be involved during validation.

wbcbugfree commented 1 month ago

The question-SPARQL-answer dataset is here.