search

redhat-et / foundation-models-for-documentation

Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat customer documentation assets.
Other
24 stars 11 forks source link

Human Evaluation of Generated Answers: Establishing Criteria and Guidelines for Assessment #51

Open suppathak opened 1 year ago

suppathak commented 1 year ago

The purpose of this issue is to establish a comprehensive framework for conducting human evaluation of generated answers and comparing them against real answers.

Shreyanand commented 3 months ago

Addressed partially in #41 However, it's still open ended without a practical implementation.