search

citadel-ai / langcheckchat

Self-evaluating RAG application on LangCheck docs
https://langcheck.readthedocs.io/en/latest/tutorial_langcheckchat.html
MIT License
10 stars 0 forks source link

Add context relevance and answer relevance metrics #28

Closed yosukehigashi closed 8 months ago

yosukehigashi commented 9 months ago

Added the context_relevance and answer_relevance metrics (which only have OpenAI versions).

image image
yosukehigashi commented 9 months ago

Thanks for the quick review! I'm gonna hold off on merging this for now actually, since I'm seeing that the function calling is kind of unreliable for Japanese (context_relevance and answer_relevance are unique in that I wrote the prompts in Japanese). So I'll fix this in LangCheck first and then merge this once that's resolved!