search

confident-ai / deepeval

The LLM Evaluation Framework
https://docs.confident-ai.com/
Apache License 2.0
2.91k stars 213 forks source link

HallucinationMetric #131

Closed ColabDog closed 6 months ago

ColabDog commented 11 months ago

To check for hallucination, we can perform the following:

j-space-b commented 11 months ago

this is cool - needs an additional API possibly for google search? If so are there any alternatives for web search?

ColabDog commented 11 months ago

For this, we can use Serp API (https://serpapi.com/) but unfortunately it's pretty expensive.
I also potentially think we should be using Wikipedia data dumps to ensure factual correctness as opposed to just Google Search because it's also a better resource than Google Search in trustworthiness.