There should be a feature saying that all of the 3 options are wrong

ray-project / ray-llm

RayLLM - LLMs on Ray

https://aviary.anyscale.com

Apache License 2.0

1.22k stars 91 forks source link

There should be a feature saying that all of the 3 options are wrong #137

Open ollie-iterators opened 7 months ago

ollie-iterators commented 7 months ago

Sometimes the prompts that are given cause the llm to give answers that are close but wrong. There should be an option to say that all of the options are not totally correct.

ollie-iterators commented 7 months ago

An example is: "what if anakin had died on mustafar in Star Wars episode 3?". It says there would be no luke skywalker, but Padme was already pregnant in the episode so that would not have impacted Luke's existence. Therefore this is a hallucination