OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
MIT License
887 stars 72 forks source link

give evaluation func the option to return None #96

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

So far evaluation could only output True/False. But in some cases we just want it to leave the answer not evaluated, and therefor it needs to be able to return None.