Annotator does not show correct option for boolean dataset.

OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/

MIT License

863 stars 69 forks source link

Annotator does not show correct option for boolean dataset. #114

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

Annotator should show correct option, true or false or yes or no. Like in multiple choice datasets, with the correct one in bold.

KonstantinHebenstreit commented 1 year ago

Boolean dataset: Strategy QA

KonstantinHebenstreit commented 1 year ago

Error is in dataset, not in Annotator. StrategyQA does not show "True" and "False" as answer options. Will fix in dataset...