create new thoughtsource version

OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/

MIT License

887 stars 72 forks source link

create new thoughtsource version #133

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

update thoughtsource to new version. this includes:

option for creating chained commands
added new datasets: MMLU (six medical subsets) and and open ended question version of MedQA
created thoughtsource_33 data collection, including examples from six dataset, summing to ~200 examples for fast testing
added chat option of gpt
added filtering functions for already created chain-of-thoughts