OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
MIT License
863 stars 69 forks source link

Prompt sprint #111

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

All code for creating the thoughtsource_100 dataset. Except from the jupyter notebooks, which will be pushed to the notebooks branch.

Introduced an error catch for using APIs. The generate function will now try five times per example using more and more API time. Please do a check on a small sample before you are going for big samples, as it now ignores the errors. It will nevertheless stop if the same error appears more than five times.