OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
MIT License
863 stars 69 forks source link

Map function in generate/evaluate without recaching #95

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

Deactivate recaching in generate and evaluate. This makes it possible to call generate multiple times on one collection. This makes it possible to reload a collection and generate with a new config without recaching the old collection. The added tests show the improvements, which have been made.