OpenBioLink / ThoughtSource

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/
MIT License
863 stars 69 forks source link

Annotator sort by dataset #100

Closed KonstantinHebenstreit closed 1 year ago

KonstantinHebenstreit commented 1 year ago

The annotator does not sort the examples by dataset. This only becomes a problem when you load in a collection which incorporates examples from multiple datasets. In that case it will just sort all of the examples by their id, no matter which dataset they belong to.