PygmalionAI / data-toolbox

Our data munging code.
GNU Affero General Public License v3.0
34 stars 9 forks source link

Add SuperCOT dataset #39

Closed TearGosling closed 11 months ago

TearGosling commented 11 months ago

SuperCOT dataset. Simple, kinda mid quality but whatever, may come in use later. Tested and works, so I'll skip any formalities and merge it. Also, in the middle of this, I realized the system prompt selection was bugged as hell, leading to it only choosing like, one prompt out of all the base system prompts. So I'll fix that next in a separate PR.