search

PygmalionAI / data-toolbox

Our data munging code.
GNU Affero General Public License v3.0
34 stars 9 forks source link

Fix Claude roleplay data #27

Closed TearGosling closed 1 year ago

TearGosling commented 1 year ago

Previously, it wasn't parsing due to a little error where instead of it treating bot messages as a model response, it treated it as a system response. Also did a little more work here and there.

TearGosling commented 1 year ago

Tested it myself, works on my machine. Merging.

TearGosling commented 1 year ago

Update: actually, there's more to the Claude logs, such as actual character descriptions. Let me handle that too.

TearGosling commented 1 year ago

Now I'm merging.