PygmalionAI / data-toolbox

Our data munging code.
GNU Affero General Public License v3.0
34 stars 9 forks source link

Always yield the first messge of each thread as an independent thread #30

Closed silverriver closed 1 year ago

silverriver commented 1 year ago

https://github.com/PygmalionAI/data-toolbox/blob/21687af22a849fca5fd2fa2d890f0911249fe4d4/toolbox/datasets/rp_forums.py#L61C49-L61C49

if the thread has the following message: m1 m2 m3 m4

The current code with yield two threads: m1 and m2, m3, m4

TearGosling commented 1 year ago

Closing due to bug being fixed in #31.