Dolphin gpt 3.5 data mix

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

https://open-assistant.io

Apache License 2.0

36.92k stars 3.22k forks source link

Closed shahules786 closed 1 year ago

shahules786 commented 1 year ago

Added dolphin random data mix to form conversations from gpt 3.5 file.
Instructions of the same type are only considered while picking at random to form conversation
Also ensured that same samples are not considered more than once

Configure

- dolphin-mix
        num_samples: 100000
        max_char_len: 32000
        seed: 44