LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
https://open-assistant.io
Apache License 2.0
36.92k stars 3.22k forks source link

Dolphin-mix code refactor #3609

Closed shahules786 closed 1 year ago

shahules786 commented 1 year ago

What

refactor dolphin-mix loader for optimized and reproducible loading

Why

The earlier version has optimization and randomization issues.

How

Simplified the code and seeded every random