search

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
https://open-assistant.io
Apache License 2.0
36.94k stars 3.22k forks source link

Add dataset loader for fanfics-10k-50k dataset #3585

Closed andreaskoepf closed 1 year ago

andreaskoepf commented 1 year ago

To use the atom-in-the-universe/fanfics-10k-500k during training add fanfics to the dataset configuration. e.g.:

  datasets:
    - fanfics