OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
37.04k
stars
3.23k
forks
source link
Orca chat Dataloader #3583
Closed
shahules786 closed 1 year ago
What
Added support for loading https://huggingface.co/datasets/shahules786/orca-chat
Why
This dataset contains samples of larger context length (~8k+) that will be used to fine-tune OA models using the scaled Rope method.
How
Added Dataloader module