jina-ai / jerboa

LLM finetuning
Apache License 2.0
41 stars 4 forks source link

feat: allow customizing dataset and dataset processing and support redpajamas instruct datasets #58

Closed alaeddine-13 closed 1 year ago

alaeddine-13 commented 1 year ago

closes https://github.com/jina-ai/jerboa/issues/51 https://github.com/jina-ai/jerboa/issues/49