jina-ai / jerboa

LLM finetuning
Apache License 2.0
41 stars 4 forks source link

Incorporate baize data and training into jerboa training pipeline #45

Closed alaeddine-13 closed 1 year ago

alaeddine-13 commented 1 year ago

Current training pipeline only supports instruction-tuning based on the alpaca template/dataset The baize's pipeline supports both training to follow instructions and to behave like a chatbot. It might be interesting to incorporate this logic/dataset into our training pipeline