search

databricks / dbrx

Code examples and resources for DBRX, a large language model developed by Databricks
https://www.databricks.com/
Other
2.47k stars 231 forks source link

Fine Tuning? #12

Closed aiyinyuedejustin closed 3 months ago

aiyinyuedejustin commented 3 months ago

Do you support fine-tuning on this model? Such as using Lora, Deepspeed, etc

bandish-shah commented 3 months ago

For fine tuning please refer to the LLM Foundry examples we've shared here https://github.com/databricks/dbrx?tab=readme-ov-file#finetune

We do not support Deepspeed.