A10 & v100 config - Githubissues

databrickslabs / dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Apache License 2.0

10.81k stars 1.16k forks source link

Closed tnixon closed 1 year ago

tnixon commented 1 year ago

Continuation of PR #181

Pre-defined deepspeed configs for A10 and V100 GPUs. UI widget to easily select appropriate config to train dolly.