use deepspeed 0.10.0 - Githubissues

CoinCheung / gdGPT

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

Apache License 2.0

90 stars 8 forks source link

Closed CoinCheung closed 1 year ago