search

CoinCheung / gdGPT

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
Apache License 2.0
90 stars 8 forks source link

Is there any plan to support chatglm2 or yi #25

Closed yangzhipeng1108 closed 9 months ago

CoinCheung commented 9 months ago

Hi ,

I added support for chatglm3, and I tried it on chatglm3-base locally on my machine. Mabe you can have a look?

yangzhipeng1108 commented 9 months ago

Thank you so much