hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Merged gpt2 with gpt3, replaced the transforms models with colossalai models #28

Closed Gy-Lu closed 2 years ago

Gy-Lu commented 2 years ago

I have tested all gpt2 models and fixed the bugs. If there are any bugs, please contact me.

gogogwwb commented 2 years ago

Hi,After I replaced cMinhash.cpp, the installation still failed, what is the reason? image