Comparision with Google Jax & Nvidia Apex

OpenBMB / BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models

Apache License 2.0

560 stars 77 forks source link

Closed Kunlun-Zhu closed 2 years ago

Kunlun-Zhu commented 2 years ago

Could BMTrain use together with the tools like Jax or Apex, or any comparisions or experiments plan with these tools? Thanks

a710128 commented 2 years ago

No, BMTrain currently only supports pytorch. The compatibility of BMTrain with apex has not been tested yet.