OpenBMB / BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models
Apache License 2.0
560 stars 77 forks source link

Add zero_context.py #160

Closed zkh2016 closed 1 year ago

zkh2016 commented 1 year ago

Pull Request Template

Issue Reference

Please mention the issue number if applicable, or write "N/A" if it's a new feature. N/A Issue #...

Description

Please describe your changes in detail. If it resolves an issue, please state how it resolves it. add zero_context.py

Type of Change

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce.

Checklist

Additional Information

Any additional information, configuration, or data that might be necessary for the review.