OpenBMB / BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models
Apache License 2.0
560 stars 77 forks source link

Fix parallel_for when grain_size > 0 #179

Closed Achazwl closed 11 months ago

Achazwl commented 11 months ago

This do not affect current BMTrain since BMTrain pass grain_size=0 in all parallel_for.

Pull Request Template

Issue Reference

Please mention the issue number if applicable, or write "N/A" if it's a new feature.

Issue #...

Description

Please describe your changes in detail. If it resolves an issue, please state how it resolves it.

Type of Change

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce.

Checklist

Additional Information

Any additional information, configuration, or data that might be necessary for the review.