Closed ver217 closed 3 months ago
[doc/gemini/tensor/...]: A concise description
pip install pre-commit && pre-commit install
Link this PR to your issue with words like fixed to automatically close the linked issue upon merge e.g. fixed #1234, closed #1234, resolved #1234
Link this PR to your issue with words like fixed to automatically close the linked issue upon merge
e.g. fixed #1234, closed #1234, resolved #1234
fixed #1234
closed #1234
resolved #1234
Summarize your work here. if you have any plots/diagrams/screenshots/tables, please attach them here.
Getting dist logger out of function may initialize it before initializing process group, which leads to wrong rank.
Tell us more if you don't enjoy contributing to Colossal-AI.
📌 Checklist before creating the PR
[doc/gemini/tensor/...]: A concise description
pip install pre-commit && pre-commit install
🚨 Issue number
📝 What does this PR do?
Getting dist logger out of function may initialize it before initializing process group, which leads to wrong rank.
💥 Checklist before requesting a review
⭐️ Do you enjoy contributing to Colossal-AI?
Tell us more if you don't enjoy contributing to Colossal-AI.