Closed GuangyaoZhang closed 2 months ago
[doc/gemini/tensor/...]: A concise description
pip install pre-commit && pre-commit install
resolved #5853
Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM
Tell us more if you don't enjoy contributing to Colossal-AI.
📌 Checklist before creating the PR
[doc/gemini/tensor/...]: A concise description
pip install pre-commit && pre-commit install
🚨 Issue number
resolved #5853
📝 What does this PR do?
Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM
💥 Checklist before requesting a review
⭐️ Do you enjoy contributing to Colossal-AI?
Tell us more if you don't enjoy contributing to Colossal-AI.