Closed jc-bytedance closed 4 months ago
This PR adds an 4D parallelism example of using veScale to run a open llama model that is directly imported from HuggingFace without any model code modifications.
This PR adds an 4D parallelism example of using veScale to run a open llama model that is directly imported from HuggingFace without any model code modifications.