Open puppy2000 opened 4 months ago
Hello, thanks for your great work. I want to know if there is any potential bug in MOE parallelism when I set ep_size > 1 in the code? Have you tried it?
Question
Hello, thanks for your great work. I want to know if there is any potential bug in MOE parallelism when I set ep_size > 1 in the code? Have you tried it?