Closed JohnZhan2023 closed 3 months ago
add one more dimension for moe expansion and due to simplicity keep the batchsize = 1
Out of Date PR
add one more dimension for moe expansion and due to simplicity keep the batchsize = 1