Open strngelet opened 6 months ago
awesome work!
I am curious if lightseq also supports MoE architecture? eg: mixtral_8x7b.
thanks in advance.
awesome work!
I am curious if lightseq also supports MoE architecture? eg: mixtral_8x7b.
thanks in advance.