LSimon95 / megatts2

Unoffical implementation of Megatts2
MIT License
264 stars 35 forks source link

Different with paper #1

Closed LSimon95 closed 10 months ago

LSimon95 commented 10 months ago

Implementation is different with paper in some modules for losing details in the early paper. And I will modify the code following the new information and train on a larger dataset. Some differences are shown below.

Liujingxiu23 commented 10 months ago

@LSimon95 Do you know the value of n_heads in MHA in MRTE module used by Bytedance? I read the paper, but did not find related declare. I see you use 2?

LSimon95 commented 10 months ago

@Liujingxiu23 No. I can't find the exact value. Same as the content encoder for convenience.