Some question about the mindspore code different from paper

huawei-noah / Pretrained-IPT

Apache License 2.0

428 stars 63 forks source link

Some question about the mindspore code different from paper #3

Closed jiaaihhy closed 1 year ago

jiaaihhy commented 3 years ago

Dear noah: In your IPT paper, writer that " The body has 12 encoder layers and 12 decoder layers.", but in the mindspore code, the num_layers in encoder and decoder all 4 layers, should change 4 to 12? or 4? Looking forward your reply

HantingChen commented 3 years ago

The num_layers should be changed to 12. Note that the mindspore code is a 4 layers demo.