Open guotong1988 opened 5 years ago
First, I'm not sure whether the model contains the encoder during training.
EOS means end-of-sentence. Encoder and decoder are part of transformer network.
If without-encoder, training time:
target: [E, F, G, H, EOS] decoder input: [0, E, F, G, H]
If without-encoder, testing time:
decoder input: [0]
If with encoder, training time:
encoder input: [A, B, C, D] target: [E, F, G, H, EOS] decoder input: [0, E, F, G, H]
If with-encoder, testing time:
encoder input: [A, B, C, D] decoder input: [0]
Am I exact right?
I know it is beyond the topic of this project, but hope you could help. Thank you and thank you.
First, I'm not sure whether the model contains the encoder during training.
EOS means end-of-sentence. Encoder and decoder are part of transformer network.
If without-encoder, training time:
If without-encoder, testing time:
If with encoder, training time:
If with-encoder, testing time:
Am I exact right?
I know it is beyond the topic of this project, but hope you could help. Thank you and thank you.