About the training loss of Masked Transformer and Residual Transformer.

[bob35buaa]

I'm trying to replicate the results on the KIT dataset, but I've observed that the training and validation classification accuracy of the Masked Transformer and Residual Transformer are not very high. Specifically, the validation classification accuracy is extremely low (below 20% for Masked Transformer and below 10% for Residual Transformer), and the animation results are also unreasonable. Is this normal? This is the tensorboard logging of Masked Transformer: And this is the tensorboard logging of Residual Transformer:

[HitBadTrap]

Have you addressed this problem or is this issue acceptable? @bob35buaa

Thanks.

[bob35buaa]

Have you addressed this problem or is this issue acceptable? @bob35buaa

Thanks.

No, the author hasn't reply this question.