At the moment, we just took the first 510 tokens of each sequence.
Other approaches would be to take the last 510 tokens or to do a mix by taking the first 255 and the last 255 tokens. For movie reviews, this could improve the model and is one aspect we could try out.
At the moment, we just took the first 510 tokens of each sequence. Other approaches would be to take the last 510 tokens or to do a mix by taking the first 255 and the last 255 tokens. For movie reviews, this could improve the model and is one aspect we could try out.