Open Vanint opened 2 years ago
Hi, thanks for your great work. I have a question related to mask generation in "bpe.py".
As shown in the above figure, it seems that len(tokens) = text_ctx, and then padding = 0. Does this mean there is no padding mask?
Best wishes,
Hi, thanks for your great work. I have a question related to mask generation in "bpe.py".
As shown in the above figure, it seems that len(tokens) = text_ctx, and then padding = 0. Does this mean there is no padding mask?
Best wishes,