search

ai-forever / ru-clip

CLIP implementation for Russian language
Apache License 2.0
137 stars 36 forks source link

Fix incorrect slice of tokens in RuCLIPProcessor #19

Closed boomb0om closed 2 years ago

boomb0om commented 2 years ago

Fix EOS token not being included in tokens, when len(tokens) > text_seq_length