search

chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
523 stars 74 forks source link

Attempting to download CLIP yields UnderVarError `unk_token` not defined #164

Closed eugene-shvarts closed 3 months ago

eugene-shvarts commented 9 months ago

https://github.com/chengchingwen/Transformers.jl/blob/91a3fe00bad5bb9ebff35b61356c3d52ad3efba3/src/huggingface/implementation/clip/tokenizer.jl#L19

The above line seems like a bug? bos_token, etc. are all provided as arguments to the function, but unk_token is not defined.