search

hkust-zhiyao / RTL-Coder

A new LLM solution for RTL code generation, achieving state-of-the-art performance in non-commercial solutions and outperforming GPT-3.5.
120 stars 16 forks source link

tokenizer can't be loaded #14

Open pierowu opened 4 weeks ago

pierowu commented 4 weeks ago

When I try to load the tokenizer with transformers.AutoTokenizer.from_pretrained() , something went wrong. However, the original tokenizer from DeepSeek can be correctly loaded. Is there any difference between these two? Here is the error report: image