ELS-RD / transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
https://els-rd.github.io/transformer-deploy/
Apache License 2.0
1.64k stars 150 forks source link

Tokenizer path #171

Open vishalsrao opened 1 year ago

vishalsrao commented 1 year ago

I get an error while loading the tokenizer from the auto-generated code. I was able to resolve the issue by changing the value of path in https://github.com/ELS-RD/transformer-deploy/blob/main/src/transformer_deploy/utils/python_tokenizer.py to

str(Path(args["model_repository"]).absolute() / args["model_version"])

from

str(Path(args["model_repository"]).parent.absolute())