ELS-RD / transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
https://els-rd.github.io/transformer-deploy/
Apache License 2.0
1.64k stars 150 forks source link

I faced with Stub process is unhealthy and it will be restarted. #167

Open OleksandrKorovii opened 1 year ago

OleksandrKorovii commented 1 year ago

I tried to implement token-classification task but faced a problem like: {"error": "Failed to process the request(s) for model instance 'transformer_tensorrt_inference_0', message: Stub process is not healthy."}

For the model I used RobertaForTokenClassification fine-tuned on my own dataset. I build docker container from main.