PaddlePaddle / PaddleOCR

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)
Apache License 2.0
39.34k stars 7.35k forks source link

TritonModelException: inference request batch-size must be <= 128 for 'cls_pp' #12135

Open sheiy opened 2 weeks ago

sheiy commented 2 weeks ago

- 完整报错/Complete Error Message:
<img width="880" alt="image" src="https://github.com/PaddlePaddle/PaddleOCR/assets/12210038/7f9814ad-8c6a-415d-bc22-49632bf3aa55">
<img width="1579" alt="image" src="https://github.com/PaddlePaddle/PaddleOCR/assets/12210038/df7a015a-75c1-4fc1-94fd-a80128f408d2">
sheiy commented 2 weeks ago

麻烦问下 需要怎么处理啊 直接修改配置吗?这个max_batch_size是什么意思?我只传了一张图 改了这个batchSize直接启动不了了

image image
zhangyubo0722 commented 1 week ago

OCR套件并不支持Triton部署,请问你是在哪里看到的命令或文档呢

sheiy commented 1 week ago

@zhangyubo0722 https://github.com/PaddlePaddle/FastDeploy/tree/develop/examples/vision/ocr/PP-OCR/serving/fastdeploy_serving 那能否给我一个适合部署成api接口的文档呢