awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
995 stars 231 forks source link

Service will get stuck when predict large size images #891

Open xuweidongkobe opened 4 years ago

xuweidongkobe commented 4 years ago

My MMS version is 1.0.4. When I predict a large size image(about >6M), the service will get stuck. I check the doc, it limits the size of the input image. All I want know is how can I modify this setting or any other better solution? Hope to get your reply. Thank you!

vdantu commented 4 years ago

Configure max_request_size in your MMS config. That will enable you to configure larger request size. You would need to look at mms_log.log to understand the error in your service.