search

apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.78k stars 6.79k forks source link

Error memory leak in multi thread use Threading library in python, when predict from same a model for multi thread #16087

Open damvantai opened 5 years ago

damvantai commented 5 years ago

Error memory leak in multi thread use Threading library in python, when predict from same a model for multi thread mxnet 1.5 after merge https://github.com/apache/incubator-mxnet/issues/15375, why still have that error when inference

mxnet-label-bot commented 5 years ago

Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended label(s): Bug

marcoabreu commented 5 years ago

Hi, can you provide us with a reproducible example?

samskalicky commented 5 years ago

@mxnet-label-bot add [bug,pending-requester-response]

samskalicky commented 5 years ago

@mxnet-label-bot add [bug]

samskalicky commented 5 years ago

@anirudh2290

anirudh2290 commented 5 years ago

What is the MXNET_ENGINE_TYPE you are using ? Threading library in python won't provide much benefits because of GIL. You can either try multiprocessing or you can use C Predict API Multi threading interface. You can find an example here : https://github.com/apache/incubator-mxnet/tree/master/example/image-classification/predict-cpp