neo-ai / neo-ai-dlr

Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
Apache License 2.0
491 stars 107 forks source link

A question about GIL #423

Open elsampsa opened 2 years ago

elsampsa commented 2 years ago

When you run the method:

dlr.DLRMode.run(batch)

is the python global interpreter lock (GIL) released while the inference is running at the GPU or not?

If you don't know the answer, any hint as of where to start unravelling this greatly appreciated.