Open DominiquePaul opened 3 months ago
hi,
Thanks for pointing this out. Your code explicitly does not do multiprocessing but the client does (actually it does threading).
We were not aware about the problem as we run infer_async(...)
within our lambdas.
We will take a look, but probably for this to be resolved there is some time needed.
As a walk-around you may take a look here: https://stackoverflow.com/questions/60455830/can-you-have-an-async-handler-in-lambda-python-3-6
should be possible to run async coroutine (await client.infer_async(...)
) within lambda handler. That should work.
Sorry for inconvenience and thanks for raising this bug
Search before asking
Bug
I am running this code on AWS Lambda
As part of a docker container that looks like this:
My requirements.txt contains nothing but inference==0.9.17
When the code runs I get the following error. I have been trying to fix this and tried workarounds but to no avail. I understand that the error is somehow related to multiprocessing. I found this post from which I understand that multiprocessing isn't possible on AWS Lambda, however, my script does not control or trigger any multiprocessing.
This is the full error:
Environment
No response
Minimal Reproducible Example
No response
Additional
I am incredibly frustrated since I've been working on this for 9 hours now and would appreciate any hints!
Are you willing to submit a PR?