search

ShannonAI / service-streamer

Boosting your Web Services of Deep Learning Applications.
Apache License 2.0
1.22k stars 187 forks source link

Streamer Windows Support #60

Open kogolobo opened 4 years ago

kogolobo commented 4 years ago

Hi,

I am working on using your multi-gpu Streamer for on-demand BERT inference. Due to other app requirements, I have to deploy it on a Windows server. ThreadedStreamer seems to work fine, however, when I use the multi-gpu Streamer, it seems like it is running into some issues when it tries creating worker threads (since fork() in not available in Windows). Error message: image

Could you please help me solve this?

Meteorix commented 4 years ago

Try add freeze_support as suggested. Btw, the default multi processing in this code is using spawn not fork.