There seems to be a problem with multithreading operations inside the model

ShannonAI / service-streamer

Boosting your Web Services of Deep Learning Applications.

Apache License 2.0

1.23k stars 187 forks source link

Closed ZQFORWARD closed 1 year ago

ZQFORWARD commented 1 year ago

When there are multithreaded operations inside my model, the batch size of the streamer is always 1, even if I have set it to 64.