question about inference time on batchsize 1 or multiple batchsizes

WongKinYiu / CrossStagePartialNetworks

Cross Stage Partial Networks

https://github.com/WongKinYiu/CrossStagePartialNetworks

894 stars 172 forks source link

question about inference time on batchsize 1 or multiple batchsizes #45

Open harrylin-hyl opened 3 years ago

harrylin-hyl commented 3 years ago

I use CSPDarknet as the backbone of my detection on mmdetection, but the inference time of CSPDarknet is slower than Darknet when batchsize is 1. However, when batchsize increases 8 or more, the inference time is quicker than Darknet. Is this normal? or something wrong?

Thanks!