Confusing about the change of fps

ceccocats / tkDNN

Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms

GNU General Public License v2.0

717 stars 209 forks source link

Confusing about the change of fps #166

Closed Elina-ye closed 3 years ago

Elina-ye commented 3 years ago

Thank you for your work.

I'm struggling with the FPS. I ran the demo on TX2 and the fps had achieved about 87. However, I need to report the fps during the detection and I found the fps has a low value at the beginning. Then it will be increased and reach a stable value. The whole period will cost about 1 minute. Could anyone can tell me why the fps is low at first and has increased after that?

mive93 commented 3 years ago

It's not a problem of tkDNN, it's very common in several application. FPS are never constant, you should always consider the average value and the variance. Clearly the first iteration will be the most expensive (it has to load the model on the GPU and initialize a lot of stuff), but then it depends on what else is running on your board.

Closing for now, feel free to reopen.