search

tryolabs / luminoth

Deep Learning toolkit for Computer Vision.
https://tryolabs.com
BSD 3-Clause "New" or "Revised" License
2.4k stars 399 forks source link

predict is taking 16sec on CPU. #292

Closed the-black-knight-01 closed 5 years ago

the-black-knight-01 commented 5 years ago

LUMINOTH is taking 16sec to give output. is it expected or i am giving more.

if it is expected then how can i result in milliseconds?

dekked commented 5 years ago

Hi @interviewBubble. This is normal if you are using a CPU for inference.

For a faster model, try SSD. But for milliseconds, you are going to need a GPU.

the-black-knight-01 commented 5 years ago

Thanks @dekked I have this requirement: I have to process more than 300 pages(images) within a second. What should I do? can you give me some advice? Because it can not be deployed on the server

dekked commented 5 years ago

Unfortunately, there is no model in Luminoth suitable for this requirement.

You might want to look into lightweight variants of the SSD model, but you will need at least one GPU for this speed.