Can you please let me know the Latency difference between GPU and CPU for a single image in msec?

[ayumiymk]

Actually, this is highly related to the hardware you use. So u can test it in your own machine, whose conclusion should just be correct for you.