We likely need to redo the code again to support multi-device streaming or use video2numpy, but for now, it works fine. The bottleneck currently is FFmpeg, not GPU or multiprocessing transfer. Using 30 FPS in FFmpeg, we can quantize over 1000 frames per second. However, at 1 FPS, this drops to 150 quantized frames per second. video2numpy is working on this problem.
We likely need to redo the code again to support multi-device streaming or use video2numpy, but for now, it works fine. The bottleneck currently is FFmpeg, not GPU or multiprocessing transfer. Using 30 FPS in FFmpeg, we can quantize over 1000 frames per second. However, at 1 FPS, this drops to 150 quantized frames per second. video2numpy is working on this problem.