search

hkchengrex / Cutie

[CVPR 2024 Highlight] Putting the Object Back Into Video Object Segmentation
https://hkchengrex.com/Cutie/
MIT License
702 stars 70 forks source link

Multi GPU support #95

Closed AjinJayan closed 2 months ago

AjinJayan commented 2 months ago

How to utilize multiple GPUS, so that I can get higher FPS. Also, any way to decrease the inference time per image, even with single GPU.

hkchengrex commented 2 months ago

Multi-GPU inference is not implemented. It would be quite challenging to get a higher FPS that way.

If you use our inference code, it should be fairly optimized. You could try using all 16-bit inference rather than mixed precision.