ant-media / Ant-Media-Server

Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
https://antmedia.io
Other
4.24k stars 622 forks source link

Correct utilization issue with multiple GPUs #6555

Open yashtandon113 opened 1 month ago

yashtandon113 commented 1 month ago

Short description

We did some tests with g3.4xlarge (one GPU server with 8 GB of memory) and it handled around 10 streams with 5 ABRs without any issue but when we performed tests on g3.8xlarge (two GPU servers with 8 GB of memory each), again only 10 streams were handled. It seems their is some issue with the correct utilization by the server in the case of multiple GPUs.

Environment

Steps to reproduce

  1. Launch one g3.8xlarge or multi-GPU instance
  2. Enable 5 ABRs (1080p, 720p, 480p, 360p and 240p)
  3. Put the load on the server and monitor the GPU usage

Expected behavior

The multi-GPU server should handle atleast double of single-GPU instance of same type

Actual behavior

Their seems to be an issue with multi-GPU utilization