I am running scenario_runner.py file with openscenario (xosc) scenario. After some frame I am getting error as "Watchdog exception - Timeout of 61.0 seconds occurred" .
In the scenario_manager.py file kept 10 sec value inside world.tick() function CarlaDataProvider.get_world().tick(10.0).
I tried changing tick value 20,30,40,60 but still getting same error.
CarlaDataProvider.get_world().tick(10.0) method is hanged until watchdog get expired.
When I tried same with local GPU system the frequency of the issue is less. But same time when it is tested with containerization in AWS with 4 dockers the frequency of issue is very high.
So here are my questions:
1) will system resource affect on carla server response(world.tick())?
2) What could be the possible solution for this issue?
Environment
AWS instance type : g4dn.4xlarge
4 docker container in one instance with memory 16384mb and 4 cpus .
OS : ubuntu18.04
Driver : NVIDIA-SMI 510.73.05
Python: 3.8
Carla versions: 0.9.11
Scenario Runner Version - 0.9.11(included watchdog fix from 0.9.12 )
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
I am running scenario_runner.py file with openscenario (xosc) scenario. After some frame I am getting error as "Watchdog exception - Timeout of 61.0 seconds occurred" . In the scenario_manager.py file kept 10 sec value inside world.tick() function CarlaDataProvider.get_world().tick(10.0). I tried changing tick value 20,30,40,60 but still getting same error.
CarlaDataProvider.get_world().tick(10.0) method is hanged until watchdog get expired. When I tried same with local GPU system the frequency of the issue is less. But same time when it is tested with containerization in AWS with 4 dockers the frequency of issue is very high.
So here are my questions: 1) will system resource affect on carla server response(world.tick())? 2) What could be the possible solution for this issue?
Environment AWS instance type : g4dn.4xlarge 4 docker container in one instance with memory 16384mb and 4 cpus . OS : ubuntu18.04 Driver : NVIDIA-SMI 510.73.05 Python: 3.8 Carla versions: 0.9.11 Scenario Runner Version - 0.9.11(included watchdog fix from 0.9.12 )