carla-simulator / carla

Open-source simulator for autonomous driving research.
http://carla.org
MIT License
11.52k stars 3.72k forks source link

Watchdog exception - Timeout of 61.0 seconds occurred due to world.tick() not responding #5573

Open nehap4225 opened 2 years ago

nehap4225 commented 2 years ago

I am running scenario_runner.py file with openscenario (xosc) scenario. After some frame I am getting error as "Watchdog exception - Timeout of 61.0 seconds occurred" . In the scenario_manager.py file kept 10 sec value inside world.tick() function CarlaDataProvider.get_world().tick(10.0). I tried changing tick value 20,30,40,60 but still getting same error.

CarlaDataProvider.get_world().tick(10.0) method is hanged until watchdog get expired. When I tried same with local GPU system the frequency of the issue is less. But same time when it is tested with containerization in AWS with 4 dockers the frequency of issue is very high.

So here are my questions: 1) will system resource affect on carla server response(world.tick())? 2) What could be the possible solution for this issue?

Environment AWS instance type : g4dn.4xlarge 4 docker container in one instance with memory 16384mb and 4 cpus . OS : ubuntu18.04 Driver : NVIDIA-SMI 510.73.05 Python: 3.8 Carla versions: 0.9.11 Scenario Runner Version - 0.9.11(included watchdog fix from 0.9.12 )

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.