search

microsoft / AirSim

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
https://microsoft.github.io/AirSim/
Other
16.25k stars 4.52k forks source link

DQN_car #4160

Open DAndrik21 opened 2 years ago

DAndrik21 commented 2 years ago

Question

What's your question?

Im running dqn_car.py.Training started at 200k timesteps as it should and for 10k steps it was working(i had good reward) but from then until now (50k steps ) the car just turns right (steering either 0.25 or 0.5) and resets immediately meaning it settles for minimum reward.Here is a ss of the results im getting. ![image](https://user-images.githubusercontent.com/94290789/143520126-58d3f068-d4ee-437e-a6c1-3288ddc85930.png) ### Include context on what you are trying to achieve Has anyone run this ?is it normal to do this for so long? #### Context details Windows 11 ,AirSimNH, Python 3.9.0

Include details of what you already did to find answers

DAndrik21 commented 2 years ago

Can anyone confirm dqn_car.py work after 210k timesteps?

Zhenlin-Xu commented 2 years ago

Did you check the cumulative reward of every episode on Tensorboard? I start a training on dqn_car.py today. I will go back to this issue if I find something interesting.