search

bradyz / 2020_CARLA_challenge

"Learning by Cheating" (CoRL 2019) submission for the 2020 CARLA Challenge
181 stars 49 forks source link

model does not pass tests on 0.9.10 #23

Closed saurabhjha1 closed 3 years ago

saurabhjha1 commented 3 years ago

Hi,

I am trying to run the model (epoch=24.chkpt) mentioned on the readme doc. However, I see that the tests are failing especially with respect to steering.

Any pointers as to what may be going wrong. I am guessing it is the updated carla version that is not compatible with the trained model. .

Saurabh

bradyz commented 3 years ago

the model is not so good at Town01 and Town02 due to the relatively hard turns, probably due to the low level controller (PID)

you can try playing around with the PID values, but the behavior you're seeing is expected, and a failure mode of our approach!

saurabhjha1 commented 3 years ago

Thanks for your quick response!

Are there test cases that the model will pass at the moment ?

bradyz commented 3 years ago

I can't remember off the top of my head try some of the later routes - maybe routes 20+ will do better

saurabhjha1 commented 3 years ago

Got it! Seems like it works okay on route 24!