search

felipecode / coiltraine

Training framework for conditional imitation learning
MIT License
230 stars 68 forks source link

Confusion over which is the best model in the exploring the limits of behavioural cloning #27

Open anthonyfong100 opened 4 years ago

anthonyfong100 commented 4 years ago

Reading the readme section (https://github.com/felipecode/coiltraine/blob/master/docs/exploring_limitations.md), it is stated resnet34_imnet10S1 corresponds to seed 2 in the paper and is the best model. However, under one of the sample commands to test the best model under the hardest condition, 

python3 coiltraine.py --gpus 0 --single-process drive -e resnet34imnet10S2 --folder nocrash \
-de NocrashNewWeatherTown_Town02 --docker carlagear

It seems to suggest that the best model is infact resnet34iment10S2. I believe that this is an error and it should instead be resnet34imnet10S1. Is this really the case? Please advice, Thanks!

Flora279 commented 2 years ago

Hi, I also have a question regarding to the yaml file provided.

Why we have AVOID_STOPPING: FALSE for all models no matter for nospeed or with speed branch.

I would expect it to be TRUE for speed models.

Anyone can help?