search

duckietown / gym-duckietown

Self-driving car simulator for the Duckietown universe
http://duckietown.org
Other
52 stars 19 forks source link

Future of gym-duckietown #127

Closed AI-Guru closed 5 years ago

AI-Guru commented 5 years ago

Namaste!

After some heavy experimentation, I strongly believe that gym-duckietown is an excellent environment for research and training. I see that it is definitely a building block when it comes to autonomous driving. It is significant.

Commits seem to be less frequent. And still, I see a huge potential for extensions. There is so much that could be done.

I wonder: What is the current plan? Are you interested in cooperating to extend this excellent environment?

liampaull commented 5 years ago

Hi - thanks for the note - commits have become less frequent after the first instantiation of the AI driving Olympics, but will ramp up again as we prepare for V2 at ICRA 2019. We are always looking for collaborators though. Please let us know what extensions you would be interested in.

AI-Guru commented 5 years ago

Thanks for your reply!

I have a couple of things in mind. Just two:

  1. Procedurally generated maps. This would help generalization the topology. Like here: https://blog.openai.com/quantifying-generalization-in-reinforcement-learning/

  2. Custom rewards. Currently (to the best of my knowledge) it is all about lane following. Correct me if I'm wrong. Here is quite a high potential for extension.

BTW. In the past I organized http://multiagentcontest.org. I know very well what kind of great work you are doing!

bhairavmehta95 commented 5 years ago

HI @AI-Guru - thank you for your recommendations.

As Liam said, commits have obviously slowed down (many of us are students, and we took a few months working on some other research). But will actually start up again next week, as we start to devote more time to the second iteration of the competition.

In fact, both recommendations are actually already on the docket (#1 and #2 are actually both done - for #2 especially, this will become more relevant as we enable some developer-only features such as the NavigationTask in Duckietown).

In addition, this repository hasn't been nearly as closely monitored as it should (I apologize - I am still trying to figure out how to get notifications for this) but most things will change starting next week :)