search

Michelle-NYX / traffic-simulator-Q-learning

We propose a driver modeling process and its evaluation results of an intelligent autonomous driving policy, which is obtained through reinforcement learning techniques. Assuming a MDP decision making model, Q-learning method is applied to simple but descriptive state and action spaces, so that a policy is developed within limited computational load. The driver could perform reasonable maneuvers, like acceleration, deceleration or lane-changes, under usual traffic conditions on a multi-lane highway. A traffic simulator is also construed to evaluate a given policy in terms of collision rate, average travelling speed, and lane change times. Results show the policy gets well trained under reasonable time periods, where the driver acts interactively in the stochastic traffic environment, demonstrating low collision rate and obtaining higher travelling speed than the average of the environment. Sample traffic simulation videos are postedsit on YouTube.
MIT License
25 stars 6 forks source link

Can you give me the report #1

Open NealLiufighting opened 5 years ago

NealLiufighting commented 5 years ago

Hello， I am learning the Q-learning in decision making for autonomous driving,but I can not understand the project.Can you give me the report about this project.

Michelle-NYX commented 5 years ago

Hi, thank you for reaching out! Unfortunately the report for this project is not publicly available, since it is a course-based work. However, you can find our previous work here: https://sites.google.com/umich.edu/testing-of-automotive-cps/game-theoretic-traffic-simulator?authuser=0 , where the idea should be similar.

NealLiufighting commented 5 years ago

Thank you very much.

shanto268 commented 5 years ago

Hi Michelle, I am having trouble using the code. Can you please provide a detailed instruction on how to use the code to create the plots or play around with the code? Also, more specifically if wanted to use a dedicated lane for the intelligent vehicle class how can I possibly do so by altering the code?

shanto268 commented 5 years ago

Hi Neal, @NealLiufighting If you were successful in using the code can you please tell me how you did it?

NealLiufighting commented 5 years ago

Hi Neal, @NealLiufighting If you were successful in using the code can you please tell me how you did it?

You must use the right csv， right path and the folder.

shanto268 commented 5 years ago

Hi Neal, @NealLiufighting If you were successful in using the code can you please tell me how you did it?

You must use the right csv， right path and the folder.

Can you please elaborate on that? My experience with MATLAB is fairly limited if you can't already tell. And thank you so much for replying!