search

june6723 / sumo-rl-suwon

Reinforcement learning for traffic signal in suwon
3 stars 3 forks source link

code questions #1

Open zzchuman opened 4 years ago

zzchuman commented 4 years ago

hello june6723! I find your code was inspired by sumo-rl. And I just have some questions!Can you teach me? 1.Whther the code run it once? I have find the num_seconds =100000,it means 100000s?

  1. Do you have a try about running ray withe the GPU?

    wish your reply

june6723 commented 4 years ago

Sorry for late answer

1. num_seconds means that it runs 100000s in sumo sinulator. If you run code, it runs during 'num_seconds' and that is 1 episode. And then ray will reset environment to run another episode

2. No, I have not tried yet. Ray does support gpu but I'm trying to find out how to apply it.

-----Original Message----- From: "zhangzhichao"notifications@github.com To: "june6723/sumo-rl-suwon"sumo-rl-suwon@noreply.github.com; Cc: "Subscribed"subscribed@noreply.github.com; Sent: 2020-05-29 (금) 00:48:12 (GMT+09:00) Subject: [june6723/sumo-rl-suwon] code questions (#1)

hello june6723! I find your code was inspired by sumo-rl. And I just have some questions!Can you teach me? 1.Whther the code run it once? I have find the num_seconds =100000,it means 100000s?

  1. Do you have a try about running ray withe the GPU? wish your reply — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.
zzchuman commented 4 years ago

Thank your reply! Do you have a try to reasearch these problem?

  1. The raw author set the num_seconds =100000, and it runs only one or few episode,right? I find that other github coder always set the num_seconds =3600,and 500 episodes. Do you have a try?
  2. Have you use the MARL algorithms to control the agents?
zzchuman commented 4 years ago

I run your code on my local PC. PIP3 install -e. but image

image Can you teach me hoe to config it?

june6723 commented 4 years ago

oh, I deleted some files and folder of original code ( https://github.com/LucasAlegre/sumo-rl ) I guess that is reason. So i recommend you to download original code and run setup.py of it. Also Ray rllib runs in linux environment!

-----Original Message----- From: "zhangzhichao"notifications@github.com To: "june6723/sumo-rl-suwon"sumo-rl-suwon@noreply.github.com; Cc: "june6723"june6723@naver.com; "Comment"comment@noreply.github.com; Sent: 2020-06-02 (화) 17:26:40 (GMT+09:00) Subject: Re: [june6723/sumo-rl-suwon] code questions (#1)

I run your code on my local PC. PIP3 install -e. but

Can you teach me hoe to config it? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

zzchuman commented 4 years ago

hello, if I want to set the sumoenv and rl env is: num_seconds 3600s, 500 episodes. I have changed the setting about rou.xml and main.py. But, I just can not change the plot.py? Because I can not understand the code of plot.py. So, can you tell me the plot.py function

june6723 commented 4 years ago

sorry i'm late

plot.py is made by lucas. You can check readme file if you want to use that code, but I don't know much about that code.

-----Original Message----- From: "zhangzhichao"notifications@github.com To: "june6723/sumo-rl-suwon"sumo-rl-suwon@noreply.github.com; Cc: "june6723"june6723@naver.com; "Comment"comment@noreply.github.com; Sent: 2020-06-21 (일) 19:30:14 (GMT+09:00) Subject: Re: [june6723/sumo-rl-suwon] code questions (#1)

hello, if I want to set the sumoenv and rl env is: num_seconds 3600s, 500 episodes. I have changed the setting about rou.xml and main.py. But, I just can not change the plot.py? Because I can not understand the code of plot.py. So, can you tell me the plot.py function — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

zzchuman commented 4 years ago

对不起，我来晚了plot.py是lucas制造的。如果要使用该代码，可以检查自述文件，但是我对该代码知之甚少。 … -----Original Message----- From: "zhangzhichao"notifications@github.com To: "june6723/sumo-rl-suwon"sumo-rl-suwon@noreply.github.com; Cc: "june6723"june6723@naver.com; "Comment"comment@noreply.github.com; Sent: 2020-06-21 (일) 19:30:14 (GMT+09:00) Subject: Re: [june6723/sumo-rl-suwon] code questions (#1) hello, if I want to set the sumoenv and rl env is: num_seconds 3600s, 500 episodes. I have changed the setting about rou.xml and main.py. But, I just can not change the plot.py? Because I can not understand the code of plot.py. So, can you tell me the plot.py function — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

Do you know policy maping or policy graphs? I dont konw the cluster id mean.

zzchuman commented 4 years ago

hello, i try to reset the a3c 2x2grid. But, I dont know the space setting. image do you have any advice?