submit-paper / Danzero_plus

31 stars 6 forks source link

Can you come up with a detailed README file, I don't really understand this docker configuration you have now #7

Open Cyclones-Y opened 8 months ago

Cyclones-Y commented 8 months ago

Forgive my ignorance. I didn't quite understand the configuration of the program

  1. Start two dockers in learnring and action respectively? and then populate action.py with the docker IP address for learning?
  2. Why do you need to start so many ip addresses in your create_container.sh?
  3. Maybe you're busy right now, but I'd appreciate it if you could come up with a detailed README file!
submit-paper commented 8 months ago

Well, as we adopt distributed reinforcement learning, we start actors and learner in different dockers. In this way, the actors only use the CPUs while the learner adopts the GPU for training. Each actor is in its own docker and equipped with its IP address for data transportation and model synchronization. In this way, many ip addresses are needed if you want to run multiple actors for higher efficiency. This is also due to that the gamecore we use is of low efficiency so we have to use multiple actors.

Cyclones-Y commented 8 months ago

Well, as we adopt distributed reinforcement learning, we start actors and learner in different dockers. In this way, the actors only use the CPUs while the learner adopts the GPU for training. Each actor is in its own docker and equipped with its IP address for data transportation and model synchronization. In this way, many ip addresses are needed if you want to run multiple actors for higher efficiency. This is also due to that the gamecore we use is of low efficiency so we have to use multiple actors.

Thanks a lot for your answer, that means I only need to open different docker containers on one machine to deploy your project right?

submit-paper commented 8 months ago

Yes, but you have to use docker network to assign ip for each docker.