flow-project / flow

Computational framework for reinforcement learning in traffic control
MIT License
1.08k stars 376 forks source link

stable_baselines folder/library- what is it and where is it? #878

Open veredhalperin opened 4 years ago

veredhalperin commented 4 years ago

hi in the examples/train.py I see from stable_baselines.common.vec_env import DummyVecEnv, SubprocVecEnv from stable_baselines import PPO2 but don't see any stable_baselines folder or stable_baselines library in flow's enviroment so I receive an error that it doesn't find stable_baselines what is it and how should I add it?

eugenevinitsky commented 4 years ago

sorry about that. pip install stable-baselines should do the trick

veredhalperin commented 4 years ago

thanks, now the code fails about something else in ray library: ray/rllib/utils/framework.py", line 71, in decorator return tf_module.function(func) AttributeError: module 'tensorflow' has no attribute 'function'

do you manage to run this code? the examples part was different 2 month ago and I was able to run it, now I tried to run the new version and it failed, It seems like there are many changes

eugenevinitsky commented 4 years ago

Can you confirm what you tensorflow and ray version were then vs. now?

veredhalperin commented 4 years ago

No because I switched computer, so I re-installed everything needed for flow The old version that worked was totally different though, without stable baslines. I think the code written in the current version doesnt match the current versions in flow env of tensorflow etc.

בתאריך יום ה׳, 19 במרץ 2020, 23:06, מאת Eugene Vinitsky ‏< notifications@github.com>:

Can you confirm what you tensorflow and ray version were then vs. now?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/flow-project/flow/issues/878#issuecomment-601416642, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2FF6N3UTLPG5QWP3NTFNTRIKCMHANCNFSM4LPOAPJA .

veredhalperin commented 4 years ago

Can you tell me what is the tf version that you have so I'll install it?

בתאריך יום ה׳, 19 במרץ 2020, 23:06, מאת Eugene Vinitsky ‏< notifications@github.com>:

Can you confirm what you tensorflow and ray version were then vs. now?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/flow-project/flow/issues/878#issuecomment-601416642, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2FF6N3UTLPG5QWP3NTFNTRIKCMHANCNFSM4LPOAPJA .