toybox-rs / Toybox

The Machine Learning Toybox for testing the behavior of autonomous agents.
http://toybox.rs
27 stars 12 forks source link

Gypsum Framerates are low (specifically breakout) #110

Closed jjfiv closed 5 years ago

jjfiv commented 5 years ago

Now it's taking 4-5x as long to train, per Emma's notifications.

However, local benchmarking on my Macbook Air seems fine.

toybox-breakout-FPS:
     133577.4752
    4012.9850
ale-breakout-FPS:
     24010.6762
     697.8181
GYM: breakout-toybox-FPS:
     7078.8343
     138.1617
Slowdown: 0.9470
GYM: breakout-ALE-FPS:
     1649.5937
     19.9729
Slowdown: 0.9313

With my homebrew'd python3.6:

./start_python --version
PYTHONPATH /Users/jfoley/code/toybox/ctoybox/baselines:/Users/jfoley/code/toybox/ctoybox/toybox:
LD_LIBRARY_PATH :/Users/jfoley/code/toybox/ctoybox/../target/release
LIBCTOYBOX /Users/jfoley/code/toybox/ctoybox/..
Python 3.6.5
etosch commented 5 years ago

Update: this seems to be from a change in slurm settings. Closing because it's not our fault.

kclary commented 4 years ago

Did we ever figure out the problem? I am having similar fps issues with the Rogue environment wrapper experiments