instadeepai / jumanji

🕹️ A diverse suite of scalable reinforcement learning environments in JAX
https://instadeepai.github.io/jumanji
Apache License 2.0
613 stars 78 forks source link

feat(training): multi-worker training #164

Closed clement-bonnet closed 1 year ago

clement-bonnet commented 1 year ago
clement-bonnet commented 1 year ago

CPU image

TPU v4-8 image

TPU v4-16 image

TPU v4-16 is indeed twice as fast ("steps per second" metric) as TPU v4-8.