CPU/GPU/TPU Benchmarks - Githubissues

RobertTLange / gymnax

RL Environments in JAX 🌍

Apache License 2.0

585 stars 54 forks source link

CPU/GPU/TPU Benchmarks #5

Closed RobertTLange closed 2 years ago

RobertTLange commented 3 years ago

Generate benchmarks for runtimes of the different environments and compare with plain NumPy/torch versions.

[ ] Open AI gym control environments
[ ] Behavioral suite environments
[ ] MinAtar environments

RobertTLange commented 2 years ago

I would like to have a set of utilities that automatically generates jobs and schedules them for the different hardware platforms. E.g. CPU/GPU/TPU. This should probably all run on GCP and with docker containers for reproducibility. Have a look pyhpc for benchmarking standards and potentially integrate with mle-toolbox GCP experiment setup.