instadeepai / Mava

🦁 A research-friendly codebase for fast experimentation of multi-agent reinforcement learning in JAX
Apache License 2.0
709 stars 83 forks source link

Feat/add marl eval json logger #950

Closed RuanJohn closed 10 months ago

RuanJohn commented 10 months ago

What?

A json logger that writes data in json files in the format that is expected for downstream use by marl-eval. This logger is adapted from the one found in BenchMARL.

Extra

Right now, this logger will write separate json files for each experiment ie. different seed, environment, task combinations will be in different json files in different directories by default. This is on purpose due to the fact that we often times run distributed experiments. A suggestion for now is that we write a helper function that can take in paths to multiple json files and combine them into one. In the case where experiments will be run on the same machine, a path can be set in the experiment config which will allow all experiments to write a single json file.