search

instadeepai / marl-eval

A tool for aggregating and plotting MARL experiment data.
https://sites.google.com/view/marl-standard-protocol/home
Apache License 2.0
61 stars 6 forks source link

fix: unique file names and squashed neptune stdout #57

Closed JemmaLDaniel closed 8 months ago

JemmaLDaniel commented 8 months ago

What?

  1. Neptune was printing extra lines between tqdm progress bar updates, which has been suppressed so the progress bar displays as expected.
  2. Where different runs are finishing at the same time, data_key is not unique. This causes two JSON files to be stored in one folder with the same data_key name and messes up plotting downstream. This has been fixed so that each JSON file is stored in a unique folder.

    Why?

  3. Prettier prints and easier to read.
  4. JSON files are downloaded as marl-eval's concatenating and plotting tools require.

    How?

  5. During the download phase, set Neptune to only log messages at an error level or higher (i.e., we don't want the extra info).
  6. Append a counter to each file name before creating the directory for the JSON file.