search

chandar-lab / Recall2Imagine

Recall to Imagine, a model-based RL algorithm with superhuman memory. Oral (1.2%) @ ICLR 2024
https://recall2imagine.github.io/
MIT License
47 stars 5 forks source link

Getting raw data for plots #7

Open LYK-love opened 5 months ago

LYK-love commented 5 months ago

Hello, I wonder how can we get/generate the scores from the experiments of r2i. In the code, I saw the JSON logger writing to two files: 'metrics.jsonl' and 'scores.jsonl'. Neither of them has the same content format as the .json files under ./score in original DreamerV3 code, where each uncompressed .json file has the format:

task": "atari_battle_zone",
        "method": "dreamerv3",
        "seed": "3",
        "xs": [ ...],
        "ys": [ ...],

I'm trying to reproduce the results of r2i and am currently trying to plotting the performance curve. Thanks for your help!

artemZholus commented 5 months ago

Hi @LYK-love . We did all the logging for our work in wandb so I can export them and upload to our repo within the same format as DreamerV3 did. I will do that in a day or two.