LucasAlegre / morl-baselines

Multi-Objective Reinforcement Learning algorithms implementations.
https://lucasalegre.github.io/morl-baselines
MIT License
295 stars 47 forks source link

Feature/benchmarking scripts #41

Closed ffelten closed 1 year ago

ffelten commented 1 year ago

Relates to #12

Wishlist:

Example plot generated using this query on openrlbenchmark CLI:

 python -m openrlbenchmark.rlops \
    --filters '?we=openrlbenchmark&wpn=MORL-Baselines&ceik=env_id&cen=algo&metric=eval/eum' \
        'PCN' \
        'MultiPolicy MO Q-Learning' \
        'Envelope' \
    --env-ids deep-sea-treasure-v0 deep-sea-treasure-concave-v0 \
    --ncols 2 \
    --ncols-legend 1 \
    --output-filename compare.png \
    --report \
    --scan-history

image

ffelten commented 1 year ago

@LucasAlegre very much a WIP but I think it might look like this in the end if we stick to the default hyperparameters. What do you think?