ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
34.14k stars 5.8k forks source link

[rllib] Action space MultiDiscrete([11 5 1 2]) is not supported for DQN #39571

Open linshuxi opened 1 year ago

linshuxi commented 1 year ago

What happened + What you expected to happen

I get some error: Action space MultiDiscrete([11 5 1 2]) is not supported for DQN.

Versions / Dependencies

ray: 2.6.3

Reproduction script

from ray.rllib.algorithms.dqn import DQNConfig algo = DQNConfig().framework("torch").environment(env = myenv).multi_agent( policies={ "A":(None, a.observation_space, a.action_space, {"gamma": 0.80}), "B":(None, a.observation_space, a.action_space, {"gamma": 0.80}) }, policy_mapping_fn = lambda agent_id: f"{agent_id}",

).build()

Issue Severity

None

ChenJiangxi commented 7 months ago

I am experiencing the same problem. May I ask how you solved it?