Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
34.14k
stars
5.8k
forks
source link
[rllib] Action space MultiDiscrete([11 5 1 2]) is not supported for DQN #39571
Open
linshuxi opened 1 year ago
What happened + What you expected to happen
I get some error: Action space MultiDiscrete([11 5 1 2]) is not supported for DQN.
Versions / Dependencies
ray: 2.6.3
Reproduction script
from ray.rllib.algorithms.dqn import DQNConfig algo = DQNConfig().framework("torch").environment(env = myenv).multi_agent( policies={ "A":(None, a.observation_space, a.action_space, {"gamma": 0.80}), "B":(None, a.observation_space, a.action_space, {"gamma": 0.80}) }, policy_mapping_fn = lambda agent_id: f"{agent_id}",
).build()
Issue Severity
None