facebookresearch / Pearl

A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.
MIT License
2.7k stars 165 forks source link

NotImplementedError: The Gym space 'Tuple' is not yet supported in Pearl. #54

Open EduardoGarrido90 opened 10 months ago

EduardoGarrido90 commented 10 months ago

Hi there, I am trying to use DeepQLearning to solve the discrete Blackjack Gymnasium environment (Blackjack-v1), where the Observation Space is a tuple, Tuple(Discrete(32), Discrete(11), Discrete(2)), but when I launch Pearl I obtain the following error:

raise NotImplementedError(NotImplementedError: The Gym space 'Tuple' is not yet supported in Pearl.

Do we know when are we going to solve this issue? Lots of environments have tuples, or if there is a quick workaround to make Pearl support this environment.

Thanks,

EduardoGarrido90 commented 10 months ago

Same happens with Atari environments, like airraid: ValueError: Tensor of shape torch.Size([250, 160, 3]) is not supported.

rodrigodesalvobraz commented 6 months ago

We are looking into this, but it will take a while for us to get to it unfortunately. I will update it here when we do.