search

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.34k stars 5.65k forks source link

[rllib] assert seq lens is not None! #16500

Closed zzchuman closed 1 year ago

zzchuman commented 3 years ago

Hello @sven1977 !

python 3.7.6 torch 1.9.0 ray 1.4.0 and 1.0.0

In my code, I set the 9 PPO agent. The agent set is:

image

And I sure that it works without lstm setting. But when I add the lstm, It occours: image

It reminds me that assert seq lens is not None! But I do not know how to set it!

Thank you!

Summer142857 commented 3 years ago

I have to say that I have the same problem.

domagojhack commented 2 years ago

Any news with this, I am reproducing the same problem with A3C