search

matthias-weissenbacher / KFC

Koopman Q-learning: Offline Reinforcement Learning via Symmetries of Dynamics.
20 stars 1 forks source link

Could I know the version of dependency package, such as mujoco、mujoco_py、d4rl、python， #1

Closed zc645080234 closed 1 year ago

zc645080234 commented 1 year ago

I hardly prepare this environment to run .py

matthias-weissenbacher commented 1 year ago

Hi,

Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujoco_py、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14

Best, Matthias

………………………………………………………………………

Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP)

Researcher in Machine Learning & Artificial Intelligence

@.***

………………………………………………………………………

On Jul 24, 2023, at 20:01, Zhong Chen @.***> wrote:

I hardly prepare this environment to run .py

— Reply to this email directly, view it on GitHub https://github.com/matthias-weissenbacher/KFC/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

zc645080234 commented 1 year ago

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujoco_py、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @. ……………………………………………………………………… … On Jul 24, 2023, at 20:01, Zhong Chen @.> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I very appreciate your quick reply, how about gym？ Maybe version conflict, I cannot find a name of environment that gym.make(env) and d4rl.get_dataset(env) both could be runned For examples, gym.error.NameNotFound: Environment door-cloned doesn't exist. (gym.make(env)) AttributeError: 'HalfCheetahEnv' object has no attribute 'get_dataset' (d4rl.get_dataset(env))

zc645080234 commented 1 year ago

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujocopy、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @.*** ……………………………………………………………………… … On Jul 24, 2023, at 20:01, Zhong Chen @_.***> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I very appreciate your quick reply, how about gym？ Maybe version conflict, I cannot find a name of environment that gym.make(env) and d4rl.get_dataset(env) both could be runned For examples, gym.error.NameNotFound: Environment door-cloned doesn't exist. (gym.make(env)) AttributeError: 'HalfCheetahEnv' object has no attribute 'get_dataset' (d4rl.get_dataset(env))

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujoco_py、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @. ……………………………………………………………………… … On Jul 24, 2023, at 20:01, Zhong Chen @.> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

NuvoleY commented 1 year ago

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujocopy、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @.*** ……………………………………………………………………… … On Jul 24, 2023, at 20:01, Zhong Chen @_.***> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I very appreciate your quick reply, how about gym？ Maybe version conflict, I cannot find a name of environment that gym.make(env) and d4rl.get_dataset(env) both could be runned For examples, gym.error.NameNotFound: Environment door-cloned doesn't exist. (gym.make(env)) AttributeError: 'HalfCheetahEnv' object has no attribute 'get_dataset' (d4rl.get_dataset(env))

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujocopy、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @.*** ……………………………………………………………………… … On Jul 24, 2023, at 20:01, Zhong Chen @_.***> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

I have the same problem 'AttributeError: 'Walker2dEnv' object has no attribute 'get_dataset'',can you tell me how to solve it？Thank you!

matthias-weissenbacher commented 1 year ago

_'Walker2dEnv' object has no attribute 'getdataset''

That suggests that d4rl is not set up correctly. However this is not to be an issue related to our code but to get d4rl + mujoco up and running.

matthias-weissenbacher commented 9 months ago

There are some version problems with d4rl with newer python, mujoco, lincese etc. below e-mail exchange was about this...

………………………………………………………………………

Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP)

Researcher in Machine Learning & Artificial Intelligence

@.***

………………………………………………………………………

On Oct 27, 2023, at 10:12, Yao @.***> wrote:

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujoco_py、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @. ……………………………………………………………………… … <x-msg://11/#> On Jul 24, 2023, at 20:01, Zhong Chen @.> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1 https://github.com/matthias-weissenbacher/KFC/issues/1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I very appreciate your quick reply, how about gym？ Maybe version conflict, I cannot find a name of environment that gym.make(env) and d4rl.get_dataset(env) both could be runned For examples, gym.error.NameNotFound: Environment door-cloned doesn't exist. (gym.make(env)) AttributeError: 'HalfCheetahEnv' object has no attribute 'get_dataset' (d4rl.get_dataset(env))

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

Hi, Yes indeed there are problems with getting d4rl, mujoco to run recently. However, the KFC implementation should be quite flexible regarding such as mujoco、mujoco_py、d4rl、versions. For python I was using Python 3.9.10. ( There may be constraint to the underlying SAC, please have a look a the dependency requirements in there reference I provide ) d4rl==1.1 mujoco==2.2.1 mujoco-py == 2.1.2.14 Best, Matthias ……………………………………………………………………… Matthias Weissenbacher Ph.D. RIKEN Center for Advanced Intelligence Project (AIP) Researcher in Machine Learning & Artificial Intelligence @. ……………………………………………………………………… … <x-msg://11/#> On Jul 24, 2023, at 20:01, Zhong Chen @.> wrote: I hardly prepare this environment to run .py — Reply to this email directly, view it on GitHub <#1 https://github.com/matthias-weissenbacher/KFC/issues/1>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI https://github.com/notifications/unsubscribe-auth/ASPE2UCIIZR4MOX4K3W3AOTXRZIXZANCNFSM6AAAAAA2VNAMLI. You are receiving this because you are subscribed to this thread.

I get the reason, because of the version conflicts and dependency version. Thank you very much, I am going to reproduce your paper results.

I have the same problem 'AttributeError: 'Walker2dEnv' object has no attribute 'get_dataset'',can you tell me how to solve it？Thank you!

— Reply to this email directly, view it on GitHub https://github.com/matthias-weissenbacher/KFC/issues/1#issuecomment-1782140736, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASPE2UGYINLNP3RHEBJDAOLYBMDADAVCNFSM6AAAAAA2VNAMLKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOBSGE2DANZTGY. You are receiving this because you commented.