jianda-chen / static_dynamic_rl_pruning

7 stars 2 forks source link

Some questions about actor_optimizer and static_actor_optimizer in code #1

Open Liuyang829 opened 3 years ago

Liuyang829 commented 3 years ago

Thanks for your great work! But I find some questions about actor_optimizer, static_actor_optimizer in train_ppo_fbs_static_dynamic.py line 611. Maybe you forgot to define these two optimizers so the code cannot be run, and I want to know the details of optimization schedules.

jianda-chen commented 3 years ago

Thanks for your comment. There are two missing lines in this file.

actor_optimizer = optim.Adam(gaussian_actor.parameters(), lr=1e-6)
static_actor_optimizer = optim.Adam(static_actor.parameters(), lr=1e-6)

I will update the codes.