Open Astik-2002 opened 1 month ago
Also, DQN was unable to stabilize the trajectory after training for 100 epochs. is it expected? The final output of training DQN is pinned below
https://github.com/user-attachments/assets/1182ced0-1237-417c-8bb7-010b4907348d
Hi @Astik-2002 , Thanks for raising the issue. Regarding your first comment: That error occurs because the SAC uses StableBaselines3 and that expects the gym library while the training environment was migrated to the more modern gymnasium. I will check if/how StableBaselines3 can be used with gymnasium. Regarding your second comment: Yes that is expected. The DQN implementation discretizes the state space produces only a subpar policy.
Thanks for the comment. I'm facing issues understanding how the competition is going to be judged. Most controllers in literature used to stabilize acrobot or pendubot are already implemented in the realistic examples. But since they require significant parameter optimization, can a working controller from examples be submitted to the leader board, Even if it's not a new controller?
Hi @Astik-2002 , yes it is allowed to submit a modified controller from the leaderboard with tuned parameters, another filtering method, etc.
while training sac, the following error occured