Let us assume two cases(Case 1 & Case 2) for the training D4PG agent in a custom Gym environment.
It is expected that when the training episodes increase the training time should increase and maintain the steps per second as constant.
But, it's not happening in my case when Increase the training episode count the training time increases (as known), and steps per second is also getting decreased drastically.
Could you explain why this is that? and is there any workaround to maintain the constant steps per second?
Case 1:
Training episode = 1000
Steps in each episode = 60
Steps per second = 200 to 250
Case 2:
Training episode = 100000
Steps in each episode = 60
Steps per second = 30 to 40
Hello,
Let us assume two cases(Case 1 & Case 2) for the training D4PG agent in a custom Gym environment. It is expected that when the training episodes increase the training time should increase and maintain the steps per second as constant.
But, it's not happening in my case when Increase the training episode count the training time increases (as known), and steps per second is also getting decreased drastically.
Could you explain why this is that? and is there any workaround to maintain the constant steps per second?
Case 1: Training episode = 1000 Steps in each episode = 60 Steps per second = 200 to 250
Case 2: Training episode = 100000 Steps in each episode = 60 Steps per second = 30 to 40