Some environments were still using splib not splib3. The changes I made:
Changed splib to splib3
Removed realTimeClock as it is no more used in splib3
The other issue was the observation returned from reset(). Some envs were returning it as a list. I modified them to return a numpy array instead for consistency and to avoid any future problems with other RL libraries or frameworks that could be used.
Some environments were still using splib not splib3. The changes I made:
realTimeClockas it is no more used in splib3The other issue was the observation returned from
reset(). Some envs were returning it as a list. I modified them to return a numpy array instead for consistency and to avoid any future problems with other RL libraries or frameworks that could be used.