Open blakeelias opened 3 years ago
one_step_lookahead() in value_iteration.py has become slower, having introduced the dynamic call to env.transitions(state, a) on every iteration, rather than the previous static usage of env.P[state][a].
one_step_lookahead()
value_iteration.py
env.transitions(state, a)
env.P[state][a]
What can be done to speed this up, though?
one_step_lookahead()
invalue_iteration.py
has become slower, having introduced the dynamic call toenv.transitions(state, a)
on every iteration, rather than the previous static usage ofenv.P[state][a]
.