Feature/time varying policy

[blakeelias]

Policy changes as a function of both time horizon and frequency of interventions possible.

With population 20 and discount factor 0.99 per time step, when interventions happen every 1 time step (i.e. 4 days):

Horizon = 24 time steps (i.e. 72 days):

Horizon = 48:

Horizon = 72:

Horizon = 96 (i.e. 384 days):

By comparison, when interventions happen every 8 time steps (i.e. once per 32 days):

Horizon = 24:

Horizon = 48:

Horizon = 72:

Horizon = 96:

[blakeelias]

When discount factor is set to 1.0:

Actions every 1 time step: Horizon 24:

Horizon 36:

Horizon 48:

Horizon 72:

Horizon 96:

When actions take place every 8 time steps (i.e. 32 days): Horizon 24:

Horizon 36:

Horizon 48:

Horizon 72:

Horizon 96: