geraintpalmer / TruncatingInfiniteMarkovChains

0 stars 0 forks source link

Investigate this more #1

Open MichalisPanayides opened 2 years ago

MichalisPanayides commented 2 years ago

Be confident that we understand why this is happening:

image

The red lines (convex) indicate when μ is higher than λ The blue lines (concave) indicate when μ is less than λ

geraintpalmer commented 2 years ago

In investigate_concavity_convexity.ipynb in #5 I wrote:


We can think about this function as the 'acceleration' towards infinity:


I propose also:

geraintpalmer commented 2 years ago

After a chat with @drvinceknight and @11michalis11:

Advantage: much simpler, all we have to do is order the states by $h_{sb}$. Disadvantage: It would be neater to have a separate definition of $d(s)$ is order to help with #4 and defining a 'reasonable region'