geraintpalmer / TruncatingInfiniteMarkovChains

0 stars 0 forks source link

Decide how to use the hitting probabilities to decide if the bound is good #4

Open MichalisPanayides opened 2 years ago

geraintpalmer commented 2 years ago

IMG_20220626_104612_793


Note that $\max+{i \in R} \left( h_{iB} \right)$ does not actually take a max, as the states are ordered, it's the hitting probability from the 'highest' state in the reasonable region.

geraintpalmer commented 2 years ago

What about in more than one dimension? Then there is more than one boundary state (e.g. (1, B), (2, B), ... (B-1, B), (B, B)). Let $\tilde{B}$ denote the set of boundary states.

Do we: