# a theorem on transient and recurrent state in a DTMC

Is the following statement true:

In a finite Markov chain, if $i$ is a transient state then there is at least one recurrent state $j$ such that $j$ is reachable from $i$.

-

## 2 Answers

I'm not sure if your looking for an algebraic proof, but intuitively I was thinking:

Assume your finite state space is $S = \{1, 2, ... , n\}$. Let $X_i$ denote the state you are in for all $i \in S$.The basic form of a transient "map" would be when

$$X_1 \rightarrow X_2 \rightarrow X_3 \rightarrow ... \rightarrow X_i$$

It is possible that $i = n$. Now when you reach state $i$, you have two options. Either move to another state, or remain in state $i$. There is no option of "nothing happening" in state $i$ as this would just be that you remain in state $i$, i.e the probability of going from $i \rightarrow i = 1$.

Looking at option $1$, if you go from $X_i$ to some other state $X_j$, you have just created a recurrance class between states $X_i$ and $X_j$ and so you have gone from a transient state (say $X_1$) to a recurrant state ($X_i$ or $X_j$).

Looking at option 2, if $X_i \rightarrow X_i$, then clearly state $i$ is recurrant and again, you have gone from a transient state to a recurrant state.

So I think your statement is correct.

-

Yes, for any finite state Markov Chain its state space admits the following Doeblin decomposition $$S = \sum_{i=1}^n H_i+E$$ where sets $H_i$ are absorbing and recurrent, and $E$ is a set of all transient states. In particular it means that $E$ does not have an absorbing subset and for any $x\in E$ there is $1\leq i\leq n$ such that $H_i$ is reachable from $x$. Since $H_i$ is recurrent, each state of it is reachable from $x$.

This answers your question, however if you will be more precise what is your background on Markov Chains, I could provide an answer that may fir you better.

-
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 32, "mathjax_display_tex": 2, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "github"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "english_confidence": 0.957102358341217, "perplexity_flag": "head"}