13 3 6 Points Problem 4 1 Given Following Four Markov Chains 2 3 4 5 States Respectively I Q37204469

13+3-6 points] Problem 4 if the 1) Given the following four Markov chains with 2, 3, 4, 5 states respectively, identify if the single is periodic or not. Direated recurrent class in each Markov chain is periodic or not. Directed arrows mean transition probability greater than zero. S1 S2 S1 S1 S2 S1 S2 S5 S3 S3 S2 S4 S4 2 Now assume that you are given a N-state Markov chain, in which each

OR

 

OR