6.2-exam3-2007-b¶
Quiz 3, 2007 · Section 6.2: Diagonalizing a Matrix Source: exam3_1.pdf, p. 117
Problem¶
Problem 4 (25 points)
(a) Find the steady state for the Markov matrix \(A = \begin{bmatrix} 0.2 & 0.4 & 0.3 \\ 0.4 & 0.2 & 0.3 \\ 0.4 & 0.4 & 0.4 \end{bmatrix}\).
(b) Calculate the limit of \(A^n \begin{bmatrix} 0 \\ 20 \\ 0 \end{bmatrix}\) as \(n \to \infty\).
Solution
(a) The steady state is the eigenvector corresponding to the eigenvalue 1. As a convention, we take it so that the sum of the components is 1. To find it, we need to look at the nullspace of the matrix \(A - I = \begin{bmatrix} -0.8 & 0.4 & 0.3 \\ 0.4 & -0.8 & 0.3 \\ 0.4 & 0.4 & -0.6 \end{bmatrix}\). The steady state is \(\begin{bmatrix} 0.3 \\ 0.3 \\ 0.4 \end{bmatrix}\). (b) The limit of \(A^n \begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix}\) as \(n \to \infty\) is the steady state, so the limit of \(A^n \begin{bmatrix} 0 \\ 20 \\ 0 \end{bmatrix}\) as \(n \to \infty\) is \[ 20 \cdot \begin{bmatrix} 0.3 \\ 0.3 \\ 0.4 \end{bmatrix} = \begin{bmatrix} 6 \\ 6 \\ 8 \end{bmatrix}. \]Keywords: Markov matrix, steady state, matrix powers