3.5-final-2013-strang¶
Final Exam, 2013 (strang) · Section 3.5: Dimensions of the Four Subspaces Source: finalexam_2.pdf, p. 110
Problem¶
2 (6+6 pts.)
(a) Find bases for all four fundamental subspaces of this \(R\):
\[
R = \begin{bmatrix} 1 & 2 & 0 & 4 \\ 0 & 0 & 1 & 3 \\ 0 & 0 & 0 & 0 \end{bmatrix}
\]
(b) Find \(U\), \(\Sigma\), \(V\) in the Singular Value Decomposition \(A = U\Sigma V^T\):
\[
A = \begin{bmatrix} 2 & 2 \\ -1 & 2 \\ 2 & -1 \end{bmatrix}.
\]
Solution
(a) The pivot columns of \(R\) are columns 1 and 3, so a basis for the column space is \[ \left\{ \begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}, \begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix} \right\}. \] The free variables are \(x_2\) and \(x_4\). Setting \(x_2 = 1, x_4 = 0\) gives \(x_1 = -2, x_3 = 0\); setting \(x_2 = 0, x_4 = 1\) gives \(x_3 = -3, x_1 = -4\). A basis for the right nullspace is \[ \left\{ \begin{bmatrix} -2 \\ 1 \\ 0 \\ 0 \end{bmatrix}, \begin{bmatrix} -4 \\ 0 \\ -3 \\ 1 \end{bmatrix} \right\}. \] The nonzero rows of \(R\) span the row space: \[ \left\{ \begin{bmatrix} 1 \\ 2 \\ 0 \\ 4 \end{bmatrix}, \begin{bmatrix} 0 \\ 0 \\ 1 \\ 3 \end{bmatrix} \right\}. \] The left nullspace \(N(R^T) \subset \mathbb{R}^3\) is spanned by the vector that eliminates the zero row, i.e. the third standard vector: \[ \left\{ \begin{bmatrix} 0 \\ 0 \\ 1 \end{bmatrix} \right\}. \] (b) Compute \(A^T A\): the columns of \(A\) are orthogonal, each of length \(\sqrt{4 + 1 + 4} = 3\), so \[ A^T A = V \Sigma^T \Sigma V^T = \begin{bmatrix} 9 & 0 \\ 0 & 9 \end{bmatrix}. \] Thus we may take \[ V = \begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix}, \qquad \Sigma = \begin{bmatrix} 3 & 0 \\ 0 & 3 \\ 0 & 0 \end{bmatrix}. \] Then \(3u_1 = A \begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} 2 \\ -1 \\ 2 \end{bmatrix}\) and \(3u_2 = A \begin{bmatrix} 0 \\ 1 \end{bmatrix} = \begin{bmatrix} 2 \\ 2 \\ -1 \end{bmatrix}\), so \[ u_1 = \begin{bmatrix} 2/3 \\ -1/3 \\ 2/3 \end{bmatrix}, \qquad u_2 = \begin{bmatrix} 2/3 \\ 2/3 \\ -1/3 \end{bmatrix}. \] A unit vector \(u_3\) orthogonal to both is their cross product: \[ u_3 = \begin{bmatrix} -1/3 \\ 2/3 \\ 2/3 \end{bmatrix}, \] and \[ U = \begin{bmatrix} 2/3 & 2/3 & -1/3 \\ -1/3 & 2/3 & 2/3 \\ 2/3 & -1/3 & 2/3 \end{bmatrix}. \]Keywords: four fundamental subspaces, basis, SVD, singular value decomposition