Skip to content

7.1-exam3-2014-strang

Exam III, 2014 (strang) · Section 7.1: Singular Values and Singular Vectors Source: exam3_2.pdf, pp. 93, 99

Problem

4. (24 points)

(a) Show that none of the singular values of \(A\) are larger than 3.

\[ A = \begin{bmatrix} 1 & 1 & 1 \\ 0 & 1 & 1 \\ 0 & 0 & 1 \end{bmatrix}. \]

(b) Why does \(B = AQ\) have the same singular values as \(A\)? (\(Q\) is an orthogonal matrix.)

Solution (a) We compute \[ A^TA = \begin{bmatrix} 1 & 1 & 1 \\ 1 & 2 & 2 \\ 1 & 2 & 3 \end{bmatrix}. \] Hence, \(\operatorname{tr}(A^TA) = 6\). However, \(A^TA\) is positive semidefinite, therefore all the eigenvalues are nonnegative. This implies that \(0 \le \lambda_i \le 6\), and hence that \(\sigma_i \le \sqrt{6} \le 3\). (b) Since \(B^TB = Q^TA^TAQ\), the matrices \(B^TB\) and \(A^TA\) are similar. This implies that they have the same eigenvalues, and therefore that \(B\) and \(A\) have the same singular values, \(\sigma_i = \sqrt{\lambda_i}\).

Keywords: singular values, positive semidefinite, trace, eigenvalues, orthogonal matrix