Skip to content

4.4-exam2-2004

Quiz 2, 2004 · Section 4.4: Orthonormal Bases and Gram-Schmidt Source: exam2_1.pdf, pp. 101-102

Problem

3 (25 pts.)

(a) Use the Gram-Schmidt procedure to find an orthonormal basis of \(C(A)\), where

\[ A = \begin{bmatrix} 1 & 1 & 1 \\ 1 & 1 & -1 \\ 1 & 0 & -1 \\ 1 & 0 & -1 \end{bmatrix}. \]

(b) Find the projection matrix \(P\) for projecting onto \(C(A)\).

(c) Check your answer for \(P\) by computing \(P a_1\), where \(a_1\) is the first column of \(A\).

Solution 3a. The columns of \(A\) are \(a_1 = (1, 1, 1, 1)\), \(a_2 = (1, 1, 0, 0)\), \(a_3 = (1, -1, -1, -1)\). Gram-Schmidt: \[ u_1 = a_1 = (1, 1, 1, 1), \] \[ u_2 = a_2 - \frac{a_2 \cdot u_1}{u_1 \cdot u_1} u_1 = (1, 1, 0, 0) - \frac{2}{4}(1, 1, 1, 1) = \left(\frac{1}{2}, \frac{1}{2}, -\frac{1}{2}, -\frac{1}{2}\right), \] \[ u_3 = a_3 - \frac{a_3 \cdot u_1}{u_1 \cdot u_1} u_1 - \frac{a_3 \cdot u_2}{u_2 \cdot u_2} u_2 = (1, -1, -1, -1) + \frac{1}{2}(1, 1, 1, 1) - \left(\frac{1}{2}, \frac{1}{2}, -\frac{1}{2}, -\frac{1}{2}\right) = (1, -1, 0, 0). \] Normalizing gives an orthonormal basis for \(C(A)\): \[ q_1 = \frac{u_1}{\|u_1\|} = \left(\frac{1}{2}, \frac{1}{2}, \frac{1}{2}, \frac{1}{2}\right), \qquad q_2 = \frac{u_2}{\|u_2\|} = \left(\frac{1}{2}, \frac{1}{2}, -\frac{1}{2}, -\frac{1}{2}\right), \qquad q_3 = \frac{u_3}{\|u_3\|} = \left(\frac{1}{\sqrt{2}}, -\frac{1}{\sqrt{2}}, 0, 0\right). \] 3b. Recall that with the factorization \(A = QR\), the projection matrix \(P = A(A^T A)^{-1} A^T\) becomes \(QQ^T\). Hence \[ P = \begin{bmatrix} \frac{1}{2} & \frac{1}{2} & \frac{1}{\sqrt{2}} \\ \frac{1}{2} & \frac{1}{2} & -\frac{1}{\sqrt{2}} \\ \frac{1}{2} & -\frac{1}{2} & 0 \\ \frac{1}{2} & -\frac{1}{2} & 0 \end{bmatrix} \begin{bmatrix} \frac{1}{2} & \frac{1}{2} & \frac{1}{2} & \frac{1}{2} \\ \frac{1}{2} & \frac{1}{2} & -\frac{1}{2} & -\frac{1}{2} \\ \frac{1}{\sqrt{2}} & -\frac{1}{\sqrt{2}} & 0 & 0 \end{bmatrix} = \begin{bmatrix} 1 & 0 & 0 & 0 \\ 0 & 1 & 0 & 0 \\ 0 & 0 & \frac{1}{2} & \frac{1}{2} \\ 0 & 0 & \frac{1}{2} & \frac{1}{2} \end{bmatrix}. \] 3c. We have \[ P a_1 = \begin{bmatrix} 1 & 0 & 0 & 0 \\ 0 & 1 & 0 & 0 \\ 0 & 0 & \frac{1}{2} & \frac{1}{2} \\ 0 & 0 & \frac{1}{2} & \frac{1}{2} \end{bmatrix} \begin{bmatrix} 1 \\ 1 \\ 1 \\ 1 \end{bmatrix} = \begin{bmatrix} 1 \\ 1 \\ 1 \\ 1 \end{bmatrix} = a_1, \] as expected.

Keywords: Gram-Schmidt, orthonormal basis, projection matrix