Skip to content

4.4-exam2-2006

Quiz 2, 2006 · Section 4.4: Orthonormal Bases and Gram-Schmidt Source: exam2_1.pdf, pp. 132, 140

Problem

3 (9 + 12 + 9 pts.) The Gram-Schmidt method produces orthonormal vectors \(q_1, q_2, q_3\) from independent vectors \(a_1, a_2, a_3\) in \(\mathbb{R}^5\). Put those vectors into the columns of 5 by 3 matrices \(Q\) and \(A\).

(a) Give formulas using \(Q\) and \(A\) for the projection matrices \(P_Q\) and \(P_A\) onto the column spaces of \(Q\) and \(A\).

(b) Is \(P_Q = P_A\) and why? What is \(P_Q\) times \(Q\)? What is \(\det P_Q\)?

(c) Suppose \(a_4\) is a new vector and \(a_1, a_2, a_3, a_4\) are independent. Which of these (if any) is the new Gram-Schmidt vector \(q_4\)? (\(P_A\) and \(P_Q\) from above.) 1. \(\frac{P_Q a_4}{\|P_Q a_4\|}\) 2. \(\frac{a_4 - \frac{a_4^T a_1}{a_1^T a_1} a_1 - \frac{a_4^T a_2}{a_2^T a_2} a_2 - \frac{a_4^T a_3}{a_3^T a_3} a_3}{\|\text{norm of that vector}\|}\) 3. \(\frac{a_4 - P_A a_4}{\|a_4 - P_A a_4\|}\)

Solution 3a. \(P_A = A(A^T A)^{-1} A^T\) and \(P_Q = Q(Q^T Q)^{-1} Q^T = QQ^T\). 3b. \(P_A = P_Q\) because both projections project onto the same subspace (the column space of \(Q\) equals the column space of \(A\)). Also \(P_Q Q = Q\). The determinant of \(P_Q\) is zero, because \(P_Q\) is singular (like all non-identity projections): every vector orthogonal to the column space of \(Q\) is projected to 0. 3c. Answer: choice 3. (Choice 2 is tempting, and would be correct if the \(a_i\) were replaced by the \(q_i\). But the \(a_i\) are not orthogonal!)

Keywords: Gram-Schmidt, projection matrix, column space, orthonormal vectors