4.3-exam2-2000¶
Quiz 2, 2000 · Section 4.3: Least Squares Approximations Source: exam2_1.pdf, pp. 42, 45
Problem¶
2 (24 pts.) (a) Fitting the best (least squares) straight line through the points \((t, b) = (2, 3), (3, 5)\), and \((4, K)\) is the same as solving what system of equations \(Ax = b\) by least squares? Is there any value of \(K\) for which this system \(Ax = b\) has an exact solution?
(b) For general \(A\) and \(b\), under what condition does the equation \(Ax = b\) have \(\bar{x} = 0\) as its least squares solution? In the example of part (a), prove that there is or there isn't a value of \(K\) so that \(\bar{x} = 0\) is the least squares solution.
Solution
2a. \[ \begin{bmatrix} 1 & 2 \\ 1 & 3 \\ 1 & 4 \end{bmatrix} x = \begin{bmatrix} 3 \\ 5 \\ K \end{bmatrix} \] \(Ax = b\) has an exact solution when \(b\) is in the column space. This happens when \(K = 7\). 2b. \(\bar{x} = 0\) is the least squares solution when \(b\) is in the nullspace of \(A^T\). For \(\begin{bmatrix} 3 \\ 5 \\ K \end{bmatrix}\) to be in the nullspace of \(A^T\), \(K\) would have to be \(-8\) (from \(3 + 5 + K = 0\)) and \(-\frac{21}{4}\) (from \(6 + 15 + 4K = 0\)), which is impossible.Keywords: least squares, straight line, column space, left nullspace