Problem Set B
1. Vector Spaces and Subspaces
(1) We can see that 0 = 0 for all , as follows:
0 = (0 + 0) =0 +0
Now we want to “cancel out” the 0 on the right side. Since we can’t divide vectors, we use
additive inverses instead.
So add − 0 to both sides of the equation, i.e.
0 + (−0 ) = (0 +0 ) + (− 0 )
The left side becomes 0 + (−0 ) = 0 (because − 0 is the additive inverse of 0 ).
The right side uses associativity:
(0 + 0 ) + (− 0 ) = 0 + (0 + (− 0 )) = 0 + 0 = 0
So we end up with 0 = 0 for any vector .
Now, prove that (−1) =− , the negative of the vector , using a similar argument with
0 = 1 + (−1).
2
(2) A line in ℝ
Let
2
𝑊 = {(𝑥, 𝑦) ∈ ℝ : 𝑦 = 0}
(a) Does 𝑊 contain the 0 vector?
(b) Is it closed under addition?
(c) Is it closed under scalar multiplication?
2
(d) Is 𝑊 a subspace of ℝ ?
2
(3) For each set below, decide whether it is a subspace of ℝ . Give a short reason (e.g.
“closed under addition”, “not containing 0”, etc.)
(a) 𝑆1 = {(𝑥, 𝑦): 𝑦 = 0}
(b) 𝑆2 = {(𝑥, 𝑦): 𝑥 = 1}
(c) 𝑆3 = {(𝑥, 𝑦): 𝑥 = 2𝑦}
(d) 𝑆1 = {(0, 0)}
(3) Let
2
𝑆 = {(𝑥, 𝑦) ∈ ℝ : 𝑥 = 1}
(e) Does 𝑆 contain the 0 vector?
(f) Is it closed under addition?
(g) Is it closed under scalar multiplication?
2
(h) Is 𝑆 a subspace of ℝ ?
Hint: what happens when you add two vectors from 𝑆?
(4) Let
3
𝑃 = {(𝑥, 𝑦, 𝑧) ∈ ℝ : 𝑥 + 𝑦 + 𝑧 = 0}
(i) Does 𝑃 contain the 0 vector?
(j) Is it closed under addition?
(k) Is it closed under scalar multiplication?
3
(l) Is 𝑃 a subspace of ℝ ?
Hint: verify the defining equation for the sum and scalar multiples.
(5) Let
𝑇 = {(1, 0, 0)}
3
Is 𝑇 a subspace of ℝ ? Why or why not?
Hint: Think about the zero vector and closure.
2. Span, Independence, and Basis
(1) Show that, for any vector in a vector space 𝑉 , the set of vectors { , 0} is linearly
dependent.
(2) Proof that has rank 3.
3
(3) Which of these sets is a basis of ℝ ?
3 3
Show that one of these sets is a basis of ℝ and that the other one spans a plane in ℝ .
Find a basis for this plane. Then find a Cartesian equation for the plane.
(4) Find the coordinates of the vector (expressed in standard coordinates) with
respect to the basis:
3. Eigenvalue & Eigenvector
(1) Find eigenvalues and eigenvectors for:
(a) and its square (b) (c)
(d) (e) (f) (g)
[Link]
Kuttler)/07%3A_Spectral_Theory/7.01%3A_Eigenvalues_and_Eigenvectors_of_a_Matrix
Can you also comment on the sign definiteness of the above matrices?
(2) Find the critical values for the following equations. Also comment on the nature of the
turning points (critical points) with the Hessian.
2 2
(a) 𝑓(𝑥, 𝑦) =− 𝑥 − 𝑥𝑦 − 3𝑦 + 6𝑥 + 8𝑦 + 10
2 2
(b) 𝑓(𝑥, 𝑦) = 𝑥 + 𝑥𝑦 + 2𝑦 − 4𝑥 − 2𝑦 + 5
2 2
(c) 𝑓(𝑥, 𝑦) = 𝑥 − 𝑦 + 4𝑥 − 6𝑦
2 2 2
(d) 𝑓(𝑥, 𝑦, 𝑧) =− 2𝑥 − 𝑦 − 𝑧 − 2𝑥𝑦 − 𝑥𝑧 + 4𝑥 + 2𝑦 + 3𝑧 + 5
2 2 2
(e) 𝑓(𝑥, 𝑦, 𝑧) = 2𝑥 + 3𝑦 − 5𝑥𝑧 + 2𝑥𝑦 − 6𝑥 − 9𝑦 − 12𝑧
(3) Find eigenvalues for (a) to (c) in (2) above, and determine the sign definiteness of the
Hessian agree with your answers above.
−1
(4) For the matrix find a nonsingular matrix P such that 𝐷 = 𝑃 𝐷𝑃 is
diagonal.
(5) For matrix find the eigenvalues and corresponding eigenvectors.
Also show that this symmetric matrix A is positive semidefinite. Lastly, decompose
−1
𝐴 = 𝑃𝐷𝑃 and find A5.
(6) Is the matrix diagonalizable? How about ? What do you
observe about these matrices?
4. Quadratic Forms
(1) Find the quadratic form for the matrix and show that it is positive definite.
How about the matrix ?
(2) For the triangular matrix , determine the sign definiteness by writing its
quadratic form.
(3) Show directly from the definitions of the quadratic form that the symmetric matrix
is positive definite.
5. QR Decomposition
(1) Find a set of orthonormal vectors using the Gram–Schmidt process for the following
vectors in standard form.
(a)
(b)
(c)
6. SVD:
(1) Find the single value decomposition of the following matrices; i.e. find .
(a) (b) (c)
(2) Decompose into 𝐿𝑈.