Vector Space Theory Lecture Notes
Vector Space Theory Lecture Notes
Prepared by
Dr. Dilawar Juneed Mir
1. Vector Space
Let (F, +, ·) be a field, whose elements are called scalars. Throughout, by a field
F we shall mean one of the standard fields: the rationals Q, the reals R, or the
complex numbers C.
Let V be a nonempty set whose elements are called vectors. Then V is said
to be a vector space over the field F if it satisfies the following postulates:
α+0 = α = 0+α ∀α ∈ V.
α + (−α) = 0 = (−α) + α.
1
B. Under Scalar Multiplication
a(α + β) = aα + aβ.
( a + b)α = aα + bα.
( ab)α = a(bα).
1 · α = α, where 1 ∈ F.
Remarks
2. Illustrative Examples
Solution. The binary operation (+) is commutative and associative, and (0, 0) is
the zero element. The inverse of ( x1 , x2 ) is (− x1 , − x2 ). Hence, (R × R, +) is an
abelian group.
Let
u = ( x1 , x2 ), v = (y1 , y2 ), α, β ∈ R.
2
Now, we verify the vector space axioms:
α ( u + v ) = α ( x1 , x2 ) + ( y1 , y2 )
= α ( x1 + y1 , x2 + y2 )
= (αx1 + αy1 , αx2 + αy2 )
= (αx1 , αx2 ) + (αy1 , αy2 )
= α ( x1 , x2 ) + α ( y1 , y2 )
= αu + αv.
(α + β)u = (α + β)( x1 , x2 )
= ( α + β ) x1 , ( α + β ) x2
= (αx1 + βx1 , αx2 + βx2 )
= (αx1 , αx2 ) + ( βx1 , βx2 )
= α ( x1 , x2 ) + β ( x1 , x2 )
= αu + βu.
α( βu) = α β( x1 , x2 )
= α( βx1 , βx2 )
= (αβx1 , αβx2 )
= (αβ)( x1 , x2 )
= (αβ)u.
1u = 1( x1 , x2 ) = (1x1 , 1x2 ) = ( x1 , x2 ) = u.
Thus, R × R satisfies all the axioms of a vector space.
Example 2. Show that the set M2 (R) of all 2 × 2 matrices is a vector space over R
under matrix addition and scalar multiplication defined by
" # " #
a b αa αb
α = .
c d αc αd
Solution. Addition (+) is a binary operation in the set M2 (R). Associative and
commutative laws hold for (+) in M2 (R).
3
The matrix " #
0 0
∈ M2 (R)
0 0
is the identity element for (+).
The inverse of " #
x1 x2
∈ M2 (R)
x3 x4
is " #
− x1 − x2
∈ M2 (R).
− x3 − x4
Hence, M2 (R) is an abelian group under matrix addition.
Let " # " #
x1 x2 y1 y2
M1 = , M2 = ∈ M2 (R), α, β ∈ R.
x3 x4 y3 y4
Then, " #
x1 + y1 x2 + y2
α( M1 + M2 ) = α
x3 + y3 x4 + y4
" #
α ( x1 + y1 ) α ( x2 + y2 )
=
α ( x3 + y3 ) α ( x4 + y4 )
" # " #
αx1 αx2 αy1 αy2
= +
αx3 αx4 αy3 αy4
= αM1 + αM2 .
Also, " #
( α + β ) x1 ( α + β ) x2
(α + β) M1 =
( α + β ) x3 ( α + β ) x4
" #
αx1 + βx1 αx2 + βx2
=
αx3 + βx3 αx4 + βx4
= αM1 + βM1 .
4
Next, " #
βx1 βx2
α( βM1 ) = α
βx3 βx4
" #
αβx1 αβx2
=
αβx3 αβx4
= (αβ) M1 .
Finally, " # " #
x1 x2 x1 x2
1 · M1 = 1 · = = M1 .
x3 x4 x3 x4
Hence, the set M2 (R) of all 2 × 2 matrices is a vector space over R under
addition and scalar multiplication.
√
Example 3. Prove that V = { a + ib : a, b ∈ R, i = −1} is a vector space
over reals under usual addition and scalar multiplication of complex numbers.
Solution: Let
V = { a + ib : a, b ∈ R}
with usual addition and real scalar multiplication defined by
z1 + z2 = ( a + c ) + i ( b + d ),
z1 + z2 = ( a + c ) + i ( b + d ) = ( c + a ) + i ( d + b ) = z2 + z1 ,
using commutativity in R.
5
(A3) Associativity of addition. For z3 = e + i f ,
( z1 + z2 ) + z3 = ( a + c ) + e + i ( b + d ) + f = a + c + e + i b + ( d + f ) = z1 + ( z2 + z3 ),
by associativity in R.
z + 0V = ( a + 0) + i (b + 0) = a + ib = z.
z + (−z) = ( a − a) + i (b − b) = 0 + i0 = 0V .
αz = (αa) + i (αb) ∈ V,
since αa, αb ∈ R.
1 · z = (1 · a) + i (1 · b) = a + ib = z.
All axioms for a vector space over R are satisfied. Hence V is a vector space
over R under the usual addition and (real) scalar multiplication of complex num-
bers.
√
Example 4. Prove that V = { a + b 2 : a, b ∈ Q} is a vector space over Q
6
under usual addition and scalar multiplication.
Solution. Let
√
V = { a + b 2 : a, b ∈ Q},
with addition and scalar multiplication given by the usual operations inherited
from R. We check the vector-space axioms over the field Q.
For x, y ∈ V write
√ √
x = a1 + b1 2, y = a2 + b2 2 ( a i , bi ∈ Q ) .
√
For α ∈ Q write αx = αa1 + αb1 2.
Since a1 + a2 , b1 + b2 ∈ Q, we have x + y ∈ V.
√
A3. Associativity of addition. For z = a3 + b3 2 ∈ V,
√ √
( x + y) + z = ( a1 + a2 ) + (b1 + b2 ) 2 + ( a3 + b3 2)
√
= ( a1 + a2 + a3 ) + (b1 + b2 + b3 ) 2 = x + (y + z),
using associativity in R.
√
A4. Additive identity. The element 0V = 0 + 0 2 = 0 ∈ V satisfies
√ √
x + 0 = ( a1 + 0) + (b1 + 0) 2 = a1 + b1 2 = x.
√
A5. Additive inverse. For x = a1 + b1 2 ∈ V, its additive inverse in R is
√
− x = (− a1 ) + (−b1 ) 2 ∈ V,
7
√
B1. Closure under scalar multiplication. For α ∈ Q and x = a1 + b1 2 ∈ V,
√
αx = αa1 + (αb1 ) 2,
= αx + βx.
B5. Identity scalar. Let 1 ∈ Q be the multiplicative identity of the field. Then
√ √
1 · x = 1 · a1 + 1 · b1 2 = a1 + b1 2 = x.
All vector-space axioms over Q are satisfied, hence V is a vector space over Q.
V = { f : [ a, b] → R | f is continuous on [ a, b]},
( f + g)( x ) = f ( x ) + g( x ), (c f )( x ) = c f ( x )
8
for all f , g ∈ V, all scalars c ∈ R and all x ∈ [ a, b]. We check the vector-space
axioms (all equalities hold for every x ∈ [ a, b]).
(A1) Closure and well-definedness.
• If f , g ∈ V then f and g are continuous on [ a, b]. The sum of continuous
functions is continuous, so f + g is continuous on [ a, b], hence f + g ∈ V.
( f + g)( x ) = f ( x ) + g( x ) = g( x ) + f ( x ) = ( g + f )( x ).
So f + g = g + f .
(A3) Associativity of addition. For all f , g, h ∈ V and all x ∈ [ a, b],
( f + g) + h ( x ) = ( f + g)( x ) + h( x ) = ( f ( x ) + g( x )) + h( x )
and
f + ( g + h) ( x ) = f ( x ) + ( g + h)( x ) = f ( x ) + ( g( x ) + h( x )).
By associativity of real addition these two are equal for every x, hence ( f + g) +
h = f + ( g + h ).
(A4) Additive identity. Define the zero function 0 ∈ V by 0( x ) = 0 for all
x ∈ [ a, b]. It is continuous, so 0 ∈ V. For any f ∈ V and all x ∈ [ a, b],
( f + 0)( x ) = f ( x ) + 0 = f ( x ),
hence f + 0 = f .
(A5) Additive inverse. For each f ∈ V define (− f ) ∈ V by (− f )( x ) = − f ( x ).
It is continuous, so in V. For all x ∈ [ a, b],
( f + (− f ))( x ) = f ( x ) + (− f ( x )) = 0,
so f + (− f ) = 0.
(B1) Compatibility of scalar multiplication with field multiplication. For all
scalars c, d ∈ R and f ∈ V, for every x ∈ [ a, b],
c(d f ) ( x ) = c (d f )( x ) = c(d f ( x )) = (cd) f ( x ) = (cd) f ( x ).
9
So c(d f ) = (cd) f .
(B2) Identity element of scalar multiplication. For the scalar 1 ∈ R and any
f ∈ V, for every x ∈ [ a, b],
(1 · f )( x ) = 1 · f ( x ) = f ( x ),
hence 1 · f = f .
(B3) Distributivity of scalar multiplication over vector addition. For all
c ∈ R and f , g ∈ V, for each x ∈ [ a, b],
c( f + g) ( x ) = c ( f + g)( x ) = c( f ( x ) + g( x )) = c f ( x ) + cg( x ) = c f + cg ( x ).
Thus c( f + g) = c f + cg.
(B4) Distributivity of scalar addition over a vector. For all c, d ∈ R and f ∈ V,
for each x ∈ [ a, b],
( c + d ) f ( x ) = ( c + d ) f ( x ) = c f ( x ) + d f ( x ) = c f + d f ( x ).
So (c + d) f = c f + d f .
All vector-space axioms over the field R are satisfied. Therefore V = C ([ a, b])
with the given pointwise addition and scalar multiplication is a vector space over
R.
v = a1 v1 + a2 v2 + · · · + a n v n .
Examples:
1. In R3 , the vector
(3, −1, 4)
is a linear combination of
10
since
(3, −1, 4) = 3(1, 0, 0) + (−1)(0, 1, 0) + 4(0, 0, 1).
f ( x ) = 2e x − sin x
f ( x ) = 2 · e x + (−1) · sin x.
4. Linear Span
Let V be a vector space over the field F and S be any non-empty subset of V.
Then the linear span of S is defined as the set of all linear combinations of finite
sets of elements of S. It is denoted by L(S).
L(S) = {λ1 u1 + λ2 u2 + · · · + λn un | ui ∈ S, λi ∈ F, i = 1, 2, . . . , n}
The set L(S) is said to be generated or spanned by the set S, and S is said to
be the set of generators of L(S).
Example: The set (" # )
λ1 0
L(S) = λ1 , λ2 ∈ F
0 λ2
of all 2 × 2 diagonal matrices is the linear span of
" # " #
1 0 0 0
and .
0 0 0 1
λ1 a1 + λ2 a2 + · · · + λ n a n = 0
11
implies that λ1 = λ2 = · · · = λn = 0.
Consequences
1. Any superset of a linearly dependent set is linearly dependent.
Notation: Throughout this unit, by Vn (F) we mean the vector space Rn (F), where
F is a field either Q or R.
Example 1. Prove that, in V3 (R), the vectors (1, 2, 1), (2, 1, 0) and (1, −1, 2) are
linearly independent.
Solution. Let
λ1 + 2λ2 + λ3 = 0 (1)
2λ1 + λ2 − λ3 = 0 (2)
λ1 + 2λ3 = 0. (3)
Solving (1), (2), and (3), we get λ1 = λ2 = λ3 = 0. Hence the given set of
vectors is linearly independent.
Example 2. In V3 (R), prove that the vectors (1, 4, −2), (−2, 1, 3) and (−4, 11, 5)
are linearly dependent.
Solution. Let
12
Therefore,
λ1 λ λ
= 2 = 3.
−18 −27 9
Hence,
λ1 λ λ
= 2 = 3 =k (say).
−2 −3 1
Therefore,
λ1 = −2k, λ2 = −3k, λ3 = k.
Taking k = 1, we get λ1 = −2, λ2 = −3, λ3 = 1, which also satisfy (3). Since
λ1 , λ2 , λ3 are non-zero scalars, the given set of vectors is linearly dependent.
is a basis of the vector space R3 , then the dimension of R3 is 3, since its basis
contains three linearly independent vectors.
Notes.
3. A vector space may have more than one basis, i.e., the basis of a vector space
is not unique.
13
4. The set {e1 , e2 , . . . , en } of unit vectors is a basis for Rn , which is known as
the standard basis.
Example. Show that the vectors (3, 0, 2), (7, 0, 9) and (4, 1, 2) form a basis for R3 .
Solution. It is easy to prove that the given vectors are linearly independent.
Now, we have to show that they span R3 . To show this, we need to prove that for
any vector ( a1 , a2 , a3 ) ∈ R3 , it is possible to find scalars λ1 , λ2 , λ3 such that
This expands to
From these equations, real values of λ1 , λ2 , λ3 can be found. Hence, the given
vectors form a basis for R3 .
Example: Prove that the vectors (1, 1, 1), (1, 1, 0) and (1, 0, 0) form a basis of
R3 . Also prove that the vector (1, 3, 1) can replace any one of the three vectors to
form a new basis.
Solution. Let A be the matrix formed by these vectors:
1 1 1
A = 1 1 0 .
1 0 0
Its determinant is
1 1 1
| A| = 1 1 0 = −1 6= 0.
1 0 0
Hence, rank( A) = 3, so the vectors are linearly independent.
Now, for ( a1 , a2 , a3 ) ∈ R3 ,
14
Expanding:
( a1 , a2 , a3 ) = ( λ1 + λ2 + λ3 , λ1 + λ2 , λ1 ).
Equating components:
λ1 + λ2 + λ3 = a1 , λ1 + λ2 = a2 , λ1 = a3 .
Thus, the scalars exist and the vectors span R3 . Hence, the given vectors form
a basis.
Now, check if (1, 3, 1) can replace one of them. Suppose:
This gives:
µ1 + µ2 + µ3 = 1, µ1 + µ2 = 3, µ1 = 1.
Solving:
µ1 = 1, µ2 = 2, µ3 = −2.
Since not all coefficients are zero, (1, 3, 1) can replace any vector of the basis to
form a new basis.
Example. Find the dimension of the subspace spanned by the vectors (1, 0, 2), (2, 0, 1), (1, 0, 1)
in R3 .
Solution. Let A be the matrix:
1 0 2
A = 2 0 1 .
1 0 1
1 0 2
| A| = 2 0 1 = 0.
1 0 1
Thus, A is singular and the given vectors are linearly dependent. So, they do
not form a basis.
Now, check the set {(1, 0, 2), (2, 0, 1)}:
This gives:
(λ1 + 2λ2 , 0, 2λ1 + λ2 ) = (0, 0, 0).
15
Equating components:
λ1 + 2λ2 = 0, 2λ1 + λ2 = 0.
dim(subspace) = 2.
2. Express the vector (1, 7, −4) as a linear combination of the vectors (1, −3, 2), (2, −1, 1)
in V3 (R).
4. Show that the vector (3, −4, 2) cannot be expressed as a linear combination
of the vectors, (2, 1, 5) and (−1, 3, 2).
16
9. Are the following sets of vectors linearly independent or dependent?
(i) {(2, −4), (1, 9), (3, 5)}
(ii) {(−1, 5, 0), (16, 8, −3), (−64, 56, 9)}
{(1, −1, 1),(1,1, −1), (−
(iii) n 1, 1, 1)(0, 1,
o0)}
1 1 1 1 1 1
(iv) 4 , 0, − 4 , 0, 2 , − 2 , 3 , − 3 , 0
(v) {(1, 9, 9, 8), (2, 0, 0, 3), (2, 0, 0, 8)}.
10. Show that the vectors (1, 2, 1), (2, 1, 0), (1, −1, 2) form a basis of the vector
space E3 over the field of real numbers.
11. Is the vector (2, −5, 3) in the subspace of R3 spanned by the vectors (1, −3, 2), (2, −4, −1)
and (1, −5, 7) ?
12. Show that the following sets of vectors form a basis of the vector space R3 .
(i) {(2, −1, 0), (3, 5, 1), (1, 1, 2)}
(ii) {(1, −3, 2), (2, 4, 1), (1, 1, 1)}
(iii) {(1, 2, −3), (2, 5, 1), (−1, 1, 4)}
(iv) {(2, −3, 1), (0, 1, 2), (1, 1, 2)}
(v) {(1, 2, 2), (1, −1, 2), (1, 0, 1)}.
13. Shor that the following sets of vectors do not form a basis of the vector space
R3 .
(i) {(3, 2, 1), (3, 1, 5), (3, 4, −7)}
(ii) {(1, 2, 3), (2, 3, 4), (3, 4, 5)}
(iii) {(1, 2, 1), (1, 3, 5), (−1, 0, 1), (1, −1, 2)}
(iv) {(1, 2, −3), (2, −3, 1)(−3, 1, 1)}.
14. Find the dimension of the subspace spanned by the following vectors in
V3 (R) :
(i) (1, 1, 1), (−1, −1, −1)
(ii) (1, 2, −3), (0, 0, 1), (−1, 2, 1).
Answers
1 (3, −5) = − 12
7 (1, 2) −
11
7 (−3, 1)
6 No.
17
9 (i) linearly dependent
(ii) linearly dependent
(iii) linearly independent
(iv) linearly dependent
(v) linearly independent
11 No
14 (i) 1
(ii) 3
18
[Chapter 2]
Linear Transformation
T : V −→ W
1. Additivity: T ( X1 + X2 ) = T ( X1 ) + T ( X2 ), ∀ X1 , X2 ∈ V.
2. Homogeneity: T ( aX ) = a T ( X ), ∀ a ∈ F, X ∈ V.
Conditions (1) and (2) can be combined into the single requirement
T ( a 1 X1 + a 2 X2 ) = a 1 T ( X1 ) + a 2 T ( X2 ) , ∀ a1 , a2 ∈ F, X1 , X2 ∈ V.
1. Additivity:
T ( X1 + X2 ) = T ( X1 ) + T ( X2 )
T ( aX ) = a T ( X )
T ( a 1 X1 + a 2 X2 ) = a 1 T ( X1 ) + a 2 T ( X2 )
19
Illustrative Examples
T ( a 1 X1 + a 2 X2 ) = 0 (by definition of T)
= 0+0
= a1 0 + a2 0
= a 1 T ( X1 ) + a 2 T ( X2 ) .
Since the condition for linearity is satisfied, we conclude that T is a linear trans-
formation.
Remark 1. Sometimes we write this map succinctly as
T : V −→ W, X 7→ 0 (∀ X ∈ V ).
T (0) = T (0 + 0)
= T (0) + T (0)
=⇒ T (0) = 0,
where the 0 on the left is the additive identity of V and the 0 on the right is the
additive identity of W.
Example 2. Let T : V → W. If W = V, define T : V → V by T ( X ) = X for all
X ∈ V. This transformation is called the identity transformation. Show that the
identity transformation is linear.
Solution. Consider T : V → V defined by T ( X ) = X.
Let X1 , X2 ∈ V and a ∈ F. Then
T ( X1 + X2 ) = X1 + X2 (since T ( X ) = X)
= T ( X1 ) + T ( X2 ) ,
T ( aX ) = aX (since T ( X ) = X)
= a T ( X ).
20
formation.
Alternative Method. Let X1 , X2 ∈ V and a1 , a2 ∈ F. Then
T ( a 1 X1 + a 2 X2 ) = a 1 X1 + a 2 X2 (since T ( X ) = X)
= a 1 T ( X1 ) + a 2 T ( X2 ) .
T : R2 → R3 , T ( x, y) = ( x, y, 0)
is linear.
Solution. Let X1 = ( x1 , y1 ) and X2 = ( x2 , y2 ) be elements of R2 . Then
T ( X1 + X2 ) = T ( x 1 , y 1 ) + ( x 2 , y 2 )
= T ( x1 + x2 , y1 + y2 )
= ( x1 + x2 , y1 + y2 , 0)
= ( x1 , y1 , 0) + ( x2 , y2 , 0)
= T ( X1 ) + T ( X2 ) . (1)
T : R3 → R2 , T ( x, y, z) = (y, z)
is linear.
21
Solution. Let α = ( x1 , y1 , z1 ) and β = ( x2 , y2 , z2 ) in R3 , and a ∈ R. Then
T ( α + β ) = T ( x1 + x2 , y1 + y2 , z1 + z2 )
= ( y1 + y2 , z1 + z2 )
= ( y1 , z1 ) + ( y2 , z2 )
= T ( α ) + T ( β ). (1)
Also,
T ( a, b) = ( a2 , b)
is not linear.
Solution. Let X1 = ( a1 , b1 ) and X2 = ( a2 , b2 ) in R2 . Then
T ( X1 + X2 ) = T ( a1 + a2 , b1 + b2 )
= ( a1 + a2 )2 , b1 + b2
Whereas
T ( X1 ) + T ( X2 ) = ( a21 , b1 ) + ( a22 , b2 )
= a21 + a22 , b1 + b2 .
(2)
Since the extra term 2a1 a2 appears in (1) but not in (2),
T ( X1 + X2 ) 6 = T ( X1 ) + T ( X2 ) ,
22
Thus we have illustrated:
• T ( x, y) = ( x, y, 0) is linear,
• T ( x, y, z) = (y, z) is linear,
• T ( a, b) = ( a2 , b) is not linear.
f : V2 (R) −→ V3 (R), f ( a, b) = ( a + b, a − b, b)
is a linear transformation.
T : V3 (R) −→ V2 (R), T ( x, y, z) = ( x + z, y + z)
is linear.
f : V2 (R) −→ V3 (R), f ( a, b) = ( a, b, 0)
f : V3 (R) −→ V2 (R),
f ( a1 , a2 , a3 ) = 3a1 − 2a2 + a3 , a1 − 3a2 − 2a3
is a linear transformation.
T : V2 (R) −→ V2 (R), T ( x, y) = x3 + y3
is not linear.
T : R3 −→ R2 , T ( x, y, z) = ( x + 3, y + z)
is not linear.
23
7. Show that the mapping
T : R2 −→ R, T ( x, y) = | x − y|
is not linear.
T ( α1 ) = α2 , T ( α2 ) = α3 , T ( α3 ) = α1 .
T ( α1 ) = α2 , T ( α2 ) = α3 , T (α3 ) = 0.
11. Let V be the vector space of all complex numbers over the field R, i.e.
V = { a + ib | a, b ∈ R}.
Define T : V → V by
ker T = { α ∈ V : T (α) = 0W },
24
The dimension of ker T is called the nullity of T and is denoted by ν( T ):
ν( T ) = dim(ker T ).
N ( T ) = { α ∈ V : T ( α ) = 0W } .
dim N ( T ) = ν( T ).
Im T = T (V ) = { T ( x ) : x ∈ V } ⊆ W.
T −1 ( y ) = { x ∈ V : T ( x ) = y } .
In general, T −1 (y) need not be a single element because more than one vector of
V may map to the same y.
If V1 ⊆ V is any subset, the image of V1 is
T (V1 ) = { T (α) : α ∈ V1 }.
a1 β 1 + a2 β 2 = a1 T ( α1 ) + a2 T ( α2 )
= T ( a1 α1 ) + T ( a2 α2 )
= T ( a1 α1 + a2 α2 )
= T ( α ),
25
where α = a1 α1 + a2 α2 ∈ V.
Thus a1 β 1 + a2 β 2 ∈ T (V ), proving that T (V ) is indeed a subspace of W.
R( T ) = { Y ∈ W | ∃ X ∈ V with T ( X ) = Y }.
ρ( T ) = rank T = dim R( T ).
Equivalently,
ρ( T ) + ν( T ) = dim V,
dim V = dim R( T ) + dim N ( T ),
dim V = n (finite).
Here:
• ν( T ) is the nullity of T.
26
Example 1 Show that the transformation
T ( a, b) = ( a + b, a − b, b), ∀ a, b ∈ R.
Solving
a + b = 0, a − b = 0, b = 0,
gives a = 0, b = 0. Thus
ker T = {(0, 0)}.
The null space is therefore the zero subspace of V2 (R).
(iii) Nullity:
nullity( T ) = dim ker T = 0.
(iv) Range of T: Let the standard basis of V2 (R) be {(1, 0), (0, 1)}. Then
Hence
Range( T ) = span{(1, 1, 0), (1, −1, 1)}.
27
To check linear independence, suppose
a + b = 0, a − b = 0, b = 0,
Find the range, kernel, rank and nullity of T. Decide whether T is one-one and/or
onto.
Solution. The standard basis of V2 is S = {(1, 0), (0, 1)}. Therefore
These two vectors are linearly independent, hence form a basis of Range( T ).
The kernel is
ker T = ( x1 , x2 ) ∈ V2 : T ( x1 , x2 ) = (0, 0, 0)
= {(0, 0)}.
T ( a, b, c) = ( a + b, b + c).
28
1. Linearity: For X1 = ( a1 , a2 , a3 ), X2 = (b1 , b2 , b3 ) and c ∈ R,
T ( X1 + X2 ) = T ( X1 ) + T ( X2 ) , T (cX1 ) = c T ( X1 ),
hence T is linear.
3. Range and Rank: T (1, 0, 0) = (1, 0) and T (0, 0, 1) = (0, 1), which are linearly
independent. Hence
Range( T ) = R2 , rank T = 2.
Example 4 Define T : R4 → R3 by
T ( x, y, s, t) = ( x − y + s + t, x + 2s − t, x + y + 3s − 3t).
Image.
T (1, 0, 0, 0) = (1, 1, 1),
T (0, 1, 0, 0) = (−1, 0, 1),
T (0, 0, 1, 0) = (1, 2, 3),
T (0, 0, 0, 1) = (1, −1, −3).
Row-reducing the matrix with these as rows gives rank 2, so
29
Kernel. Solve
x − y + s + t = 0,
x + 2s − t = 0,
x + y + 3s − 3t = 0.
1. Let T : V → V be defined by
T ( x1 , x2 , x3 ) = 2x1 + x2 + 3x3 , 3x1 − x2 + x3 , −4x1 + 3x2 + x3 .
Find a basis and the dimension of the image (rank) of T and of the null
space of T.
Find a basis and the dimension of the image and the rank of T.
30
Verify that
ρ( T ) + v( T ) = dim V4 = 4,
where ρ( T ) and v( T ) denote the rank and nullity of T, respectively.
Verify that T is a linear transformation and then find its rank and nullity.
Illustrative Examples
Solution.
T12 ( x, y) = T1 T1 ( x, y) = T1 (0, x ) = (0, 0).
Similarly,
T22 ( x, y) = T2 T2 ( x, y) = T2 (y, 0) = (0, 0).
Next,
T1 T2 ( x, y) = T1 T2 ( x, y) = T1 (y, 0) = (0, y).
Hence
( T1 T2 )2 ( x, y) = T1 T2 T1 T2 ( x, y) = T1 T2 (0, y) = (0, y).
T1 ( x1 , x2 ) = ( x2 , x1 ), T2 ( x1 , x2 ) = ( x1 , 0).
Show that T1 T2 6= T2 T1 .
31
Solution.
T1 T2 ( x1 , x2 ) = T1 T2 ( x1 , x2 ) = T1 ( x1 , 0) = (0, x1 ),
T2 T1 ( x1 , x2 ) = T2 T1 ( x1 , x2 ) = T2 ( x2 , x1 ) = ( x2 , 0).
T ( x, y, z) = (y, − x, 2z).
Solution.
I ( x, y, z) = ( x, y, z),
T 2 ( x, y, z) = T T ( x, y, z) = T (y, − x, 2z) = (− x, −y, 4z),
Therefore
32
Solution
(3S + 7T )( x1 , x2 ) = 3S( x1 , x2 ) + 7T ( x1 , x2 )
= 3 2x1 , 3x1 + 4x2 + 7 x1 + x2 , 0
= 6x1 , 9x1 + 12x2 + 7x1 + 7x2 , 0
= 6x1 + 7x1 + 7x2 , 9x1 + 12x2
= 13x1 + 7x2 , 9x1 + 12x2 .
M ( X ) = T1 ( X ) + T2 ( X ), ∀ X ∈ U.
M = T1 + T2 , so that ( T1 + T2 )( X ) = T1 ( X ) + T2 ( X ), ∀ X ∈ U.
TT −1 = T −1 T = I,
33
In Other Words
TS = I.
UT = I.
TS = UT = I,
T ( x ) = 0 =⇒ x = 0.
ker( T ) = {0}.
34
In other words, only the zero vector of V maps to the zero vector of W.
Evidently, T is one-one (injective) if and only if T is non-singular. Thus,
non-singular linear transformations are precisely those that preserve linear inde-
pendence.
A linear transformation T : V → W over the same field F is said to be singular
if there exists some non-zero vector α ∈ V such that
T (α) = 0.
Theorem 7.1. Let V and W be finite-dimensional vector spaces over a field F with
dim V = dim W = n. If T : V → W is a linear transformation, the following statements
are equivalent:
(i) T is invertible.
(ii) T is non-singular.
(iv) For every basis {α1 , α2 , . . . , αn } of V, the set { T (α1 ), T (α2 ), . . . , T (αn )} is a basis
of W.
(v) There exists a basis {α1 , α2 , . . . , αn } of V such that { T (α1 ), T (α2 ), . . . , T (αn )} is
a basis of W.
(c) (iii ) ⇔ (iv): If T is onto and {α1 , . . . , αn } is a basis of V, then { T (α1 ), . . . , T (αn )}
spans W. Because dim W = n, these vectors are automatically linearly inde-
pendent, hence form a basis of W.
35
(d) (iv) ⇔ (v): This is immediate: statement (iv) requires the basis condition
for every basis, while (v) asserts it for at least one basis.
(e) (v) ⇔ (i ): Assume there is some basis {α1 , . . . , αn } of V such that { T (α1 ), . . . , T (αn )}
is a basis of W. Then R( T ) = W. If α = ∑in=1 ai αi lies in the kernel K ( T ), we
have !
n n
T ∑ ai αi = ∑ ai T (αi ) = 0.
i =1 i =1
Corollary 7.2. Let U and V be finite-dimensional vector spaces over F, and let T : U →
V be linear. Then dim U = dim V if and only if T is non-singular.
T : V3 → V3 defined by T ( α1 ) = α1 + α2 , T ( α2 ) = α2 + α3 , T ( α3 ) = α1 + α2 + α3
( x1 , x2 , x3 ) = x1 α1 + x2 α2 + x3 α3 .
Applying T, we get
T ( x1 , x2 , x3 ) = T ( x1 α1 + x2 α2 + x3 α3 )
= x1 T ( α1 ) + x2 T ( α2 ) + x3 T ( α3 )
= x1 ( α1 + α2 ) + x2 ( α2 + α3 ) + x3 ( α1 + α2 + α3 )
= ( x1 + x3 ) α1 + ( x1 + x2 + x3 ) α2 + ( x2 + x3 ) α3
= ( x1 + x3 , x1 + x2 + x3 , x2 + x3 ).
T ( x1 , x2 , x3 ) = (0, 0, 0).
36
Then
x1 + x3 = 0,
x1 + x2 + x3 = 0,
x2 + x3 = 0.
N ( T ) = {0},
T ( x1 , x2 , x3 ) = ( y1 , y2 , y3 ) = ( x1 + x3 , x1 + x2 + x3 , x2 + x3 ).
x1 = y2 − y3 , x2 = y2 − y1 , x3 = y1 − y2 + y3 .
Thus,
T −1 ( y 1 , y 2 , y 3 ) = ( y 2 − y 3 , y 2 − y 1 , y 1 − y 2 + y 3 ).
Example 2. Let T be a linear operator on R3 defined by
T ( x1 , x2 , x3 ) = (3x1 , x1 − x2 , 2x1 + x2 + x3 ).
If the only solution is (0, 0, 0), then T is non-singular and hence invertible.
T ( x1 , x2 , x3 ) = (3x1 , x1 − x2 , 2x1 + x2 + x3 ).
37
Solution. Step 1: Show that T is one-one.
Let
T ( α ) = T ( β ) , α = ( x 1 , x 2 , x 3 ) , β = ( y 1 , y 2 , y 3 ) ∈ R3 .
Then
Comparing components:
3x1 = 3y1 =⇒ x1 = y1 ,
x1 − x2 = y1 − y2 =⇒ x2 = y2 ,
2x1 + x2 + x3 = 2y1 + y2 + y3 =⇒ x3 = y3 .
Hence, α = β, so T is one-one.
Then
T (α1 ) = T (1, 0, 0) = (3, 1, 2) = β 1 ,
T (α2 ) = T (0, 1, 0) = (0, −1, 1) = β 2 ,
T (α3 ) = T (0, 0, 1) = (0, 0, 1) = β 3 .
The range R( T ) is generated by { β 1 , β 2 , β 3 }. To check linear independence, let
38
Step 4: Find T −1 .
Let T ( x1 , x2 , x3 ) = (y1 , y2 , y3 ), i.e.,
y1 = 3x1 , y2 = x1 − x2 , y3 = 2x1 + x2 + x3 .
1 1
x1 = y1 , x2 = x1 − y2 = y1 − y2 , x3 = y3 − 2x1 − x2 = −y1 + y2 + y3 .
3 3
Hence, the inverse is
−1 1 1
T ( y1 , y2 , y3 ) = y1 , y1 − y2 , − y1 + y2 + y3 .
3 3
Find T −1 .
Solution Let
T ( x, y, z) = ( a, b, c),
so that
( a, b, c) = (2x, 2x − 5y, 2y + z). (1)
Comparing components, we get:
a = 2x, b = 2x − 5y, c = 2y + z.
a−b 2a − 2b 5c − 2a + 2b
z = c − 2y = c − 2 = c− = .
5 5 5
39
Thus, from (1):
a a − b 5c − 2a + 2b
−1
T ( a, b, c) = , , .
2 5 5
In general, for ( x, y, z) ∈ R3 :
x x − y −2x + 2y + 5z
−1
T ( x, y, z) = , , .
2 5 5
40