Chapter Two Vector Spaces
Chapter Two Vector Spaces
Vector Spaces
Department of
Mathematics
Department of Mathematics
Department of
Mathematics
This chapter introduces the underlying structure of linear
algebra, that of a finite dimensional vector spaces.
The definition of a vector space V , whose elements are
called vectors, involves an arbitrary field, K , whose
elements are called scalars.
The following notations will be used (unless and otherwise
stated):
V the given vector space
u, v , w vectors in V
K the given number field
a, b, c or k ‘ scalars in K .
Chapter Two: 2.1 Definition and Examples The following defines the
Vector Spaces
notion of vector space V over a scalar field K :
Department of
Mathematics
Definition
Let V be nonempty set with two operations:
(i.) Vector addition : This assigns to any u, v ∈ V , their sum
u+v ∈v
(ii.) Scalar multiplication : this assigns to any u ∈ V , k ∈ K , a
product ku ∈ V
Then V is called a vector space (over a field K ) if the following
axioms hold for any vectors u, v , w ∈ v :
A1 . (u + v ) + w = u + (v + w )
A2 . There is a vector in V , denoted by 0 and called the zero
vector, such that for any vector u ∈ V ,
u+0=0+u =u
Chapter Two:
Vector Spaces
u + (−u) = 0 = (−u) + u
A4 . u + v = v + u
A5 k(u + v ) = ku + kv for any scalar k ∈ K .
A6 . (a + b)u = au + bu for any scalars a, b, ∈ K
A7 . a(bu) = (ab)u, for any scalars a, b ∈ K
A8 . 1u = u, for the unit scalar 1 ∈ K .
Chapter Two:
Vector Spaces The above axioms naturally split in to two sets
Department of
Mathematics
Axioms A1 − A4 (concerned only on ” + ”)indicates that
(V , +) is an abelian group.
The remaining axioms A5 − A8 are the actions of the field
K on V .
Now, we have the following theorem
Theorem
Let V be a vector space over a field K .
(i.) For any scalar k ∈ K and 0 ∈ V , k0 = 0
(ii.) For 0 ∈ K and u ∈ V , 0u = 0
(iii.) If ku = 0 (k ∈ K , v ∈ V ), then k = 0 or u = 0.
(iv .) For any k ∈ k, and any u ∈ V , (−k)u = k(−u) = −ku
Chapter Two:
Vector Spaces
Department of
Proof:
Mathematics
(i.) Let k ∈ K and 0 ∈ V , then
k0 = k(0 + 0) = k0 + k0 =⇒ k0 = 0
0v = (0 + 0)v = 0v + 0v =⇒ 0v = 0
Department of
Mathematics
Department of
1. [Space K n ] Let K be any field and consider
Mathematics
K n = {(a1 , a2 , · · · , an ) : ai ∈ K ∀i}
Then K n is a vector space over K with addition and scalar
multiplication defined by :
Vector addition:
Scalar Multiplication:
Here, we have
the zero vector is 0 = (0, 0, · · · , 0)
the negative of the vector −(a1 , a2 , · · · , an ) is
(−a1 , −a2 , · · · , −an )
Chapter Two:
Vector Spaces
Department of
Mathematics 2. [Polynomial Space P(t)] Let P(t) dnote the set of all
polynomials of the form
p(t) = a0 + a1 t + a2 t 2 + · · · + an t n , n = 1, 2,
with
Vector addition: (f + g )(x) = f (x) + g (x)
Scalar multiplication : (kf )(x) = kf (x)
is a vector space.
Chapter Two:
Vector Spaces
Department of
Mathematics 5 [Polynomial Space Pn (t)]
Let
i.e
p(t) = a0 + a1 t + a2 t 2 + · · · + as t s , s ≤ n
Then, Pn (t) is a vector space over K with the usual
operation of addition of polynomials and multiplication of
polynomials by a constant.
Chapter Two:
Vector Spaces 2.2 Linear combinations, Spanning Set
Department of
Mathematics Definition
Let V be a vector space over a field K . A vector v in V is said
to be a linear combination of vectors u1 , u2 , · · · , un in V , if
there exist scalars a1 , a2 , · · · , an in K such that
v = a1 u1 + a2 u2 + · · · + an un
v = x1 u1 + x2 u2 + · · · + xn vn
p1 = t 2 + 2t + 1, p2 = 2t 2 + 5t + 4, p3 = t 2 + 3t + 6
i.e
Department of
Set coffecients of the same powers of t equal to each other
Mathematics
which yields the linear system
x + 2y + z = 3
2x + 5y + 3z = 5
x + 4y + 6z = −5
x = 3, y = 1, z = −2
And hence
v = 3p! + p2 − 2p3
Chapter Two:
Vector Spaces
Department of
Mathematics
Spanning Set
Definition
Let V be a vector space over a field K . Vectors u1 , u2 , · · · , un
in V are siad to be span V or to form a spanning set(set of
generators) if every v in V is a linear combination of the
vectors u1 , u2 , · · · , un -that is , there exist scalars a1 , a2 , · · · , an
such that
v = a1 u1 + a2 u2 + · · · + an un
Chapter Two:
Vector Spaces
Remark
Department of
5. Consider the vector space V = M2×2 (R) consisting of the
Mathematics set of all 2 × 2 matrices whose entries from R, and
consider the following four matrices
1 0 0 1
E11 = , E12 = ,
0 0 0 0
0 0 0 0
E21 = , E22 =
1 0 0 1
a b
Then, clearly every matrix A = can be written as
c d
Hence, E11 , E12 , E21 , E22 is a spanning set for M2×2 (R)
Chapter Two:
Vector Spaces
2.3 Subspaces
Department of
Mathematics This section introduces the important notion of a subspace.
Definition
Let V be a vector space over a field K and let W be a subset
of V . Then W is a subspace of V if W itself is a vector space
over K with respect to the operation of vector addition and
vector scalar multiplication on V .
Department of
1. For any vector space V , then {0} and V itself are
Mathematics subspace of V .
2. Consider the vector soace V = R3
(a.) Let U = {(a, b, c) ∈ R3 : a = b = c}. Show that U is a
subspace of V .
Solution: Let u = (a, b, c) and v = (a0 , b 0 , c 0 ) belongs to
U, then
a = b = c, and a0 = b 0 = c 0
For any k, k 0 ∈ K
ku + k 0 v = (ka + k 0 a0 , kb + k 0 b 0 , kc + k 0 c 0 )
and
ka + k 0 a0 = kb + k 0 b 0 = ck + c 0 k 0
Clearly, 0 = (0, 0, 0) ∈ U.
Hence, U is a subspace of V .
Chapter Two:
Vector Spaces
Department of
Mathematics
Department of
Mathematics Intersection of Subspace
Let U and V be subspaces of a vetor space V . We will show
that the intersection U ∩ V is a subspace of V . In fact, here
0 ∈ U and 0 ∈ W , hence 0 ∈ U ∩ W .
Let u, w ∈ U ∩ W , a, b ∈ K =⇒ U, w ∈ U, W , hence
au + bw ∈ U, W and au ∈ U, W
Hence
au + bw , au ∈ U ∩ W
The above result yields the following thorem.
Chapter Two:
Vector Spaces
Department of
Theorem
Mathematics
The intersection of any number of subspaces of a vector space
V is a subspace of V .
Linear Spans
Recall that, For any vectors u1 , u2 , · · · , un , any vector of the
form
a1 u1 + a2 u2 + · · · + an un
where ai are scalars is called the linear combination of
u1 , u2 , · · · , un
The collection of such linear combinations is denoted by
Span{u1 , u2 , · · ·n } or Span{ui }
Chapter Two: Regarding Span{ui } , we have
Vector Spaces
Department of
The zero vector is written as
Mathematics
Then
and
kv = (ka1 )u1 + (ka2 )u2 + (kan )un
Hence, v + v 0 , kv ∈ Span{ui }. Accordingly, Span{ui } is a
subspace of V .
Chapter Two:
Vector Spaces
a1 v1 + a2 v2 + · · · + am vm = 0
Department of
Mathematics
a1 v1 + a2 v2 + · · · + an vn = 0 =⇒ a1 = a2 = · · · = an = 0
kv = 0, v 6= 0, =⇒ k = 0
v2 = kv1 (∃k ∈ K )
Chapter Two:
Vector Spaces
3. Suppose two of the vectors v1 , v2 , · · · , vm are equal or one
Department of
Mathematics of them is a scalar multiple of the other, say v1 = kv2 ,
then the vectors are linearly dependent. (here we put
a1 = 1, a2 = −k, aj = 0 for all 3 ≤ j ≤ m) and
Department of
Mathematics
Example
Let u = (1, 1, 0), v = (1, 3, 2) and w = (4, 9, 5). Then u, v , w
are linearly dependent.
Solution
Here,
Department of Example
Mathematics
Solution:
Consider the equation
xu + yv + zw = 0
Hence
1 2 1 0
x 2 + y 5 + z 3 = 0
3 7 5 0
Chapter Two:
Vector Spaces
Department of
Mathematics
This yields the system
x + 2y + z = 0
2x + 5y + 3z = 0
3x + 7y + 5z = 0
x =y =z =0
Department of
Now put
Mathematics
t = 0, we have
x sin 0 + ye 0 + z02 = 0 =⇒ y = 0
t = π, we have
x sin π + 0e π + zπ 2 = 0 =⇒ z = 0
Finally, t = π2 , we have
π π π
x sin + 0.e 2 + 0.( )2 = 0 =⇒ x = 0
2 2
Hence, v1 , v2 , v3 are linearly independent.
Chapter Two:
Vector Spaces Exercises:
Department of 1 Check whether the following vecctors in R3 are linearly
Mathematics
independent or linearly dependent.
a. u = (2, 0, 0), v = (3, 2, 0), w = (4, 2, 1)
b. u = (1, 1, 2), v = (2, 3, 1), w = (4, 5, 5)
2 Let V = P(t) set of polynomials, determine whether the
following are linearly dependent or linearly independent.
a. u = 2t 2 + 4t − 3, v = 4t 2 + 8t − 6
b. u = 2t 2 + 3t − 4, v = 4t 2 − 3t + 2
3 Let V = set of all functions R → R. Show that the
functions
Then
Department of
Mathematics
On the other hand, Suppose vi is a linear combination of
the others,say
Definition
A set S = {u1 , u2 , · · · , un } of vectors is a basis of V if every
v ∈ V can be uniquely written as a linear combination of the
basis vectors u1 , u2 , · · · , un .
Chapter Two:
Vector Spaces
Department of
Mathematics The following is a fundamental result in linear algebra
Theorem
Let V be a vector space such that one basis has m elements
and another basis has n elements. Then m = n.
Department of Examples:
Mathematics
1. Let V = R3 , then the following are bases of V .
(a.) {e1 = (1, 0, 0), e2 = (0, 1, 0), e3 = (0, 0, 1)}
(b.) {v1 = (1, 1, 1), v2 = (2, 3, 0), v3 = (4, 0, 0)}
2. Let V = M2×3 , the the vectors
1 0 0 0 1 0 0 0 1
, , ,
0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0
, ,
1 0 0 0 1 0 0 0 1
forms a basis of V .
Chapter Two:
Vector Spaces
Department of
Mathematics
3. Let V = P(t) the vector space of polynomials, then the
vectors
1, t, t 2 , · · · ,
forms a basis of V .
4. Consider the vector space Pn (t) of all polynomials of
degree ≤ n, then the vectors
1, t, t 2 , · · · , t n
Lemma
Suppose v1 , v2 , · · · , vn span V , and suppose w1 , w2 , · · · , wm is
a linearly independent set. Then m ≤ n and V is spanned by a
set of the form
Now,
The vectors e1 , e2 , · · · , en are linearly independent.
For any vector v = (a1 , a2 , · · · , an ), we have
v = a1 e1 + a2 e2 + · · · + an en
i.e e1 , e2 , · · · , en span V
Hence, {e1 , e2 , · · · , en } is a basis of V . In particular
Dim(K n ) = n
Chapter Two:
Vector Spaces
2. The vector space V = Mr ×s of all r × s matrices. The
Department of
Mathematics following six matrices form a basis of the vector space
V = M2×3 :
1 0 0 0 1 0 0 0 1
e1 = , e2 = , e3 =
0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0
e4 = , e5 = , e6 =
1 0 0 0 1 0 0 0 1
In fact,here
{e1 , e2 , · · · , en } is linearly independent set and,
{e1 , e2 , · · · , en } span M2×3
Thus,
Dim(M2×3 ) = 6 = 2 × 3
Chapter Two:
Vector Spaces
Department of
Mathematics
Department of
Mathematics
Dim(P(t)) = ∞
Chapter Two:
Vector Spaces
Department of
Mathematics
Now, we have the following theorems on Bases
Theorem
Let V be a vector space of finite dimension n, then
1 Any n + 1 or more vectors are linearly dependent.
2 Any linearly independent set S = {u1 , u2 , · · · , un } with
n − elements is a basis of V .
3 Any spanning set T = {v1 , v2 , · · · , vn } of n − vectors in V
is a basis of V .
Chapter Two:
Vector Spaces
Department of Theorem
Mathematics
Suppose S span a vector space V , then
1 Any maximum number of linearly independent vectors in S
forms a basis of V .
2 Suppose one deletes from S every vector that is a linear
combination of preceding vectors in S, then the remaining
vectors forms a basis of V .
Theorem
Let V be a vector space of finite dimension and let
S = {u1 , u2 , · · · , ur } be a set of linearly independent vectors in
V , then S can be extended to a basis of V .
Chapter Two:
Vector Spaces
Examples:
Department of
Mathematics 1. The following vectors
1, t − 1, (t − 1)2 , · · · , (t − 1)n
Department of
Mathematics
3. The vectors
Dim(R3 ) = 3
Chapter Two:
Vector Spaces
Department of
Mathematics
Department of
Mathematics
Example: Consider V = R3 and w be a subspace of V . Then,
Dim(R)3 = 3, hence Dim(W ) will be either of 0, 1, 2, or 3.
Hence
If Dim(W ) = 0, then W = {0}
If Dim(W ) = 1, then W is a line which passes through the
origin.
If Dim(W ) = 2, then w is a plane which passes through
the origin.
If Dim(W ) = 3, then W = R3 .
Chapter Two: Chapter Two: Vector Spaces- Worksheet Two
Vector Spaces
1. Let V be a vector space and u, v ∈ V . Simplify each of
Department of
Mathematics the following expressions:
a. 2(4u − 5v ) + 3v + 6u
b. 2u − 3(5v − 4u) + 6v − u
c. 3uv + 2(u + v )
d. v2 + 3u − 2(u − v )
2. Let V be a vector space and u ∈ U, show that u + u = 2u.
3. Express the vector v = (1, −2, 5) as a linear combination
of the vectors
u1 = (1, 1, 1), u2 = (1, 2, 3), u3 = (2, −1, 1)
4. Express as a linear combination of the following vectors
a. v = 2, −5, 3 as
u1 = (1, −3, 2), u2 = (2, −4, −1), u3 = (1, −5, 7)
b. v = t 2 + 4t − 3 ∈ P(t) as
p1 (t) = t 2 − 2t + 5, p2 (t) = 2t 2 − 3t, p3 (t) = t + 1
Chapter Two:
Vector Spaces
4 7
Department of c. M = as the matrices
Mathematics 7 9
1 1 1 2 1 1
A= ,B = ,C =
1 1 3 4 4 5
Department of
Mathematics
10. Determine whether or not the following vectors in R3 are
linearly dependent or not.
a. u = (1, 1, 2), v = (2, 3, 1), w = (4, 5, 5)
b. u1 = (1, 2, 5), u2 = (1, 3, 1), u3 = (2, 5, 7), u4 = (3, 1, 4)
c. u1 = (1, 2, 5), u2 = (1, 5, 2), u3 = (2, 5, 1)
d. u = (1, 2, 3), v = (0, 0, 0), w = (1, 5, 6)
11. Show that the functions f (t) = cos t, g (t) = sin t, h(t) = t
from R → R are linearly independent.
12. Suppose u, v , w are linearly independent. Then show that
u + v , u − v , u − 2v + w are also linearly independent.
Chapter Two:
Vector Spaces
Department of
16. Let W be the subspace of R4 spanned by the vectors
Mathematics
is a basis of P3 (t).