Vector spaces

Linear independence
Bases
Dimension
Subspaces

Vector spaces

to Vector spaces are the abstract

generalization of Rh

Definition
A vector space over f R or e is a
nonempty set V of objects called vectors
such that there is
I An internal operation denoted by t

subject to the following axioms

a Associativity att th uit ith
t it T W EV
lb Commutativity it f it u tu TeV
c Existence of a neutral element
F TEV such that V TEV
f t I J to T

d Existence of inverse elements

Tire V F J EV such that
It C T fT t J To

I An external operation from

into V denoted by juxtaposition

subject to the following axioms

Cal Nitti truth Fat F tu TEV
b at B it avi Bit [Link] F tu EV
c x Bet Cap a V [Link] V u EV
 d I a it t a EV

The elements of F are called scalars

Example The basic model of a vector

space is Rn

Example The set of matrices of

size mxn is a vector space

Example For each nzo the set 112

of polynomials of degree at most n
is vector space
a

Moreover the set D Epn of all

polynomials is a vector space
 Theorem
For every AEV and CEF
1 Otto
2 c0

03 I U Tt

D Rule of thumb A set V is a vector

space if it is closed under linear

combinations that is

x at TE V i ta BEF tu o EV
Linear Independence

Definition
Let hi Vi In be a set of vectors
in a vector space V A linear combination
of Vi Vi in is any vector of the
form
diVtAzVzt txnJn EV
y
where die it 2 n

Definition
we say that a set of vectors
VT VI In is linearly independent
if the equation
Xiv taint tannin I
 has the unique solution d dz hn o

We say that a set of vectors it Ty in

is linearly dependent if there exist

weights 442 xn not all Zero

such that
4J taint tant n

Example Consider the vectors

H L
it it t

Determine whether I VI VI VI is

a linearly dependent or independent

set
Example Consider the polinomials
pix x'txt 1
GK 2 11 r X't 1

Determine whether p g r is a

linearly dependent or independent set

Theorem
Let V be a vector space
1 If Oetti VI Tn then VIVI in
is linearly dependent
2 Vi is linearly independent if and

only if Vito
3 If t Vi Vi in is linearly dependent
then 4Th VI n Tn Inti Intr is

linearly dependent
4 If 4Th VI Tn Intl Intr is

linearly independent then Viii in

is linearly independent

Theorem
A set of vectors hi VI Tn is

linearly dependent if and only if

at least one rector can be written

as a linear combination of the others

Systems of generators

Definition
A set of vectors 5 is called a system

of generators of a vector space V

if every vector it in V is a linear

combination of de elements of S

Example Determine whether

Hill L
hill
is a
system of generators of IR
Theorem
Let 4 Ui Th Vin be a system of
generators of a vector space V

If some Tti is a linear combination

of the other generators then the

set obtained by eliminating Ii is
also a system of generators of V

Example In the previous example

4 f fifty
Therefore is a system
i lo
 1122
of generators of

Theorem
If 4Th VI Fm is a linearly independent
set and but liz in is a system
of generators of V then men

Bases of a vector space

Definition
Given a vector Space V a set of
vectors B is a basis of V i f i

t B is linearly independent
2 B is a system of generators of V
Theorem
If a vector space V has a basis
with a finite number of vectors
then every basis of V is finite
and has the same number of
vectors

Definition
For any vector space with a

finite basis we will say that

the V denoted
dimension of
by dim V is the number of
vectors in any of its bases
 3 dim v is the maximum number
of elements in any linearly independent
set of V

dim IV is the minimum number of

elements in any system of generators
of V

3
Example In IR

is basis usually called the canonical

a

basis dim Rs 3
Example Let it

fog

Determine whether hi VI VI constitutes

1123
a basis for

Example In the vector space Pn of

polynomials of degree at most n

the set
2
44 1 xn
is a
usually called the standard
basis

basis of Pn dim Rn _htt

Example Consider the polynomials
pix x't Xt l gCx 2 1 rex X2tl
Determine whether 3pm 9CH rea

constitutes a basis for IR

Theorem
In a non trivial finite dimensional
vector space every system of generators
can be reduced to a basis

Example Consider the following

1122
system of generators in

E 5
fo ft
Reduce it to a basis
Theorem
Let V be a vector space of
dimension n and let hi Vi Js
San be
linearly independent
a

set There exist vectors Tsa Tsa in

such that hi VI Js Jst Tn is
a basis

Summary
Let V be a vector space of dimension
N and let f hi Tz in be a set with

exactly n vectors The are

following
equivalent
1 S is linearly independent
2 S is a system of generators of V
Z S is a basis of V
Coordinates of a vector with respect to a basis

Theorem
Let V be a vector space If B tu UI In
is a basis of V then every vector E EV

has unique representation as

a a linear
combination of the vectors in B

Definition
Let B tu Ui ruin be a basis

of a vector space If F Guitczuit tenth

is the representation of E in terms

of B then a er Cn are called the

coordinates of I with respect to B
 We will call the vector

ITB Egg
ER

the coordinate vector of I with respect

to B

Example Find the coordinates of the

vector I with respect to the

f
basis

µ fo B
f
Theorem
Let V be vector space of dimension
a

n and let 13 be a basis of V

It I VE
1 YTB Bt if B
g EV
2 AI B a I B VI EV d E IR

Coordinates and linear dependence

The concept of coordinates with

respect to a basis is the link between
a
finite dimensial vector space V
and R n dim v
Theorem
Let V be a vector space and let B
be a basis of V A set of r vectors
Ii U2 ur is linearly independent
if and only
if CUIB U2 B Lin B

is a set of linearly independent

vectors in Rn n dim V

Example Consider the polynomials

2
rat 644 13
pix 3 2 1 Glx 4 21 3 12

Determine whether pal g CH ra is

linearly dependent or independent

Change of basis
Let V be a finite dimensional space
and let

B 95,52 ibn and C SE Ez In

be two bases of V

B For every vector IEV we want to

find a relation between the coordinates

IIB and I c

I C bi t Cibzt [Link] B
B I c Cib t Iba t ten In c

b
a
if Cz b if ten bn c

bDc b 21 In c
I B

Theorem
Let V be vector space and let
a

13 151,52 ibn and C be two bases

of V
Then for every vector Itv

I c
c B
II B

bi bDc bDc
where
I e
Theorem

Every change of basis matrix is

invertible
Every invertible matrix is a
change
of basis matrix

Example Consider two bases of Pz

E tl X x and B f x if 2 XD 2

x 1 x 2x 11 IX il E

Ig
 21 17 2 2 2K IDE

f
2 e
sq

The matrix of change of bases between

E and B is

P x D e 2K IDE 2 e
B

ii
 pix e
PB pix pix B lpcxDe
y

P P
E B BEE

a'E
Enif
1 B x B x'IB

It B 1 01 1140121 1111 4214

µ
 B Lx B X 01 1 t k 21 1 4212

B X B l X G 1172K Dt 1212

fJ
42

As an example consider pCxI H2x 2 2

to Since I 12 2 21
412
2

and I 12 2 233 1 142 2

2
e

µy
then 1 2 2
2
21 112 21 1 TI
 Example Let
bi ibi [Link] iE iE
f 9
fi f
and consider the two bases of RZ
B bi bi and C Ta Iz Find the
matrix of change of basis cEB from
B to C

Example Let
b bi
if f
i

and consider the two bases B Fbi ba

and C HI I
a Find the matrix of change of basis from Btc
b Find the matrix of change of basis from Cto B
Hector Subspaces

Definition
Let V be a vector space and let
U be a non empty subset of V We
say that U is a vector subspace
of V if U has the following
properties
1 U is closed under addition
ht Tri EU Itv EU

2 U is closed under scalar multiplication

Fut EU V x e IR acte U
 A vector subspace is a vector space
in its own
right with the same

operations of the bigger vector space

Alternative definition of a vector subspace

Given a non empty subset U of a
vector subspace V the following
statements are equivalent
1 U is a vector subspace of V
2 U is closed under linear combinations
tu FEU Va ft IR att Br E U
Example Every non trivial vector space V
has at least two vector subspaces
403 and V
These two subspaces are usually called
improper subspaces

Example Many subspaces can be defined

in the vector space of square matrices
1 Upper
triangular matrices
Lower
2
triangular matrices
3 Diagonal matrices
4
Symmetric matrices A _At
5 Antisymmetric matrices A At
Example The polynomials of degree at
most 3 is a vector subspace of the
vector space of polynomials of degree
at most 5

Example IR is NOT a vector subspace

1123 since 1122 is not subset of
of a

1123 vectors in 1122 have two entries

while vectors in 1123 have 3

The set H
sitek

is a subspace of 1123 that looks

like 1122
Subspace spanned by a set of vectors

Definition
Let V be a vector space and let
5 lui UI in be a set of vectors
The set defined as

Spants taut azuit tantin trick

is the set of all possible linear combination

of the vectors in S

We say that Sparks is the set

spanned by S
Example Consider the following set

spank
o
ftp aeeRt

That is these two vectors span the

set of vectors in 1123 whose first
two components are equal

Theorem
Let V be a vector space and
lets be a set of vectors in V
Then Span453 is a vector
subspace of V
 Since Span Is is a vector sub space
then S is a system of
generators
of Span s and therefore S can
be reduced to a basis of Span IS

D Given any vector subspace U of a

vector Space V there exists a system

of generators That is if S is
system of generators of U then
U Span S Since S can be
reduced to a basis we can define
the dimension of any vector
subspace U dim U
 Moreover since U
any basis
De
of
is a linearly independent set of
V then we can extend it to a basis
V Therefore dim U C
dim U
of
for any vector subspace U of V

Example Consider the following

1124
subspace of

a Span

µµ6gµ
Determine dim U and obtain a

basis
Example Let It be the subset of 1124

defined as

[Link] abEIR

Determine
if It is a subspace of
1124 In case it is H
determine dim
and obtain a basis
Column space and Null space of a matrix

Definition
The column space of a matrix
A Lai Eez In is the set

Cola Span ta ai In

Example Let A
fly 3g and

5 Determine if Tse Cola

1.33
Definition
The null space of a matrix A
denoted by NWA is the set of
solutions of the homogeneous
equation AE O That is

NHA I AI o

Theorem
For every matrix A Nu IA is a

vector space
Example let A
f

Find a basis for Col A and a basis

for Nut A

Example let A

fig

Find a basis for GIA and a basis for

Nal A
Theorem
The pivot columns of a matrix A
constitute a basis for Col A

Therefore dim Nul A is the number

of non pivot columns of A we must
reduce the matrix A to find a basis

for Nut A

Rank of a matrix

Definition
The rank of a matrix A is
defined as the dimension of Col A

rank A dim Cola

D Since the pivot columns of a matrix
constitute a basis of Col A then the
rank of A is equal to the number
of pivot columns

Example Compute the rank of the

Matrix

l
i i
L

The rank theorem

If the matrix A has n columns

then rank At dim Nuc A n
Theorem
Let A be matrix of size n xn The
a

following statements are equivalent

1 A is invertible
2 The columns of A form a basis

of IRN Col A Rn
3 Rank A n

4 Not A SO dim Nut A o

Review Problems

1 For each of the following

subsets of IR determine
whether it is a subspace of
IR
3 0
a X t2 2 3

At 2 3 54

f
2
b

c X X2 3 0

d x 5x
1
2 Prove that if I Jn spans

so does the list

V then
Tn
VI VI VI
VT in i Tn
obtained by subtracting
from
except the last one
each vector
the following vector

T Tz Tn
3 Prove that if t
is

independent in V then
linearly
so is the list
Jn i Tn Tn
VT VI VI VI
4 Suppose that it Tn is
linearly independent in V and
J EV Prove that
if
Ftw Vito Jn tw
is linearly
dependent then
we Span I
Tn3

5 Suppose that V is finite

dimensional and U is a
subspace of V such that
dim U dim V Prove that
U V
 6 Consider the basis of IR
a
Hot fill D
Find the matrix
of change
of basis from C to
B where
c
Holl
7 Let U 412 be the vector subspace
defined by

Find a matrix A such that U NUI A