Vector spaces

Linear independence
Bases
Dimension
Subspaces

Vector spaces

to Vector spaces are the abstract

generalization of Rh

Definition
A vector space over f R or e is a
nonempty set V of objects called vectors
such that there is
I An internal operation denoted by t

subject to the following axioms

a Associativity att th uit ith
t it T W EV
lb Commutativity it f it u tu TeV
c Existence of a neutral element
F TEV such that V TEV
f t I J to T

d Existence of inverse elements

Tire V F J EV such that
It C T fT t J To

I An external operation from

into V denoted by juxtaposition

subject to the following axioms

Cal Nitti truth Fat F tu TEV
b at B it avi Bit [Link] F tu EV
c x Bet Cap a V [Link] V u EV
 d I a it t a EV

The elements of F are called scalars

Example The basic model of a vector

space is Rn

Example The set of matrices of

size mxn is a vector space

Example For each nzo the set 112

of polynomials of degree at most n
is vector space
a

Moreover the set D Epn of all

polynomials is a vector space
 Theorem
For every AEV and CEF
1 Otto
2 c0

3
I U Tt

D Rule of thumb A set V is a vector

space if it is closed under linear

combinations that is

x at BI E V i ta BEF tu o EV
Example Use the rule of thumb to show

that Pz is a vector space

I Aot A X 192 2
UTTER
T bot bixtbzx2
For any x ER
dat I KaotBbo t xastpbs x

xaztpbz x2
1,2 3 4 in EIR

IN 1,2 3 3
IR
Linear Independence

Definition
Let hi Vi In be a set of vectors
in a vector space V A linear combination
of Vi Vi in is any vector of the
form
divitaz Vat txnJn EV
y
where die it 2 n

Definition
We say that a set of vectors
VT VI Tnt is linearly independent
if the equation
divitaivet tannin J

has the unique solution d dz xn O

d
d
0 Ji Jo got a JitxI o

dependent x xz o
do

We say that a set of vectors it Ty in

is linearly dependent if there exist

weights 442 xn not all Zero

such that
4J trivet txnVn o

Example Consider the vectors

H it it

I
Determine whether I VI VI VI is

a linearly dependent or independent

set
 XIV tXzVztXzV3tX4T4 0

I Guess

no
I L
o

I H

is free
Of

1 L
132 4 0
Xz 27
Xy X Xy 7
 onto

1 1 X _I k 0 Xz 2 Xy L
Example Consider the polinomials
pix x'txt 1
GK 2 11 r X't 1

Determine whether p g r is a

linearly dependent or independent set

2
Cepcat Cz flat circa 0 0 0

Cs Rtx H ta 0 21 2 1 1 21 0 11 8

Cst G x't Ci 1261 6 1Gt GF 0 70 10

Cit Cz O

Cit 2 Cz O

C t Cz t Cz o

L
iii in H

rz rz 2b
 Linearly independent

A E IR
L 0 t LzVz t thin 5 4 23 24 xn O
Theorem Let V be a vector space

1 If Oetti VI in then VIVI in

is linearly dependent
2 Vi is linearly independent if and

only if Vito
3 If tht VI In is linearly dependent
then 4Th VI n Tn Inti Intr is

linearly dependent
4 If 4Th VI Tn Tna Intr is

linearly independent then Viii in

is linearly independent

Theorem
A set of vectors hi VI Tn is

linearly dependent if and only if

at least one rector can be written
as a linear combination of the others
 civil civet twin To

at least one C is non zero

Suppose that c to

Civ Critz Tz Chin

Ti Ezra VI Eun
c c a
Systems of generators

Definition
A set of vectors 5 is called a system

of generators of a vector space V

if every vector it in V is a linear

combination of de elements of S
s 5h vi Tvr
Xi Vit XI Viet t x Jr 5 for any
b EV

Example Determine whether

Hill L
is a
system of generators of IR
 tuff
1
f Haft ab
0

I XA O
at
O
b

L Ifa
System of generators
Xiv tXzTz 0
solution X
If
If there is pivot in every row
a

of the coefficient matrix then A E b

has atleast one solution

If there pivot in every

is a column

of the coefficient matrix A there

A F To has at most 1 solution
 Independence Uniqueness
XIV XzTzt tXnJn I

ite a
pivot

Generators Existence
XIV tXzVzt tXnTn b tf b EV
Avoid 0 1
tht

If HE lt
In
Theorem
Let 4 UT Th In be a system of
generators of a vector space V

If some Ili is a linear combination

of the other generators then the

set obtained by eliminating Ii is
also a system of generators of V

A
XIU t X z UI t t X in it t X nUT Ts
Ii C Te t Cz Uz t T Corvin

x Tut Xiu at t Xi Cia t Catz t t Cnuin t

tinting

X 1 Xia uit x at Xi G uit tcxn [Link] tin To

9
iii does not appear
Example In the previous example

4 f fifty
Therefore is a system
i f

c I Hitt's lil
 1122
of generators of

Theorem
If 4Th VI Fm is a linearly independent
set and but UI in is a system
of generators of V then men

Bases of a vector space

Definition
Given a vector Space V a set of
vectors B is a basis of V i f i

t B is linearly independent
2 B is a system of generators of V
 Xi Ti't Xia t txnv n 5V [Link]
Theorem
If a vector space V has a basis
with a finite number of vectors
then every basis of V is finite
and has the same number of
vectors

Definition dim1122 2

For any vector space with a

finite basis we will say that

the V denoted
dimension of
by dim V is the number of
vectors in any of its bases
 er
2 dim v is the maximum number
of elements in any linearly independent
set of V

in
dim IV is the minimum number of
elements in any system of generators
of V

If s has more than in elements S is 1in deep

if S has less than in elements S cannot generate V

3
Example In IR

is basis usually called the canonical

a

basis dim Rs 3
dim lRn n
 Example Let i

fg
Determine whether hi VI VI constitutes
1123
a basis for every column
L lin ind set XII tXzVztXzVI o is a pivot
every row is
2 generate 1123 Kitt XzEztX35 y a pivot
for any FEIR3
0 1 X

T Tz Tz I3

In in
l

hi VI VI is a basis
Example In the vector space Pn of

polynomials of degree at most n

the set
2
14 1 xn
is a
usually called the standard
basis

basis of Rn dim Rn _htt

Example Consider the polynomials
pix x't Xt l gCx 2 1 rex X2tl
Determine whether 2pm 9CH rea

constitutes a basis for IR

pea gin red is a basis for Pe

bases
pl
Theorem
In a non trivial finite dimensional
vector space every system of generators
can be reduced to a basis

Example Consider the following

1122
system of generators in
Generators
E
fo
Reduce it to a basis third
Theorem
Let V be a vector space of
dimension n and let hi Vi Js
Sen be
linearly independent
a

set There exist vectors Tsa Tsa in

such that htt VI Js Jst Tn is
a basis
Ji Ja Vs HEM
[Link] n
gz gm st2
Summary
Let V be a vector space of dimension
N and let f hi Tz in be a set with

exactly n vectors The are

following
equivalent
1 S is linearly independent
2 S is a system of generators of V
Z S is a basis of V

1H
EEen iii ii Holt
Coordinates of a vector with respect to a basis
Theorem
Let V be vector space If 134ThUI Tun
a

is a basis of V then every vector E EV

has a unique representation as a linear
combination of the vectors in B

I Quit Azizt tdnu

I pauitpzuzt itpn
u o
lxc [Link] Ba uit t ten Brinn

Q B o A _Bi
xn p o
2 Bz o
n
Az B z Ln Bn

Definition
Let B hui Ui ruin be a basis

of a vector space If F Guitczuit tenth

is the representation of E in terms

of B then a er Cn are called the

coordinates of I with respect to B
 1122
Xy

B We will call the vector ft x i ty Y

I B EIR

the coordinate vector of I with respect

to B

Example Find the coordinates of the

vector with

if II f YEH

basis

µ fo B
f
 l

It l I Y I
iii I
I

I I
t il

it I
il l il l
t H
Theorem
Let V be vector space of dimension
a

n and let 13 be a basis of V

It I VE
1 YTB Bt if B
g EV
2 AI B a I B VI EV d E IR

Coordinates and linear dependence

The concept of coordinates with

respect to a basis is the link between
a
finite dimensial vector space V
and R n dim v
Theorem
Let V be a vector space and let B
be a basis of V A set of r vectors
Ii U2 ur is linearly independent
if and only
if CUIB U2 B Lin B

is a set of linearly independent

vectors in Rn n dim V

Example Consider the polynomials

2
pix 3 2 1 Glx 4 21 3 12 rat 644 13

Determine whether pox GCN rex is

linearly dependent or independent

E L X X
 Ep Ie

µ Haley Birkhoff

XLpix
txzqcxltxzrcxfzotoxtoxy p xfpcxbctxzl9

[Link] E
XfpcxDctxz 9CH e KDE

iii in
i n i

din ind
set of B vectors that are

tin ind in a vector space

of
dimension 3 pg r is
a basis of 112
 I
L

Epexile WWE

µ Ginley µ
i

iii
l
It H I

it L

Ili
Change of basis
Let V be a finite dimensional space
and let

B Taiba ibn and C SE Ez In

be two bases of V

For every vector IEV we want to

find a relation between the coordinates

IIB and I c

I C bi t Cibzt tCnbn ITB

B I c 95 t Iba t ten In c

b
a
if Cz b aft ten bn c

bDc b23C bDc I B

Theorem
Let V be vector space and let
a

13 151,52 ibn and C be two bases

of V
Then for every vector Itv

I c
c B
II B

bi bi bDc
where
I e c

BID Ib l
Ek
p IB B
 DTB
Theorem
filled Ciao
U
Every change of basis matrix is

invertible
Every invertible matrix is a
change
of basis matrix
B t P C Idc CIB Ipo IIc I B

BE Ips
Example Consider two bases of Pz

E Il X x and B f x D2 2 X D 2

How to change coordinates from B to E

I need eP textile 24 De 2 c

B x D X 2 1 Ux Die
Y

I
 21 17 0 72 2 21 1
e
Lg

2 0 21 0 12 2 E

pix x 15 24 Dt2 pkDB

x 21 11 2 1 2 1 21 Ly
1121 1
 I

ti
[Link]
L
2

2
pix 1 1

qcxl x D2 24 D 2 9th B

X 2 11 2
XZ 4 1
12 21 µ
2 I

f's Hittite 2

2
1 1 1 4 1
g
t
L

i
L

i
L

i
i
i
 i
it

Ee Con
p
1 X B X B
B
B f x it 2H D 2
I 0 X l t 0.2 x c t 12.2 1 r

xE 0 x D t Yz 4 x r t 121 X it l X V
x x i 5 t2 x 1 t 12.2
XZ 24 txt 2A Itt XZ V
 pix e
PB pix pix B lpcxDe
y

P P
E B BEE

a'E
Enif
1 B x B x'IB

It B 1 01 1140121 1111 4214

µ
 B Lx B X 01 1 t k 21 1 4212

B X B l X G 1172K Dt 1212

fJ
42

As an example consider pCxI H2x 2 2

to Since I 12 2 21
412
2

and I 12 2 233 1 142 2

2
e

µy
then 1 2 2
2
21 112 21 1 TI
Example Let
bi bi iE
ff [Link] iE f.i f
and consider the two bases of RZ
B bi bi and CHI I Find the
matrix of change of basis IB from
B to C

Cbi bile
IB c

Xist XzEz by I iz I CE Ez 5 bz
Te
yzE Iz E Ez Bz Iz
v
C it
Yi
IdeTbd

l It I
a

I It 3
 f
Hats [Link] Hit
4 its iii t til

Example Let
b bi
if 4
if
and consider the two bases B Fbi ba
and C 3 I I
a Find the matrix of change of basis from Btc
b Find the matrix of change of basis from Cto B
E E b bi

fi s H
iii is L I L

Y [Link] I
I L t fat
fal stat fist L
 filth tf's tuff L

Irs BE war

[Link] Ht i il
t's's i it to ti's

to i i [Link]
CHB Cars
B I 34
c x H X
Hector Subspaces

Definition
Let V be a vector space and let
U be a non empty subset of V We
say that U is a vector subspace
of V if U has the following

properties
1 U is closed under addition
ht Tri EU Itv EU

2 U is closed under scalar multiplication

Fut EU V x e IR acte U
 A vector subspace is a vector space
in its own
right with the same

operations of the bigger vector space

Alternative definition of a vector subspace

Given a non empty subset U of a
vector subspace V the following
statements are equivalent
1 U is a vector subspace of V
2 U is closed under linear combinations
Hui re U ta p E IR att Br E U
Example Every non trivial vector space V
has at least two vector subspaces
403 and V
These two subspaces are usually called
1031 0
improper subspaces
f
Example Many subspaces can be defined
in the vector space of squa rematrices
1 Upper matrices V
triangular
Lower
2
triangular matrices
3 Diagonal matrices
4
Symmetric matrices A _At
5 Antisymmetric matrices A At
A At B Bt
ATB
t
ATB At B I Attest At B
t
x A a Ar
Example The polynomials of degree at
most 3 is a vector subspace of the
vector space of polynomials of degree
at most 5 n em Dn E Pm
9

Example IR is NOT a vector subspace

1123 since 1122 is not subset of
of a

1123 vectors in 1122 have two entries

while vectors in 1123 have 3

The set H

µo sitek

is a subspace of 1123 that looks

1122

I
like
CEE
Refa
Subspace spanned by a set of vectors

Definition
Let V be a vector space and let
5 9 UT Tk In be a set of vectors
The set defined as

Spants taut azuit tantin trick

is the set of all possible linear combination

of the vectors in S

We say that Sparks is the set

spanned by 8

Span Tu Ia Ten
Example Consider the following set

spank
o
ftp aeeRt

That is these two vectors span the

set of vectors in 1123 whose first
two components are equal

spank
fi f fafioltef9l are'T

ER
Ip xp
Theorem
Let V be a vector space and
lets be a set of vectors in V
Then Span453 is a vector
subspace of V

Span s is a subspaces Span Is

is closed under 1 c

p cR E TE Span s
d

Question Is aritate Span Is

S TW WI In

truth air quiz t ten Wn

I A W t Azw at tannin
F bi htt bzw at 1 bn Tn
air 1psJ da
Bb To t [Link] wit t xantBbnTn
w un
U Cz Cn

C
Span Is
 Since Span Is is a vector sub space
then S is a system of generators

of Span s and therefore S can

be reduced to a basis of Span IS

D Given any vector subspace U of a

vector Space V there exists a system

of generators That is if S is
system of generators of U then
U Span S Since S can be
reduced to a basis we can define
the dimension of any vector
subspace u
din
 Moreover since U
any basis
De
of
is a linearly independent set of
V then we can extend it to a basis
V Therefore dim U C
dim U
of
for any vector subspace U of V

Example Consider the following

1124
subspace of

a Span

Determine dim U and obtain a

basis

at Iv
l
 ii
in

Basuispen seanff f

dimlut 2

[Link] spanffz

i
i i

iii
Example Let It be the subset of 1124

defined as

A a 3b

a
i Aib EIR span Is
bg

Determine
if It is a subspace of
1124 In case it is H
determine dim
and obtain a basis

is it
it

0 I
 span
µ
ii space

bin ind
basis

dim It elements in a basis def din 2

Prove by showing that It is closed under

linear combinations
ie ie H
I need to show that art pre H x
PE IR

x [Link] H avi
µy
x
tpJ y
 Since I J e H

tis
a too
i
[Link] cix

i
.i
itl
i

It is closed under 1in comb

Column space and Null space of a matrix

Definition
The column space of a matrix
A Lai Eez In is the set

Cola Span ta ai In

Example Let A
f
3g and

5 Determine if Tse Cola

1.33

Xe I t Xz a ztXzaz I AI D

yes BE 61 A

I
 I 3 l
i

ii
i

i
ti tk l

t I
i
i tt

I I
I

92
XI 1 5 3 5 92
52 a i 1 5
2 32 Ez 1753

12 13 3
5 2 4

3 2

basis

Cola 2

_spanff.ly
ff fdimcolA
a3 5 a It 3 Iz

ae fois 315Cia
Definition
The null space of a matrix A
denoted by NWA is the set of
solutions of the homogeneous
equation AE O That is

NHA I AI o

Theorem
For every matrix A Nu IA is a

vector space

Tt V E NUI A Act 0 AT 0

Need to show A Alai 1ft O

xu
[Link] Nul
A au
tpvl dh
utph r xotp o

[Link]
AI
A
Ern

IE IR IR
Columns of A

columns of A
NWA is a subspace of 112

rows of A
Cola is 112
a subspace of

rows f colums Nul A and ColA

do not belong to

the same IRN

Example let A
f

Find a basis for Col A and a basis

for Nu 1A AI o

at ii l

i n

i it is 44 Is

H i
i
Bases

fall'll t XB
Because CoIA lR3

Xi
2,421,4
3 12 4 0

Il I
i
it t't

L
O 0

dim Nut A 2

Nul A II AI E
 Example let A

4,3
Find a basis for Col A and a basis for
Nal A

L
i

i iii
 i
L

Basis of 61 A

µµ µyµµ

O O

Basis
Theorem
The pivot columns of a matrix A
constitute a basis for Col A

Therefore dim Nul A is the number

of non pivot columns of A we must
reduce the matrix A to find a basis

for Nut A

Rank of a matrix

Definition
The rank of a matrix A is
defined as the dimension of Col A

rank A dim Cola

D Since the pivot columns of a matrix
constitute a basis of Col A then the
rank of A is equal to the number
of pivot columns

Example Compute the rank of the

matrix

I rank as

L
I n
i
 i
i ii i

rank A pivots 3
ExplanatRouche

i
ii

O I no solution

The rank theorem

If the matrix A has n columns

then rank At dim Nut A n
Theorem
Let A be matrix of size nxn The
a

following statements are equivalent

1 A is invertible
2 The columns of A form a basis

of Rn Col A Rn
3 Rank A n Full rank
4 Not A SO dim Nut A o

45 8
Review Problems

1 For each of the following

subsets of IR determine
whether it is a subspace of
IR
3 0
a X t2 2 3

b At 2 2 3 3 4

c X X2 3 0

d x 5x
1
2 Prove that if I Jn spans

so does the list

V then
Jn i Tn Tn
VI VI VI
VT

obtained by subtracting
from
except the last one
each vector
the following vector

T Tz Tn
3 Prove that if t
is

independent in V then
linearly
so is the list
Jn i Tn Tn
VT VI VI VI
4 Suppose that it Tn is
linearly independent in V and
J EV Prove that
if
Ftw Vito Jn tw
is linearly
dependent then
we Span I
Tn3

5 Suppose that V is finite

dimensional and U is a
subspace of V such that
dim U dim V Prove that
U V
 6 Consider the basis of IR
a
Hot fill D
Find the matrix
of change
of basis from C to
B where
c
Holl
7 Let U 412 be the vector subspace
defined by

Find a matrix A such that U NUI A

 Solutions
1 For each of the following
subsets of IR determine
whether it is a subspace of
IR
3 0
a X t2 2 3

b At 2 2 3 3 4

c X X2 3 0

d x 5x
1

a yes
closed under linear combination
 3 0
2 2 3
µ µy

X t2 2 3 3 0 Nut I 2 3

Yes because Null spaces are vector spaces

closed under linear combination

WH X t2 2 3 3 0

w
t

U 12kt 3h3 O Vi 12kt 3Vz o

We need to show that dirt pie w

It
LU [Link] dUitBV Guitar t2kuztpvI
Luz tBVz J t3 XU 1GB O

Luz tpV3

X Ue1242 1343 Vi 12kt 3Vs x Otp 0 0

tp
Then duitpiew

b V At 2 2 3 3 4

NO Ot 2 01 2.0 0 14
E V so V is not a vector subspace

of 1123
 0
W
µ
c X xzX3

No
I

lil't
L

But 1 Iof L 1 0

So W is not closed under addition

d x 5x
1
yes

5 3
1 f
a 5 3 0

Nul I 0 5