Module 1b
Module 1b
26
A field is a non-empty set F together with two binary operations:
20
al
• Addition: + : F × F → F
op
Bh
• Multiplication: · : F × F → F IT
satisfying the following axioms.
II
II-
1. Addition Axiom
ics
at
2. Multiplication Axiom
m
he
3. Distributive Axiom
at
M
Axiom: Addition
g
rin
For all a, b, c ∈ F:
ee
in
1. a + b ∈ F
ng
(Closure)
:E
2. (a + b) + c = a + (b + c) (Associativity)
HI
5. a + b = b + a (Commutativity)
1
Axiom: Multiplication
For all a, b, c ∈ F:
1. ab ∈ F (Closure)
5. ab = ba (Commutativity)
26
20
Axiom: Distributivity Law
al
op
For all a, b, c ∈ F,
Bh
a(b + c) = ab + ac IT
II
Notation
II-
ics
• Rational numbers: Q
:E
HI
• Real numbers: R
• Complex numbers: C
Example 2. Under the usual addition and multiplication, the set of integers
Z is not a field.
2
Vector Spaces over a Field
Vector Space
A non-empty set V is called a vector space over a field F (R or C) if:
• Vector addition + : V × V → V
• Scalar multiplication · : F × V → V
1. Axiom of addition
26
2. Axiom of scalar multiplication.
l20
pa
Vector Space Axioms (Addition)
o
Bh
For all u, v, w ∈ V :
1. u + v = v + u T (Commutative)
II
-I
II
2. (u + v) + w = u + (v + w) (Associative)
s
ic
3. α(βu) = (αβ)u
4. 1u = u
3
Notation
• We say: V is a vector space over the field F.
• We use (V, +, ·) for vector space.
• We also use V (F) for vector space.
Example 3. Consider Rn = {(x1 , x2 , . . . , xn ) : xi ∈ R} under component-wise
addition and and scalar multiplication.
• (Rn , +) is an abelian group.
• Scalar multiplication satisfies all axioms.
• So, (Rn , +, ·) is a vector space over R.
26
20
• The vector space Rn is popularly known as Euclidean Space.
l
pa
Example 4. Consider Cn = {(x1 , x2 , . . . , xn ) : xi ∈ C} under component-wise
o
addition and and scalar multiplication.
Bh
• (Cn , +) is an abelian group. T
II
• Scalar multiplication satisfies all axioms.
-I
II
Example 5. Consider V = Mm×n (R) under the matrix addition and matrix
m
scalar multiplication.
he
scalar multiplication.
En
4
Subspace
Let V be a vector space over a field F. A subset W ⊆ V is called a subspace
of V if W itself is a vector space under the same operations over F.
Example 8. • We know that R3 is a vector space over R.
• Then
W = {(x, y, 0) : x, y ∈ R}
is a subspace of R3 .
26
Let V be a vector space and W ⊆ V . Then W is a subspace of V if and only
20
if:
l
pa
1. 0 ∈ W (Zero Vector)
o
Bh
2. u, v ∈ W ⇒ u + v ∈ W (Addition of two vectors)
T
II
3. α ∈ F, u ∈ W ⇒ αu ∈ W (Scalar multiplication of vector)
-I
II
Equivalent Form
s
ic
at
if:
he
at
1. 0 ∈ W (Zero Vector)
M
g
2. α ∈ F, u, v ∈ W ⇒ u + αv ∈ W (Linear Combination)
rin
ee
Checking:
En
(A + B)T = AT + B T = A + B
5
• Test the Zero Vector:
• For (0, 0, 0) to be in W , it must satisfy the equation:
0 + 0 + 0 = 1 =⇒ 0 = 1 (False!)
Example 12. Is the set of all real skew-symmetric matrices form a subspace
26
of Mn×n (R)?
20
Example 13. Let W be the set of vectors in R2 that lie on either the x-axis
al
op
or the y-axis. That is
Bh
W = {(x, 0) ∪ (0, y) : where x, y ∈ R}.
IT
• Zero Vector: It is there inside W .
II
II-
u + v = (1, 1) ∈
/W
he
at
M
Important Results
in
ng
Theorem
The intersection of two subspaces is always a subspace.
6
What qualifies as a subspace of R3 ?
• The Origin {0, 0, 0} alone (Zero Subspace).
26
20
1. W = {(x, y) ∈ R2 | x = 2y}
l
pa
2. W = {(x, y) ∈ R2 | x2 + y 2 ≤ 1} (The Unit Disk)
o
Bh
3. W = {(x, y, z) ∈ R3 | x + y + z = 0}
T
II
4. W = {(x, y, z) ∈ R3 | x, y, z ∈ Z} (Integers)
-I
II
Exercise 2. Let V = Mn×n (R) (All 2 × 2 real matrices). Check for subspaces:
s
ic
Discussion: Why does the sum of two singular matrices often fail to be
gi
En
singular?
I:
1. W = {p(x) ∈ P2 | p(0) = 0}
2. W = {p(x) ∈ P2 | p(1) = 2}
7
Linear Combination
A vector v is said to be a linear combination of vectors v1 , v2 , . . . , vn if
there exist scalars c1 , c2 , . . . , cn such that:
v = c1 v1 + c2 v2 + · · · + cn vn
26
(3, 4) = 3(1, 0) + 4(0, 1)
20
=⇒ w = 3v1 + 4v2 .
al
op
• w is a linear combination of vectors v1 , v2 .
v = (3, −1).
rin
Solution: Assume that c1 (1, 2) + c2 (3, −1) = (9, 4). Form a System of Equa-
ee
tions
in
(
ng
c1 + 3c2 = 9
:E
2c1 − c2 = 4
HI
8
Spanning Set
Let V be a vector space over the field F and S = {v1 , . . . , vn } be a set of
vectors in V . The Span of S is defined by
X n
Span(S) = ci vi : ci ∈ F
i=1
Results
• The Span of any set S is a subspace of V .
• Span(V ) = V .
26
Example 18. Given S = {(1, 1, 0), (0, 1, 1)}, does S span the vector b =
20
(2, 5, 3)?
al
Solution: We check if c1 (1, 1, 0) + c2 (0, 1, 1) = (2, 5, 3) is consistent.
op
Bh
1. c1 + 0 = 2 =⇒ c1 = 2 IT
2. c1 + c2 = 5
II
II-
3. 0 + c2 = 3 =⇒ c2 = 3
ics
at
2 + 3 = 5 (True!)
he
Answer:
ee
Notation
• The S = {(1, 0), (0, 1)} spans R2
• We say: S = {(1, 0), (0, 1)} generates R2
9
Span of an Infinite Set
Let S be an infinite subset of a vector space V over F. The Span of S is
defined by
X k
+
span(S) = ci vi : k ∈ Z , vi ∈ S, ci ∈ F
i=1
26
20
• Example: f (x) = 5x10 − πx2 + 7. This is a finite combination of
l
pa
{x10 , x2 , 1}.
o
Bh
x2
• What is NOT in the Span? The function ex = 1 + x + 2!
+ ....
T
II
Why? To form ex , you need infinitely many terms from S. Therefore,
-I
ex ∈
/ span(S) in the purely algebraic sense.
II
s
ic
equation:
M
c1 v1 + c2 v2 + · · · + cn vn = 0
g
in
c1 = 0, c2 = 0 = · · · = cn = 0.
n
gi
En
If there exist scalars c1 , c2 , . . . , cn (not all zero) such that the sum equals 0,
the set is Linearly Dependent.
10
Example 21. Check if S = {(1, 2, 1),(2, 1, 0), (1, −1,
−1)} is LI.
1 2 1
Answer: Matrix Formulation: A = 2 1 0
1 −1 −1
1 2 1 1 2 1 1 2 1
R2 →R2 −2R1 R →R −R2
2 1 0 −−−−−−−→ 0 −3 −2 −−3−−−3−−→ 0 −3 −2
R3 →R3 −R1
1 −1 −1 0 −3 −2 0 0 0
26
Determinant Shortcut
l 20
If you have exactly n vectors in Rn (a square matrix):
pa
o
• If det(A) ̸= 0 =⇒ The set is Linearly Independent. (Rank(A) = n)
Bh
T
• If det(A) = 0 =⇒ The set is Linearly Dependent. (Rank(A) < n)
II
-I
Warning! This shortcut only works for square matrices. If you have 2
II
Important Results
he
at
LD.
r
ee
3. Subset Rule:
n
gi
En
Infinite Set
A set S ⊂ V (possibly infinite) is:
• Linearly Independent (LI): If every finite subset of S is linearly
independent.
• Linearly Dependent (LD): If there exists at least one finite subset of
S that is linearly dependent.
Note:
Pn Linear combinations in standard vector spaces are always finite sums:
i=1 ci vi = 0.
11
Example 22. Consider the space of all polynomials P (x) and the set:
S = {1, x, x2 , x3 , . . . , xn , . . . }
• Since a polynomial is zero if and only if all coefficients are zero, we find
c1 = c2 = c3 = 0.
26
S = {(1, 0), (0, 1), (1, 1), (2, 2), (3, 3), . . . }
20
• We look for one finite subset that fails the test.
al
op
• Take the subset S ′ = {(1, 0), (0, 1), (1, 1)}.
Bh
IT
• We can write: 1(1, 0) + 1(0, 1) − 1(1, 1) = (0, 0).
II
II-
Since we found a dependent finite subset, the entire infinite set S is Linearly
ics
Dependent.
at
m
tions:
g
rin
1. B is Linearly Independent.
ee
in
ng
2. span(B) = V .
:E
v = c1 v1 + c2 v2 + · · · + cn vn
Dimension
The Dimension of a vector space V , denoted dim(V ), is the number of vectors
in its basis.
12
Working Rule: The Row Echelon Method
To find a Basis and Dimension from a given set of vectors:
3. Step 3: The non-zero rows of the REF are the basis vectors.
26
S = {(1, 2, 1), (2, 9, 0), (3, 3, 4)}
20
al
op
Solution: Form the matrix:
Bh
1 2 1 1 2 1
IT
R2 −2R1 ,R3 −3R1
A = 2 9 0 −−−−−−−−−−→ 0 5 −2
II
II-
3 3 4 0 −3 1
ics
at
1 2 1
m
R3 + 3 R2
−−−−5−→ 0 5 −2
he
0 0 −0.2
at
M
• And dim = 3
ee
in
ng
Important Results
:E
HI
Important Note
If dim(V ) = n, then n + 1 vectors are always LD, and n − 1 vectors can
never span V .
13
Standard Basis: Definition
The standard basis of a vector space is the simplest basis obtained by choosing
vectors with:
Standard Basis of Rn
The standard basis of Rn is
26
20
E = {e1 , e2 , . . . , en },
al
op
where
Bh
e1 = (1, 0, 0, . . . , 0),
IT
e2 = (0, 1, 0, . . . , 0),
II
II-
..
.
ics
at
en = (0, 0, 0, . . . , 1).
m
Example 25. The standard basis of R3 is {(1, 0, 0), (0, 1, 0), (0, 0, 1)}.
M
Check:
g
rin
1 0 0
ee
in
0 0 1
:E
HI
Standard Basis of R2
The standard basis is
e1 = (1, 0), e2 = (0, 1).
Any vector (a, b) ∈ R2 can be written as
14
Standard Basis of M2×2 (R)
The standard basis is
! ! ! !
1 0 0 1 0 0 0 0
, , , .
0 0 0 0 1 0 0 1
Any matrix !
a b
c d
can be written as a linear combination of these matrices.
26
Exercise 4. 1. Write the standard basis of R4 .
20
2. Express (3, −2, 1) using the standard basis of R3 .
l
opa
Bh
3. Find the standard basis of M3×1 (R).
T
II
The ”Half-Work” Theorem
-I
II
Practical Advantage:
g
r in
• To prove n vectors form a basis, you only need to check Linear Inde-
ee
n
pendence.
gi
En
Important Theorem
A set of exactly n vectors in Rn is a basis if and only if it is
• linearly independent, or
• spanning Rn .
Hence, when the number of vectors is n, checking only one condition is suffi-
cient.
Example 26. Let S = {(1, 2), (3, 5)} in R2 . Here, n = 2 and |S| = 2.
Check for LI:
15
• Since (1, 2) is not a scalar multiple of (3, 5), the set is Linearly Inde-
pendent.
26
20
Hence, {v1 , v2 , v3 } is linearly independent.
l
pa
• So, it is a basis.
o
Bh
Example 28. Consider the set in R2 :
T
II
S = {(1, 0), (1, 1)}
-I
II
(x, y) = (a + b, b)
g
Comparing components:
r in
b = y, a=x−y
nee
• Hence, S spans R2 .
I:
H
• S is a basis of R2 .
16
• det(A) = 2 ̸= 0, so vectors are LI.
• It is a basis of R3 .
Example 30. R over R
• Any a ∈ R can be written as a = a · 1.
26
20
Example 32. C over R (Reals as scalars)
l
pa
• Any z ∈ C can be expressed as z = a · 1 + i · b
o
Bh
• Basis: {1, i}, Dimension: 2
T
II
Example 33. C over C (Complex as scalars)
-I
II
• Basis: {((1, 0), (i, 0), (0, 1), (0, i)}, Dimension: 4
Example 36. The space of polynomials of degree at most n.
• Example: P2 [x] (Quadratic polynomials)
• Dimension: n + 1
Example 37. The space of all m × n matrices with entries in R.
17
• Basis: The set of matrices Eij having a 1 at position (i, j) and 0 else-
where.
• Example M2×2 :
! ! ! !
1 0 0 1 0 0 0 0
, , ,
0 0 0 0 1 0 0 1
26
20
• Constraint: The off-diagonal elements must be equal.
l
pa
• Basis:
o
! ! !
Bh
1 0 0 1 0 0
, ,
0 0 1 0 0 1 T
II
-I
• Dimension: 3
II
trices of order n?
at
m
order n?
at
M
Coordinate Representation
Let B = {v1 , v2 , . . . , vn } be a basis of V . For v ∈ V , if
v = a1 v1 + a2 v2 + · · · + an vn ,
then a1 , a2 , . . . , an are called the coordinates of v with respect to B.
a1
a2
[v]B = ..
.
an
18
Theorem
Let B = {v1 , v2 , . . . , vn } be a basis of V . Then every vector v ∈ V has a
unique coordinate representation with respect to B.
Example 39. The standard basis of Rn is
E = {e1 , e2 , . . . , en }
where
e1 = (1, 0, . . . , 0), e2 = (0, 1, . . . , 0), . . . , en = (0, 0, . . . , 1)
For v = (x1 , x2 , . . . , xn ),
x1
26
x2
[v]E = ..
20
.
al
xn
op
Bh
Example 40. Let B = {(1, 1), (1, −1)} and v = (2, 0). Find [v]B .
Answer: Assume
IT
(2, 0) = a(1, 1) + b(1, −1).
II
II-
Then
ics
(2, 0) = (a + b, a − b).
at
Equating components:
m
he
(
at
a+b=2
⇒ a = 1, b = 1.
M
a−b=0
g
rin
!
1
ee
[v]B =
in
1
ng
:E
and
v = (2, 1, 3).
Find [v]B .
Answer:
2
[v]B = 1
0
Exercise 6. 1. Find the coordinates of (3, 2) with respect to {(1, 2), (2, 1)}.
2. Let B = {(1, 1, 0), (0, 1, 1), (1, 0, 1)}. Find [(1, 2, 3)]B .
3. Write (1, 0) in the basis {(1, 1), (1, −1)}.
19
Polynomial Spaces Pn (x)
For the space of polynomials of degree ≤ n, the standard basis is:
B = {1, x, x2 , . . . , xn }
Example 42. Consider P2 (x). Any quadratic polynomial p(x) = ax2 + bx + c
is a linear combination of the base elements.
Crucial Result:
• The dimension of Pn (x) is n + 1.
• This is because we must include the constant term x0 = 1.
26
20
For m × n matrices, the basis elements Eij have a 1 at the (i, j) position.
For M2×2 :
al
op
" # " # " # " #
1 0 0 1 0 0 0 0
Bh
E11 = , E12 = , E21 = , E22 =
0 0 0 0 1 0IT 0 1
• Dimension: m × n.
II
II-
" #
a b
ics
dim(V ) = n
:E
Hence,
dim(R3 ) = 3
Any basis of R3 must contain exactly 3 vectors.
20
Polynomial Space
Consider
P2 = {a0 + a1 x + a2 x2 | a0 , a1 , a2 ∈ R}
A basis is:
{1, x, x2 }
Therefore,
dim(P2 ) = 3
Finite-Dimensional
• Has a finite basis
26
20
• Every spanning set contains a basis
l
pa
• Every LI set can be extended to a basis
o
Bh
T
II
Infinite-Dimensional
-I
II
• No finite basis
s
ic
at
Dimension of Subspaces
g
rin
then
n
gi
dim(W ) ≤ dim(V )
En
I:
W = {(x, y, z) ∈ R3 | x + y + z = 0}.
Hence,
dim(W ) = 2 < dim(V ) = 3
21
Exercise 7. 1. Find the dimension of the space of 2 × 3 matrices.
4. Find the dimension of the subspace spanned by {(1, 2, 3), (2, 4, 6)}.
26
20
al
op
Bh
IT
II
II-
ics
at
m
he
at
M
g
rin
ee
in
ng
:E
HI
22