Chapter Three Matrices
Chapter Three Matrices
Three:
Matrices
Department of
Mathematics
Department of Mathematics
November 9, 2025
Chapter
Three:
Matrices
Department of
Mathematics
First Draft
Department of
Mathematics Introduction
This chapter investigates matrices and algebraic
operations defined on them.
These matrices may be viewed as rectangular arrays of
elements where each entry depends on two subscripts (as
compared with vectors, where each entry depended on
only one subscript).
Systems of linear equations and their solutions may be
efficiently investigated using the language of matrices
Chapter
Three:
Matrices
Definition
A matrix A over a field K is a rectangular array of scalars from
K presented in the following form
a11 a12 · · · a1n
a21 a22 · · · a2n
A= .
.. ..
.. . ··· .
am1 am2 · · · amn
Chapter
Three:
Matrices
The rows of such a matrix A are the m horizontal lists of
Department of scalars:
Mathematics
x +y =5
x −y =3
2z + t = 6
z −t =3
Definition
Let A = (aij )m×n and B = (bij )m×n be two matrices and k ∈ K
be a scalar
The sum A + B is defined as
kA = (kaij )m × n
Chapter
Three:
Matrices
Department of
Mathematics
Remark:
We also define
−A = (−1)A and
A − B = A + (−B)
The matrix −A is called the negative of the matrix A, and
A − B is called the difference of the matrix A and B.
The sum of matrices with different sizes is not defined
Chapter
Three:
Matrices
Department of Exercise:
Mathematics
−1 2 −3 1 2 −1 4 3
1. Let A = and B =
2 0 4 1 −1 2 −2 1
Then find
a. A + B
b. 3A − 2B
1 −1 −2 3
2. Let A = 2 1 and B = 1 −2. Then find
−1 3 −1 4
a. 4A, − 5B
b. 4A + 5B
c. 5A − 2B
Chapter Basic properties of matrix addition and scalar multiplication:
Three:
Matrices We have the following theorem
Department of
Mathematics Theorem
Consider any matrices A, B, C (with the same size) and any
scalars k and k 0 . Then
1 A + (B + C ) = (A + B) + C
2 A+0=0+A=A
3 A + (−A) = (−A) + A = 0
4 A+B =B +A
5 k(A + B) = kA + kB
6 (k + k 0 )A = kA + k 0 A
7 (kk 0 A) = k(k 0 A)
8 1A = A
where 0 is the zero matrix.
Chapter
Three: Matrix Multiplication
Matrices
Department of
The product of matrices A and B, written AB, is
Mathematics somewhat complicated. For this reason, we first begin
with a special case.
Consider a row matrix A = (aj )1×n and a column matrix
B = (bj )n×1 , then the product
b1
b2
AB = a1 a2 · · · an .
..
bn
n
X
= a1 b1 + a2 b2 + · · · + an bn = aj bj
j=1
Chapter
Three:
Matrices
Department of
Examples
Mathematics
3
1. 1 2 3 2 = 1(3) + 2(2) + 3(1) = 10
1
2.
2
−2
−2 3 4 1 1 = −2(2) + 3(−2) + 4(1) + 1(4)
4
= −2
Chapter
Three:
Matrices We are now ready to define matrix multiplication in general.
Department of
Mathematics
Definition
Suppose A = (aik )n×p and B = (bkj )p×m be two matrices such
that the number of columns of A are equal to the number of
rows of B , then the product AB is the n × m matrix whose
ij − entry of AB is obtanined by multiplying the i th − row of A
and the j th column of B.i.e.
AB = (cij )n×m
where
cij = ai1 b1j + ai2 b2j + · · · + ain bnj
Chapter
Three:
Matrices
Department of
Mathematics Graphically, we have
Department of
Mathematics
Remark
1 2 5 6
Suppose A = and B = , then
3 4 0 −2
5 2 23 34
AB = and BA =
15 10 −6 −8
Department of
Mathematics
Transpose of a Matrix
Definition
The transpose of a matrix A, denoted by AT , is the matrix
obtanied by writing the columns, in order, as rows and vice
versa.i.e if A = (aij )n × m, then
AT = (aji )m×n
Chapter
Three:
Matrices
Department of
Mathematics
Example:
1 4
1 2 3
1 Let A = , then AT = 2 5
4 5 6
3 6
−1 2 −1 −1 3 0
2 Let B = 3 1 2 , then B T = 2 1 1
0 1 2 −1 2 2
Chapter
Three:
Matrices
Department of The next theorem lists the basic properties of the transpose
Mathematics
operation.
Theorem
Let A and B be matrices and let k be a scalar. Then, whenever
the sum and product are defined,
1 (A + B)T = AT + B T
2 (AT )T = A
3 (kA)T = kAT
4 (AB)T = B T AT
Chapter
Three: Square Matrices
Matrices
Department of Definition
Mathematics
A matrix A is said to be a square matrix if it has the same rows
as columns.
Example: The following are square matrices
−1 2 1
1 2
(2), , 2 1 3 , e.t.c.
3 4
1 1 2
Department of
Mathematics
Theorem
Suppose A = (aij ) and B = (bij ) be an n − square matrices and
k a scalar. Then
1 tr (A + B) = tr (A) + tr (B)
2 tr (kA) = [Link] (A)
3 tr (AT ) = tr (A)
4 tr (AB) = tr (BA)
Chapter
Three: Examples
Matrices
Department of
1 2 1 −2 3 1
Mathematics 1. Let A = 3 0 4 and B = 3 4 2 Then
−1 2 −3 1 1 −2
Diagonal(A) = [1, 0, −3] and Diagonal(B) = [−2, 4, −2]
tr (A) = 1 + 0 + (−3) = −2 and
tr (B) = (−2) + 4 + (−2) = 0
Using this example verify the above theorem.
3 2 1 3 1 5
2. Let A = 1 4 −2 and B = −1 2 5. Then find
5 1 4 2 1 1
a. tr (A + B)
b. tr (3A)
c. tr (4A + 3B)
d. tr (2A + 3B)T
Chapter
Three:
Matrices 3.2 Special Types of matrices
Department of
Mathematics 1. Identity Matrix: The n − square identity or unit matrix,
denoted by In , or simply I , is the n − square matrix with
10 s on the diagonal and 00 s elsewhere. i.e.
1 0 0 ··· 0
0 1 0 · · · 0
In = . . .
.
.. .. .. · · · ..
0 0 0 ··· 1
AIn = A = In A
Chapter
Three:
Matrices
Department of
Mathematics
Example
The following are identity matrices
1 0 0 0
1 0 0
1 0 0 1 0 0
, 0 1 0 , , etc
0 1 0 0 1 0
0 0 1
0 0 0 1
Chapter
Three:
Matrices
Department of
Mathematics 3. Invertible(Nonsinguar) matrices: An n − square matrix
A is said to be non singular if there exist an n − square
matrix B such that
AB = In = BA
Department of
Mathematics
4. Upper Triangular matrices: An n − square matrix A is
siad to be upper triangular if all the elements below the
main diagonal are zero.
Examples: The following are upper triangular matrices:
−1 0 2 0
1 2 0
0 0 1 , 2 4 , 0 0 0 1
0 1 0 0 3 1
0 0 2
0 0 0 2
Chapter
Three:
Matrices
Department of
Mathematics
5. Lower Triangular matrices: An n − square matrix A is
said to be lower triangular if all the elements above the
main diagonal are zero.
Examples: The following are lower triangular matrices
1 0 0 2 0 0
2 0
0 1 0 , , 1 3 0 , · · ·
1 4
0 0 1 1 2 4
Chapter
Three:
Matrices
6. Diagonal matrix: An n − square matrix A is said to be
Department of
Mathematics diagonal matrix if all its nondiagonal matrices are zero.
Examples: The following are diagonal matrices
0 0 0 1 0 0 2 0 0
0 0 0 , 0 1 0 , 0 4 0 , · · ·
0 0 0 0 0 1 0 0 2
AB = BA = I
Example
2 5 3 −5
Suppose A = and B = , then
1 3 −1 2
6 − 5 −10 + 10 1 0
AB = =
3 − 3 −5 + 6 0 1
and
6 − 5 15 − 15 1 0
BA = =
−2 + 2 −5 + 6 0 1
Hence, A and B are inverses of each other.
Chapter
Three:
Matrices
Theorem
Department of Suppose A and B are invertible(of same size), then AB is
Mathematics
invertible and
(AB)−1 = B −1 A−1
Proof: Here
Hence
B −1 A−1 is inverse of AB
But, (AB)−1 is inverse of AB
So ,
(AB)−1 = B −1 A−1 (by uniqueness)
Chapter
Three:
In general, if A1 , A2 , · · · , An are invertible matrices (of
Matrices
same sizes), then A1 A2 · · · An is invertible and
Department of
−1 −1
Mathematics
(A1 A2 · · · An )−1 = A−1
n · · · A2 A1
and
ax2 + by2 = 0
cx2 + dy2 = 1
Department of
Mathematics That means,
−1 1 d −b
A =
|A| −c a
Hence, if |A| =
6 0,then to find the inverse of a 2 × 2
matrix, we have these simple steps
Interchange the elements on the main diagonal
Multiply the other two elements by −1
1
Multiply the resulting matrix by |A| , or Equivalently, divide
each element by |A|
If |A| = 0, the matrix has no inverse.
Chapter
Three:
Matrices
Department of
Mathematics
Exercises: Find the inverses of the following matrices
1 3
1 A=
2 5
3 4
2 B =
2 5
1 2
3 C =
2 3
Chapter
Three:
Matrices
Department of
Mathematics
Inverse of an n × n matrix:
Suppose A is an n − square matrix
Finding its inverse, A−1 , to finding the solution of a
collection of n × n systems of linear equations.
We will study an effcient method in finding A−1 in chapter
4.
Chapter
Three:
Matrices
Department of
Mathematics
Department of
Mathematics
Examples: The following matrices are in echelon form, where
the pivots are circled.
1 2 3 4
1 0 0 0 3 4 2 1
0 2 0 4
, 0 0 ,
2 0 0 0 1 2
0 0 3 −1
0 0 0 0 0 0 0 1
0 0 0 0
Chapter
Three:
Matrices Exercise: Identify which of the following matrices are in
Department of echelon form:
Mathematics
0 1 2 0 4
0 0 3 1 2
1 A=
0 0 0 0 1
0 0 0 0 0
2 1 3 1 −1
0 0 0 0 0
2 B =
0 0 2 0 −2
0 0 0 0 2
1 2 3
3 C = 0 2 1
2 0 3
Chapter
Three: Row Canonical Form:
Matrices
Department of
Definition
Mathematics
A matrix A is said to be in row canonical form (or row-reduced
echelon form) if it is an echelon matrix that is, if it satisfies the
above properties (1) and (2), and if it satisfies the following
additional two properties:
3. Each pivot (leading nonzero entry) is equal to 1.
4. Each pivot is the only nonzero entry in its column.
Question:
1 What is the major difference b/ n echelon form and Row
cannonical form? Explain !
2 Is the zero matrix 0 of any size in row cannonical form?
What a bout the identity matrix I of any size?
Chapter Elementary Row Operations
Three:
Matrices
Suppose A is a matrix with rows R1 , R2 , · · · , Rm . The following
Department of
Mathematics operations on A are said to be elementary row operation
[E1 ] (Row Interchange): Interchange rows Ri and Rj . This
may be written as
Ri ↔ Rj
[E2 ] (Row scaling) Replace row Ri by a nonzero multiple kRi
of itself. This may be written as
kRi → Ri
kRi + Rj → Rj
Chapter
Three:
Matrices
Department of
Mathematics
Row Equivalence
Definition
A matrix A is said to be row equivalent to a matrix B, written
A∼B
Department of
Mathematics Theorem
Suppose A = (aij ) and B = (bij ) are row equivalent echelon
matrices with respective pivot entries
Then A and B have the same number of nonzero rows - that is,
r = s−and the pivot entries are in the same positions-that is,
j1 = k1 , j2 = k2 , · · · , jr = kr
Chapter
Three:
Matrices
Department of
Mathematics
Theorem
Every matrix A is row equivalent to a unique matrix in row
canonical form. This unique matrix is called the row cannonical
form of A.
Chapter
Three:
Matrices
Example
Department of
Mathematics
Find the echelon form of the matrix
1 2 3
A = 0 0 0
2 3 4
Solution:
1 2 3 1 2 3 1 2 3
R2 ↔R3 −2R +R2 →R2
0 0 0 − −−−→ 2 3 4 −−−−1−−− −−→ 0 −1 2
2 3 4 0 0 0 0 0 0
1 2 3
Hence, 0 −1 2 is echelon form of A
0 0 0
Chapter
Three:
Example
Matrices
Department of
Find the echelon form of the matrix
Mathematics
1 2 −3 1 2
A = 2 4 −4 6 10
3 6 −6 9 13
Solution:
1 2 −3 1 2 1 2 −3 1 2
−3R +R3 →R3
A = 2 4 −4 6 10 −−−−1−−− −−→ 0 0 2 4 6
−2R1 +R2 →R2
3 6 −6 9 13 0 0 3 6 7
− 23 R2 +R3 →R3
1 2 −3 1 2
−−−−−−−−−→ 0 0 2 4 6
0 0 0 0 −2
So, the matrix is in row echelon form.
Chapter
Three:
Matrices
Exercise: Determine the row echelon form of the following
Department of
Mathematics matrices:
1 0 2
1 A = 2 −1 3
4 1 8
1 2 −1 3 4
3 6 −3 9 12
2 B =
2 4 5 2 1
0 2 1 2 1
2 −2 2 1
3 C = −3 6 0 −1
1 −7 10 2
Chapter
Three:
Matrices
Department of
Mathematics
Example
1 2
The rank of the matrix A = is 1.
3 6
1 2 −3R1 +R2 →R2 1 2
Solution: −−−−−−−−−→
3 6 0 0
So, A has one pivot and hence rank(A) = 1
Equivalently, the row vectors (1, 2) and (3, 6) are linearly
dependent, hence rank(A) must be 1.
Chapter
Three:
Matrices Example
Department of
Mathematics
1 2 3
Determine the rank of the matrix B = 4 5 6
7 8 9
C3 = −C1 + 2C2
hence, its rank < 3. But any two columns of this matrix are
linearly independent. Hence
rank(B) = 2
Chapter
Three:
Matrices
Department of
Exercise: Determine the rank of the following matrices:
Mathematics
1 0 3
1 A = 0 2 0
0 0 0
−1 3 2
2 B = 2 0 1
0 1 1
1 2 3 4
−1 2 1 1
3 C =
3 2 1 4
2 1 0 2
Chapter
Three:
Matrices
Department of
Mathematics 3.6 Applications to Systems of linear Equations:
One way to solve a system of linear equations is by
working with its augmented matrix M rather than the
equations themselves.
Specifically, we reduce M to echelon form (which tells us
whether the system has a solution), and then further
reduce M to its row canonical form (which essentially gives
the solution of the original system of linear equations).
The justification for this process comes from the following
facts:
Chapter
Three:
Matrices
Department of
(1) Any elementary row operation on the augmented matrix
Mathematics M of the system is equivalent to applying the
corresponding operation on the system itself.
(2) The system has a solution if and only if the echelon form
of the augmented matrix M does not have a row of the
form (0, 0, · · · , 0, b) with b 6= 0.
(3) In the row canonical form of the augmented matrix M
(excluding zero rows), the coefficient of each basic variable
is a pivot entry equal to 1, and it is the only nonzero entry
in its respective column; hence, the free-variable form of
the solution of the system of linear equations is obtained
by simply transferring the free variables to the other side.
Chapter
Three: Example
Matrices
x1 + x2 − 2x3 + 4x4 = 5
2x1 + 2x2 − 3x3 + x4 = 3
3x1 + 3x2 − 4x3 − x4 = 1
x +y +z =2
2y + 3z = 4
−x + 2y + 3z = 2
2x + 3y + z + 2t = 4
x − z + 2t = 5
3x − 4z + 4t = −4
−x − y + 2z + 4t = 2
Chapter
Three:
Example
Matrices
Department of
Solve the system
Mathematics
x1 + x2 − 2x3 + 4x4 = 5
2x1 + 2x2 − 3x3 + x4 = 3
3x1 + 3x2 − 4x3 − x4 = 1
x1 + x2 − 10x4 = −9
x3 − 7x4 = −7
or
x3 = −7 + 7x4
x1 = −9 + 10x4 − x2
Hence, x2 and x4 are the free variables and x1 and x3 are the
pivot variables.
Chapter
Three:
Example
Matrices
Department of
Solve the system of the equations
Mathematics
x + y − 2z + 3t = 4
2x + 3y + 3z − t = 3
5x + 7y + 4z + t = 5
Department of
Mathematics
There is no need to continue to find the row canonical
form of M, because the echelon form already tells us that
the system has no solution.
Specifically, the third row of the echelon matrix
corresponds to the degenerate equation
0x + 0y + 0z + ot = −5
x + 2y − z + 3w = 7
2x − y + 4z + w = 3
3x + y + 2z − 2w = 5
2.
2x + y + 3z − w = 4
x − 2y + z + 2x = 1
3x + y − 4z + w = 6
2x − 2y + 3x − 4w = 5
Chapter
Three:
Matrices
Department of 3.
Mathematics
x + 2y + 3z = 1
x + 3y + 6z = 3
2x + 6y + 13z = 5
4.
x + 2y − z = 3
x + 3y + z = 5
3x + 8y + 4z = 17
Chapter
Three:
Chapter Three: Worksheet III
Matrices
1 −2 3 3 0 3
Department of 1. Given A = and B = . Then
Mathematics 2 −1 4 −7 1 8
compute
a. 3A − 2B
b. (2A + 3B)T
2. Find x, y , z, t such that
x y x 6 4 x +y
3 = +
z t −1 2t z +t t
AB = B 5 A and B 6 = I
Department of 10. Find the echelon form and Row cannonical form of the
Mathematics following matrices
1 2 3 4
2 4 5 6
a. A =
3 6
4 2
2 4 1 5
−2 1 3 4
b. B = 1 5 4 1
0 2 3 1
0 0 0 0
1 −1 2 1
c. C =
−1
2 1 4
2 1 1 1
Chapter
Three: 11. Write the augmented matrix and solve the following
Matrices
system of equations
Department of
Mathematics a.
x + 2y − z + w = 5
2x − y + 3z − 2w = 4
3x + y + 2z + w = 10
x − y + z + 2w = 3
b.
2x + 3y − w = 7
x − y + 2z + w = 4
3x + y + z − w = 5
4x − 2y + 3z + w = 10
Chapter
Three:
Matrices c.
Department of
Mathematics
x +y +z +w =6
2x − y + 3z − w = 4
3x + 2y − z + 2w = 5
4x − 3y + 2z + w = 8
d.
2x + y − z + 3w = 9
x − 2y + 4z + w = 3
3x + 2y + z − 2w = 7
x + 3y + 2z + w = 10