Chapter 5
Chapter 5
Introduction
In addition to the two basic operations of vector spaces, we encounter other operations
between vectors when studying specific cases. In this chapter, we examine vector spaces
equipped with inner products, alongside the study of bilinear forms and quadratic forms
on vector spaces.
Chapter Contents:
1. Bilinear Forms
2. Quadratic Forms
3. Euclidean Spaces
Contents
1 Bilinear Forms 3
1.1 Concept of Bilinear Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.2 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.3 Matrix and Expression of a Bilinear Form . . . . . . . . . . . . . . . . . . . . . . 4
1.3.1 Coordinate Expression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.3.2 Change of Basis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2 Quadratic Forms 5
2.1 Concept of Quadratic Forms and Relation to Symmetric Bilinear Forms . . . . . 6
2.2 Matrix and Expression of a Quadratic Form . . . . . . . . . . . . . . . . . . . . . 6
2.2.1 Coordinate Expression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.3 Definite Quadratic Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.4 Methods for Reducing Quadratic Forms to Canonical Form . . . . . . . . . . . . 7
2.4.1 Lagrange’s Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.4.2 Jacobi’s Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.5 Sylvester’s Criterion for Definite Quadratic Forms . . . . . . . . . . . . . . . . . 9
2.6 Law of Inertia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
3 Euclidean Spaces 9
3.1 Concept of Inner Product and Definition of Euclidean Space . . . . . . . . . . . . 10
3.2 Length and Angle of Vectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
3.3 Orthogonality Relations in Euclidean Spaces . . . . . . . . . . . . . . . . . . . . 11
3.3.1 Properties of Orthonormal Bases . . . . . . . . . . . . . . . . . . . . . . . 12
3.3.2 Gram-Schmidt Orthogonalization . . . . . . . . . . . . . . . . . . . . . . . 12
3.3.3 Orthogonal Projection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.4 Orthogonal Matrices and Orthogonal Transformations . . . . . . . . . . . . . . . 13
3.5 Orthogonal Diagonalization of Symmetric Matrices . . . . . . . . . . . . . . . . . 14
3.5.1 Orthogonal Diagonalization Problem . . . . . . . . . . . . . . . . . . . . . 14
3.6 Symmetric Transformations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.7 Reducing Quadratic Forms to Canonical Form by Orthogonal Method . . . . . . 16
2
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
1 Bilinear Forms
On an R-vector space V , when considering linear maps from V to R, we have linear forms. When
considering maps from V × V to R that are linear in each variable, we have bilinear forms. More
generally, maps from V n to R that are linear in each variable give us multilinear forms. To better
understand multilinear forms, we begin with bilinear forms—a concept encountered frequently
in familiar vector spaces.
Objectives
Knowledge: Students understand the concept of bilinear forms on a vector space, com-
mon examples, and computational aspects related to bilinear forms.
Skills: Verify the bilinear form concept, determine the matrix and expression of a bilinear
form.
f : V × V → R, (u, v) 7→ f (u, v)
1.2 Examples
Example 1.2 (Examples of Bilinear Forms). 1. Let V = R2 . Consider the map:
2. More generally, let V = Rn and A be a square matrix of order n. Consider the map
f (x, y) = [x]T A[y], where if x = (x1 , x2 , . . . , xn ) then [x] = [x1 x2 · · · xn ], and we identify
the 1 × 1 matrix [a] with the real number a. Then f is a bilinear form on Rn .
is a bilinear form.
3
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
5. Let V = C[a, b] be the space of continuous functions on the interval [a, b]. The map
T : V × V → R given by:
Z b
T (f (x), g(x)) = f (x)g(x) dx
a
is a bilinear form.
where aij = f (ui , uj ), is called the matrix of the bilinear form f with respect to basis B.
Example 1.4. Consider the bilinear form on V = R2 given by:
where x = (x1 , x2 ), y = (y1 , y2 ). The matrix of f with respect to the standard basis of R2 is:
1 2
A=
−1 3
4
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
• f (u2 , u3 ) = 8
• f (u3 , u1 ) = 3
1 4 7 1
• f (2u1 + u2 − u3 , u1 − u2 + 3u3 ) = [2 1 − 1] 2 5 8
−1 = 33
3 6 9 3
A2 = C T A1 C
Example 1.7. Let V = R2 with bilinear form f ((x1 , x2 ), (y1 , y2 )) = 3x1 y1 +2x1 y2 −x2 y1 +4x2 y2
and basis B = {u1 = (1, 2), u2 = (3, 4)}. Find the matrix of f with respect to basis B.
Solution: The matrix of f with respect to the standard basis is:
3 2
A1 =
−1 4
2 Quadratic Forms
A quadratic form is a polynomial in several variables where all terms are monomials of degree
2. In this section, we approach quadratic forms from the perspective of vector spaces and
symmetric bilinear forms. Through this, we examine some properties of quadratic forms in
relation to symmetric matrices.
Objectives
Knowledge: Students understand the concept of quadratic forms and their properties.
Skills: Determine the relationship between quadratic forms and symmetric bilinear
forms, methods for reducing quadratic forms to canonical form, examine positive def-
inite and negative definite quadratic forms.
5
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
2. More generally, let A be a symmetric matrix of order n. Consider the symmetric bilinear
form f on Rn given by f (x, y) = [x]T A[y]. Then φ(x) = [x]T A[x] gives the associated
quadratic form.
3. Let V = Pn [x]. The symmetric bilinear form f : V × V → R defined by:
f (p(x), q(x)) = p(0)q(0) + p(1)q(1)
has associated quadratic form φ(p(x)) = p(0)2 + p(1)2 .
4. Let V = C[a, b] be the space of continuous functions on [a, b]. The symmetric bilinear
form T : V × V → R defined by:
Z b
T (f (x), g(x)) = f (x)g(x) dx
a
Rb 2
has associated quadratic form φ(f (x)) = a [f (x)] dx.
6
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Then:
Xn n
X n
X n
X
φ(u) = f (u, u) = f xi ui , xj uj =
xi xj f (ui , uj ) = aij xi xj
i=1 j=1 i,j=1 i,j=1
The formula φ(u) = ni,j=1 aij xi xj , written in matrix form as φ(u) = [u]TB ·A·[u]B = X T AX,
P
is called the (coordinate) expression of the quadratic form φ with respect to basis B.
When A = diag(a1 , a2 , . . . , an ) is a diagonal matrix, we have:
A2 = C T A1 C
b 2 4ac−b2
1. ax2 + bx + c = a x +
2a + 4a
7
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Example 2.7. Let φ = x21 + 2x22 + 5x23 − 2x1 x2 + 4x1 x3 . Reduce to canonical form.
Solution:
in canonical form.
Example 2.8. Let φ = x1 x2 − 2x2 x3 . Reduce to canonical form.
Solution: Setting x1 = y1 + y2 , x2 = y1 − y2 , x3 = y3 :
Setting z1 = y1 − y3 , z2 = y2 − y3 , z3 = y3 :
φ = z12 − z22
2. Every quadratic form can be reduced to canonical form and normal form.
3. For a symmetric matrix A, there always exists an invertible matrix C such that C T AC is
diagonal.
4. For a quadratic form φ associated with symmetric bilinear form f , there always exists a
basis B = {u1 , u2 , . . . , un } of V satisfying f (ui , uj ) = 0 for all i ̸= j.
8
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
3 Euclidean Spaces
In ordinary vector spaces, we are familiar with concepts such as inner product, angle between
vectors, length, orthogonality relation, orthogonal projection, etc. A natural question is: do
these concepts exist in general vector spaces? How are these concepts constructed and applied?
Objectives
9
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Example 3.2 (Examples of Inner Products). 1. The bilinear form f on R2 given by:
f (x, y) = x1 y1 + x2 y2
2. More generally, let A be a symmetric matrix of order n. Consider the symmetric bilinear
form f on Rn given by:
f (x, y) = [x]T A[y]
This is an inner product if and only if A has all positive principal minors.
is symmetric but not positive definite (e.g., f (x2 −x, x2 −x) = 0 but x2 −x ̸= 0). Therefore,
this is not an inner product.
4. Let V = C[a, b] be the space of continuous functions on [a, b]. The bilinear form T :
V × V → R defined by:
Z b
T (f (x), g(x)) = f (x)g(x) dx
a
Rb 2
is symmetric and the associated quadratic form φ(f (x)) = a [f (x)] dx is positive definite.
Thus T is an inner product on V .
Definition 3.3 (Euclidean Space). A real vector space of dimension n equipped with an inner
product is called an n-dimensional Euclidean space. The inner product on a Euclidean
space is usually denoted by ⟨·, ·⟩.
This is an inner product called the standard inner product of Rn , giving us the Euclidean
space Rn .
10
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
|⟨u, v⟩|
≤1
∥u∥ · ∥v∥
⟨u,v⟩
Therefore, the real number r = ∥u∥·∥v∥ can be viewed as the cosine of an angle α, i.e., there
exists an angle α, 0 ≤ α ≤ π, such that:
⟨u, v⟩
cos α =
∥u∥ · ∥v∥
Definition 3.8 (Orthogonality Concepts). 1. Two vectors u, v are called orthogonal if ⟨u, v⟩ =
0.
11
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
1. For any u ∈ V , the coordinates of u with respect to basis B are [u]TB = (x1 x2 · · · xn )
where xi = ⟨u, ui ⟩, 1 ≤ i ≤ n. In other words:
⟨u, v⟩ = X T Y = x1 y1 + x2 y2 + · · · + xn yn
where:
⟨ej , ur ⟩
krj = − , j = 1, 2, . . . , r − 1
⟨ej , ej ⟩
After normalizing this system, we obtain an orthonormal basis of V .
12
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
23
Solving: x1 = 15 , x2 = 59 . Therefore:
23 9 10 73 104
ProjU (v) = (1, 2, 1) + (1, 1, 3) = , ,
15 5 3 15 15
• A is an orthogonal matrix
• |A|2 = 1
Proposition 3.15. Let V be a Euclidean space. Let P be the change-of-basis matrix from one
orthonormal basis B1 to another orthonormal basis B2 of V . Then P is an orthogonal matrix.
Definition 3.16 (Orthogonal Transformation). Let V be a Euclidean space with inner product
⟨·, ·⟩. A linear transformation f on V is called an orthogonal transformation if ∥f (v)∥ = ∥v∥
for all v ∈ V .
• f is an orthogonal transformation
13
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Example 3.17. Consider the linear transformation f on V = R3 with standard inner product
having matrix: 1
√1 − √13
√
6 2
A = √26 0 √1
3
− √16 √12 √1
3
Therefore:
y1 x1
y12 + y22 + y32 = y1 y2 y2 = x1 x2 x3 A A x2 = x21 + x22 + x23
T
y3
y3 x3
2. Distinct eigenspaces of A are orthogonal to each other. Moreover, the eigenspace corre-
sponding to eigenvalue λi has dimension ri .
3. Matrix A is diagonalizable.
C −1 AC = C T AC = D
14
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
4 − λ −1 2
PA (λ) = −1 4 − λ 2 = −λ3 + 9λ2 − 15λ − 25 = −(λ + 1)(λ − 5)2
2 2 1−λ
Eigenvalues: λ = −1, 5.
Step 2:
√
1/√6
• For λ = −1: eigenspace VA (−1) has orthonormal basis B1 = 1/ √6
−2/ 6
√ √
1/ √2 1/√3
• For λ = 5: eigenspace VA (5) has orthonormal basis B2 = −1/ 2 , 1/√3
0 1/ 3
diagonalizes A:
−1 0 0
C −1 AC = C T AC = 0 5 0
0 0 5
• f is a symmetric transformation
• There exists an orthonormal basis of V such that the matrix of f with respect to this
basis is diagonal
⟨f (u), v⟩ = [f (u)]TE [v]E = (A[u]E )T [v]E = [u]TE AT [v]E = [u]TE A[v]E = [u]TE [f (v)]E = ⟨u, f (v)⟩
15
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Example 3.22. Reduce the quadratic form ω(x1 , x2 , x3 ) = 2x21 − x22 − x23 + 4x2 x3 to canonical
form by orthogonal method (specify the transformation).
Solution (summary):
2 0 0
Matrix of ω with respect to standard basis: A = 0 −1 2
0 2 −1
Characteristic equation:
Objectives
16
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
Skills: Transform equations of curves and surfaces to determine the types of second-
degree curves and surfaces.
xT Ax + aT x + a0 = 0
we reduce the equation to canonical form and classify the second-degree curves and surfaces.
6. Parabola: x2 = py
17
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
x2 − 2xy + y 2 + 4x + 2y − 6 = 0
Example 4.2. Identify the second-degree curve (C): 5x21 + 8x22 − 4x1 x2 = 36
5 −2
Solution: Quadratic form h = 5x21 + 8x22 − 4x1 x2 has matrix A =
−2 8
(
5 − λ −2 λ1 = 4
Characteristic equation: =0⇔
−2 8 − λ λ2 = 9
√ √
2/√5 −1/√ 5
Orthogonal diagonalization with matrix C =
1/ 5 2/ 5
x1 y
Setting =C 1 :
x2 y2
y2 y2
Equation becomes: 4y12 + 9y22 = 36 ⇔ 91 + 42 = 1
Therefore (C) is an ellipse with semi-axes 3 and 2.
18
Chapter 5: Euclidean Spaces and Quadratic Forms MI1141 - Linear Algebra
19