Inner Product &
Orthogonality
CHAPTER OUTLINE
Introduction
Norm of the Vector, ui
Examples of Inner Product Space
- Euclidean n-space R
n
- Function Space Ca, b , Polynomial Space P(t )
Angle between Vectors
Orthogonal & Orthonormal Set
Normalizing Vector
Gram Schmidt Process
INNER PRODUCT SPACE
Is a vector space, V with an inner product
, : V V F
Satisfy the following 3 axioms, for all vectors
x, y, z V , all scalars a F
1) Conjugate symmetry: x, y x, y
2) Linearity in the first argument:
ax, y a x, y
x y , z x, z y , z
3) Positive definiteness: x, y 0 with
equality only for x=0.
NORM OF THE VECTOR ( ui )
• Norm of the vector or length:
ui x12 ... x12
v1
• The norm of the vector v v in ,
R 2
denoted by v ; 2
v v12 v12
• Eg:
2
If v
5
EUCLIDEAN N-SPACE( R ) n
• Consider the vector space R n . The dot product
or scalar product in R is defined by:
n
x, y x1 y1 x2 y2 ... xn yn
• This function defines an inner product on R n.
• Eg:
Find the Euclidean inner product u, v
a) u (4,8,2) v (0,1,3)
FUNCTION SPACE Ca, b
POLYNOMIAL SPACE P(t )
• The notation Ca, b - used to denote the vector
space of all continuous functions on the closed
interval a, b , where a t b .
• Let f (t ) and g (t ) are functions in Ca, b , an
inner product on Ca, b :
b
f , g f (t ) g (t )dt
a
• Eg: Consider f (t ) 3t 5 and g (t ) t 2 in the
polynomial space P(t ) with inner product
1
f , g f (t ) g (t )dt
0
a) Find f , g
b) Find f and g
ANGLE BETWEEN VECTORS
For any nonzero vectors u and v in an
inner product space, V, the angle between
u and v is defined to be the angle θ such
that 0 and
u, v
cos
u v
Eg: Consider the vector
u (2,3,5) and v (1,4,3) in R3
Find the angle θ between u and v .
ORTHOGONAL SET
Let V be an inner product space. The vectors
ui ,u j V is said to be orthogonal if
ui , u j ui u j 0 when i j
Eg: Determine whether the given vectors are
orthogonal
u (1,1,1) , v (1,2,3) , w (1,4,3)
ORTHONORMAL SET
The set is said to be orthonormal if it is
orthogonal and each of its vectors has norm 1,
that is ui 1 for all i.
ui x12 ... xn2 1 and ui u j 0
Eg:
Let S u1 , u2 , u3 (1,0,0), (0,1,0), (0,0,1) R3
Determine whether S is an orthonormal set.
NORMALIZING VECTOR
If u 1 or equivalently u, u 1 , then u
is called a unit vector and is said to be
normalized.
To obtain a unit vector, every nonzero
vector v in V, can be multiplied by the
reciprocal of its length
1
v v
v
Eg:
Let u (1,3,4,2), v (4,2,2,1) in R 4
Normalize u and v.
GRAM SCHMIDT PROCESS
GRAM SCHMIDT PROCESS
Eg:
Use Gram Schmidt Process to find an
orthonormal set from the set
S (1,1,0), (1,1,1), (1,2,4) R3