Geometric Interpretation of Linear Programming
Geometric Interpretation of Linear Programming
Samia Kerdjoudj
kerdjoudj_samia@[Link]
University of Blida 1.
12 octobre 2025
Chapter 2
Geometric interpretation of linear programming
Mathematical Program
Given a domain D ⊂ Rn and a function f : D → R.
A Mathematical Program (MP) is a problem that consists in finding an
element x∗ ∈ D (if such an element exists) that maximizes or minimizes
the function f . In other words :
1 ∀x ∈ D, f (x) ≥ f (x∗ ) (minimization problem : min f (x)),
x∈D
or
2 ∀x ∈ D, f (x) ≤ f (x∗ ) (maximization problem : max f (x)).
x∈D
Vocabulary
Let (P ) : max f (x) be a mathematical program. Then :
x∈D
A point x is called a solution of (P ).
The set D is called the feasible region of (P ).
A point x ∈ D is called a feasible solution of (P ).
The function f is called the objective function of (P ).
A point x∗ ∈ D is called an optimal solution of (P ), i.e., a feasible
solution whose value is the greatest possible for (P ).
where :
x1 a11 a12 ··· a1n
x2 a21 a22 ··· a2n
X =
..
A=
.. .. .. ..
. . . . .
Once the linear program is formulated, the next step is to solve the
model.
Once the linear program is formulated, the next step is to solve the
model.
Convex Set
A set C ⊂ Rn is said to be convex if
In other words, a set C is convex if the line segment joining any two of
its points lies entirely within the set C.
Convex Set
A set C ⊂ Rn is said to be convex if
In other words, a set C is convex if the line segment joining any two of
its points lies entirely within the set C.
Illustration
b
b b
Convex Combination
Let x1 , . . . , xk ∈ Rn . A convex combination of x1 , . . . , xk is a vector x
such that :
k
X k
X
x= λi xi , λi ≥ 0, λi = 1
i=1 i=1
Convex Combination
Let x1 , . . . , xk ∈ Rn . A convex combination of x1 , . . . , xk is a vector x
such that :
k
X k
X
x= λi xi , λi ≥ 0, λi = 1
i=1 i=1
Hyperplane
Let a be a nonzero vector in Rn and let b be a scalar.
A hyperplane H is the set of all points x ∈ Rn that satisfy aT x = b.
H = {x ∈ Rn | aT x = b}
Polyhedron
A Polyhedron P in Rn is the intersection of finitely many halfspaces. It
can be equivalently defined to be the set
P = {x ∈ Rn | Ax ≤ b}
Fact
The feasible region of any linear program can be described as a
polyhedron.
Bounded Set
A set S ⊆ Rn is said to be bounded if there exists a constant k > 0 such
that the absolute value of every component of every element of S is at
most k. In other words, ∃k ∈ R+ , kxk ≤ k, ∀x ∈ S
Polytope
A nonempty bounded polyhedron is called a polytope.
Theorems
1 A hyperplane is convex.
Let H = {x ∈ Rn | aT x = b} be a hyperplane.
Suppose u, v ∈ H, then
aT u = b and aT v = b.
Hence, w ∈ H, so H is convex.
Extreme Point
Let P ⊂ Rn be a polyhedron. A point x ∈ P is called an extreme point
of P if there do not exist two distinct points y, z ∈ P such that x is a
convex combination of them :
Example
w is not an extreme point because ∃u, v ∈ P such that w ∈ [uv].
x is an extreme point because if x = λy + (1 − λ)z, with λ ∈]0, 1[
and y, z 6= x, then either y ∈
/ P or z ∈
/ P.
b
y P
b
x b
b
b v
b
z w
u
S. Kerdjoudj Linear programming 15/33
Geometry of Linear Programming Existence of Extreme Points
Definition
A polyhedron P ⊆ Rn is said to contain a line if there exist a point
x ∈ Rn and a nonzero vector d ∈ P such that :
x + λd ∈ P for all λ ∈ R.
Example
P Q
Corollary
Every bounded polyhedron (i.e., every polytope) has at least one
extreme point.
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
Let Q = {x ∈ Rn | Ax ≤ b, cT x = v} ⊆ D be the set of all opt. sol.
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
Let Q = {x ∈ Rn | Ax ≤ b, cT x = v} ⊆ D be the set of all opt. sol.
D has an extreme point ====⇒ D has no lines ===⇒ Q has no lines
thm. 2 Q⊆D
====⇒ Q has an extreme point.
Thm. 2
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
Let Q = {x ∈ Rn | Ax ≤ b, cT x = v} ⊆ D be the set of all opt. sol.
D has an extreme point ====⇒ D has no lines ===⇒ Q has no lines
thm. 2 Q⊆D
====⇒ Q has an extreme point.
Thm. 2
Let x′ be an extreme point of Q. Suppose that x′ is not an extreme
point of D. Then ∃y 6= x′ , z 6= x′ , λ ∈]0, 1[ s.t x′ = λy + (1 − λ)z
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
Let Q = {x ∈ Rn | Ax ≤ b, cT x = v} ⊆ D be the set of all opt. sol.
D has an extreme point ====⇒ D has no lines ===⇒ Q has no lines
thm. 2 Q⊆D
====⇒ Q has an extreme point.
Thm. 2
Let x′ be an extreme point of Q. Suppose that x′ is not an extreme
point of D. Then ∃y 6= x′ , z 6= x′ , λ ∈]0, 1[ s.t x′ = λy + (1 − λ)z
cT x′ = λcT y + (1 − λ)cT z = v. Since v is the optimal value, and
y, z ∈ D, we have : cT y ≤ v and cT z ≤ v
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Proof of Theorem 3
Let D = {x ∈ Rn | Ax ≤ b} be a feasible region, and let x∗ be an
optimal solution to the LP with optimal value v = cT x∗
Let Q = {x ∈ Rn | Ax ≤ b, cT x = v} ⊆ D be the set of all opt. sol.
D has an extreme point ====⇒ D has no lines ===⇒ Q has no lines
thm. 2 Q⊆D
====⇒ Q has an extreme point.
Thm. 2
Let x′ be an extreme point of Q. Suppose that x′ is not an extreme
point of D. Then ∃y 6= x′ , z 6= x′ , λ ∈]0, 1[ s.t x′ = λy + (1 − λ)z
cT x′ = λcT y + (1 − λ)cT z = v. Since v is the optimal value, and
y, z ∈ D, we have : cT y ≤ v and cT z ≤ v
But the equality above implies : cT y = cT z = v ⇒ y, z ∈ Q
Hence, x′ is not an extreme point of Q. Contradiction.
S. Kerdjoudj Linear programming 19/33
Geometry of Linear Programming Optimality of extreme point
Properties
Let (P ) be a linear program (LP) and let D be its feasible region.
Then :
1 If D is a non-empty bounded polyhedron, then :
1 (P ) admits a unique optimal solution, and this solution is an
extreme point ; or
2 (P ) admits an infinite number of optimal solutions, which are
convex combinations of a finite number of extreme points of D.
2 If D is a non-empty unbounded polyhedron, then :
1 Cases (1) and (2) may still occur ;
2 (P ) may not have a finite optimal solution, i.e., max(Z) → +∞ or
min(Z) → −∞.
3 If D = ∅, then (P ) has no feasible solution. As a consequence, (P )
has no optimal solution.
S. Kerdjoudj Linear programming 20/33
Graphical Solution of an LP
Gradient method
Production Problem
A manufacturer produces two types of strawberry yogurt, labeled A
and B, using strawberries, milk, and sugar. Producing one pot of
yogurt A requires 1 kg of strawberries, 2 kg of milk, and 1 kg of sugar.
For one pot of yogurt B, the recipe requires 2 kg of strawberries, and 1
kg of milk.
The total available quantities of ingredients in stock are 800 kg of
strawberries, 700 kg of milk, and 300 kg of sugar. Yogurt A is sold at 4
DA per pot, and yogurt B at 5 DA per pot.
max(Z) = 4x1 + 5x2
s.t x1 + 2x2 ≤ 800
(P ) 2x1 + x2 ≤ 700
x1 ≤ 300
x1 ≥ 0, x2 ≥ 0
x2
x1
x2
x1
x2
x1
x2
x1 + 2x2 = 800
x1
x2
x1 + 2x2 = 800
x1
x2
2x1 + x2 = 700
x1 + 2x2 = 800
x1
x2
2x1 + x2 = 700
x1 + 2x2 = 800
x1
x2
x1 = 300
2x1 + x2 = 700
x1 + 2x2 = 800
x1
x2
x1 = 300
2x1 + x2 = 700
x1 + 2x2 = 800
x1
x2
x1 = 300
2x1 + x2 = 700
x1 + 2x2 = 800
x1
x2
x1 = 300
2x1 + x2 = 700
A = (0, 400)
B = (200, 300)
D C = (300, 100)
O = (0, 0) x1 + 2x2 = 800
x1
D = (300, 0)
Note
This approach is effective for small problems but becomes
computationally expensive in higher dimensions.
S. Kerdjoudj Linear programming 26/33
Graphical Solution of an LP Finding the Optimum of the Production Problem
x2
x1 = 300
2x1 + x2 = 700
!
4
▽Z =
5
A = (0, 400)
B = (200, 300)
D C = (300, 100)
O = (0, 0) x1 + 2x2 = 800
x1
D = (300, 0)
x2
x1 = 300
2x1 + x2 = 700
!
4
▽Z =
5
A = (0, 400)
B = (200, 300) Optimal Solution
D C = (300, 100)
O = (0, 0) x1 + 2x2 = 800
x1
D = (300, 0)
x2
x1 = 5
−2x1 + 3x2 = 0
D 2x1 − 3x2 = 6
!
−2
▽Z =
3
B = (5, 4/3)
O = (0, 0)
x1
A = (3, 0)
x2
x1 = 5
−2x1 + 3x2 = 0
D 2x1 − 3x2 = 6
!
−2
▽Z =
3
B = (5, 4/3)
O = (0, 0)
x1
A = (3, 0)
It is clear that the value of Z can be increased in the direction of the gradient
vector of the objective function, indicating that the solution is unbounded
(i.e., it tends to infinity).
S. Kerdjoudj Linear programming 30/33
Graphical Solution of an LP Infeasible Problem (No Solution Exists)
max(Z) = 3x1 + 3x2
s.t x1 + 2x2 ≤ 2
(P )
2x1 + 4x2 ≥ 8
x1 ≥ 0, x2 ≥ 0
x2
x1
2x1 + 4x2 = 8
x1 + 2x2 = 2
x2
x1
2x1 + 4x2 = 8
x1 + 2x2 = 2
x2
x1 = 3
C D
x2 = 3
D
B
▽Z
x1
A E
x1 + x2 = 2
x2
x1 = 3
C D
x2 = 3
D
B
▽Z
x1
A E
x1 + x2 = 2
The points
!
on the
!
segment [AB] represent the optimal solutions of (P ).
2 0
X∗ = , X ∗∗ = , Z ∗ = 4.
0 2
max(Z) = x1 + x2
s.t 3x1 + 2x2 ≤ 40
(P ) x1 ≤ 10
x2 ≤ 5
x1 ≥ 0, x2 ≥ 0
max(Z) = x1 + x2
s.t 3x1 + 2x2 ≤ 40
(P ) x1 ≤ 10
x2 ≤ 5
x1 ≥ 0, x2 ≥ 0
x2
x1 = 10
▽Z
C Sol. Opt
x2 = 5
B
D
x1
A D
3x1 + 2x2 = 40
max(Z) = x1 + x2
s.t 3x1 + 2x2 ≤ 40
(P ) x1 ≤ 10
x2 ≤ 5
x1 ≥ 0, x2 ≥ 0
x2
x1 = 10
▽Z
C Sol. Opt
x2 = 5
B
D
x1
A D
3x1 + 2x2 = 40
!
10
The optimal solution is X ∗ = , with Z ∗ = 15. A solution X ∗ is called
5
degenerate if at least three constraints are active (i.e., intersect) at that point.