Non-Cooperative Load-Balancing Game Analysis
Non-Cooperative Load-Balancing Game Analysis
Load-balancing Game
Supervisor:
Josu Doncel Vicente
Introduction v
2 Game Formulation 7
2.1 Non-Cooperative Routing Game . . . . . . . . . . . . . . . . 7
2.2 Inefficiency of Nash Equilibrium . . . . . . . . . . . . . . . . 9
3 Inefficiency Analysis 13
3.1 Worst traffic conditions for a fixed total traffic . . . . . . . . 13
3.2 Characterisation of routing strategies . . . . . . . . . . . . . . 15
3.2.1 Centralised routing strategy . . . . . . . . . . . . . . . 15
3.2.2 Decentralised routing strategy . . . . . . . . . . . . . 17
3.3 Characterisation of the inefficiency . . . . . . . . . . . . . . . 19
5 Conclusions 39
Bibliography 45
iii
Introduction
Game Theory as a research field has hugely developed since the mathem-
atician John von Neumann and the economist Oskar Morgenstern published
their book Theory of Games and Economic Behaviour [1] in 1944. This pub-
lication alongside with the work carried out by John Nash (specifically, the
Nash Equilibrium) is considered to be the first step towards setting Game
Theory as an interdisciplinary research field. Nowadays, Game Theory plays
an important role not only in mathematics or economics, but also in politics,
philosophy and, of course, in network systems, which is the field our work
belongs to.
The aim of this dissertation is to analyse deeply a non-cooperative load
balancing game. To begin with, we approach the problem appropriately.
Then, we compare the cost at the Nash Equilibrium, being this the solution
to our problem, to the cost at the optimal routing strategy of the problem,
which is the one which provides the minimum possible cost. To finish, we
present the results and the conclusions reached from them.
This work consists of five main chapters. In the first one, we give a quick
idea about what Game Theory is from a broad point of view. Furthermore,
we provide some basic definitions about non-cooperative Game Theory so
as to familiarise with this research field. In addition, we present a handy
example for the better understanding of those concepts. We also introduce
a few useful ideas we will deepen into during this work.
In the second chapter, we present the non-cooperative routing game we
work on. To begin with, we define the architecture of the system and the
players taking part in it. Besides, we define two possible routing strategies:
the first one consists of the solution of the game we propose whereas the
second one is the best possible routing strategy. In an attempt to compare
the cost functions of both of them, we set a measure called the inefficiency
ratio.
The third chapter consists of the analysis of the strategies introduced
in the previous chapter. For that purpose, we characterise both routing
strategies and we compare them through the inefficiency ratio so as to de-
termine which one is better. Additionally, this chapter contains the main
result of this work, i.e. proposition (3.3.3).
v
vi
In the fourth chapter, based on the results obtained in the third chapter,
we seek for an alternative expression of the inefficiency ratio. Hence, we can
take advantage of this form of the ratio to characterise the Price of Anarchy,
a quite popular concept of measurement, in an easier way.
Finally, in the last chapter, we compile all the results obtained and we
explain and analyse the meaningful conclusions we have reached.
Chapter 1
Introduction to
Non-Cooperative Game
Theory
Unless otherwise indicated, the theory displayed throughout the first chapter
is compiled from [2].
1
2 1.1. Basic definitions
Example 1.1.1. Let us suppose that 2 countries, say A and B, are about
to enter a nuclear war. The players taking part in the game are country A
and country B and each player has 2 possible actions: build nuclear bombs
(Build ) and do not build nuclear bombs (Do Not Build ). Assume that both
countries have enough resources to decide whether to build or not nuclear
weapons and each country’s best case scenario is to have bombs and the other
country not to. Assume also that both countries prefer the scenario where
neither has any bombs rather than the one in which both are armed, since
the process can be tedious and expensive. The problem can be modelled as
follows:
• Players: P = {A, B}
Chapter 1. Introduction to Non-Cooperative Game Theory 3
• Preferences:
Player A’s preferences from the best to the worst are presented as
follows: (Build, Do Not Build ), (Do Not Build, Do Not Build ),
(Build, Build ), (Do Not Build, Build ).
Player B’s preferences from the best to the worst are presented as
follows: (Do Not Build, Build ), (Do Not Build, Do Not Build ),
(Build, Build ), (Build, Do Not Build ).
Based on the previous preferences, the payoff functions are the following:
• uA (Build, Do Not Build ) > uA (Do Not Build, Do Not Build ) >
uA (Build, Build ) > uA (Do Not Build, Build )
• uB (Do Not Build, Build ) > uB (Do Not Build, Do Not Build ) >
uB (Build, Build ) > uB (Build, Do Not Build )
We illustrate our strategic game in the next figure. The cells represent
the different situations the game reaches after each player’s choices. The
first number shows the payoff of player A whereas the second one shows the
payoff of player B.
B
Build Do Not Build
A Build (1,1) (3,0)
Do Not Build (0,3) (2,2)
Table 1.1: This figure captions payoffs for each feasible situation.
4 1.1. Basic definitions
Having a look at the example above, what should each player choose? What
seems to be clear is that each player must make a choice bearing in mind
other player’s choice. We assume that each player’s decision is based on
her previous experience playing the game (that is, she knows what other
players will do because she knows their preferences) and that she will make
a decision according to a rational model.
Definition 1.1.2. An action profile a∗ is a vector containing actions such
that a∗i ∈ a* for every i ∈ P , i.e. a∗ = (a∗1 , a∗2 , . . . , a∗n ).
A Nash Equilibrium point can be seen as a steady state strategy. That
is, if the game reaches a Nash Equilibrium a*, no player finds it beneficial
to deviate from her current action a∗i . We present some useful notation we
will use throughout this chapter in order to make the definition of the Nash
Equilibrium easier.
Let a = (a1 , ..., an ) be an action profile where ai ∈ a is the action chosen
by player i ∈ P . Let a0i be any action (either different or equal to ai ) of
player i. The action profile (a0i , a−i ) = (a1 , ..., a0i , ..., an ) represents that every
player except i adheres to ai ∈ a while player i chooses action a0i . It goes
without saying that, if a0i =ai , then (a0i , a−i ) = (ai , a−i ) = a. With all this,
we can define the Nash Equilibrium of a strategic game.
Definition 1.1.3 (Nash equilibrium of a strategic game with ordinal prefer-
ences). The action profile a* is a Nash Equilibrium (NE) if no player i ∈ P
has any action ai for which she prefers (ai , a∗−i ) to a∗ = (a∗i , a∗−i ). That
is, according to player i’s preferences, a∗ is at least as good as (ai , a∗−i ).
Equivalently, for every player i, being ui her payoff function,
ui (a∗ ) ≥ ui (ai , a∗−i ) for every action ai of player i ∈ P .
Immediately after having defined what the NE is, some significant ques-
tions need to be asked: does it always exist a NE point? In case it does,
how many NE points are there? The answer to those questions lies in the
theorem of the existence of the NE. Before stating it, we need to make a
difference between pure and mixed strategic games.
In mixed strategies each player i assigns a probability to each of her
possible actions in Ai instead of restricting herself to choose a single action.
However, in pure strategies, a player assigns probability 1 to a single
action ai and probability 0 to every other action aj , where j 6= i (what is
equivalent to simply choosing the action ai ). Indeed, a pure strategy can
be seen as a particular mixed strategy case. Bearing all this in mind, the
issue raised before about the existence of the NE, which is a crucial point
in Non-Cooperative Game Theory, can be answered.
Theorem 1.1.1 (Existence of the Nash Equilibrium). In a non-cooperative
game with a finite set of players P and finite strategy set Ai , there exists, at
least, one NE point in mixed strategies.
Chapter 1. Introduction to Non-Cooperative Game Theory 5
II. If player B chooses Build, player A gets higher payoff by choosing Build
than choosing Do Not Build since
III. If player A chose Do Not Build, player B would get higher payoff by
choosing Build than choosing Do Not Build, which would lead to player
A deviating towards Build (that is, case II).
IV. If player B chose Do Not Build, player A would get higher payoff by
choosing Build than choosing Do Not Build, which would lead to player
B deviating towards Build (that is, case I).
In our example, each player has a few actions to choose among so we can
easily spot the NE by examining whether an action profile satisfies all the re-
quired conditions. However, in more complicated games where the number of
actions for each player is large, it is better off using best response functions.
For a player i ∈ P , giving every other players’ actions, we seek the action for
which she gets the higher payoff. We next define best response functions.
Definition 1.1.4. Denote by Bi (a−i ) the set of player i’s best actions when
every other player adheres to the list a−i .
Bi (a−i ) = ai in Ai : ui (ai , a−i ) ≥ ui a0i , a−i for all a0i in Ai
Game Formulation
One of the most relevant areas reached by Game Theory is the one related
to industrial technology and computing, which is, mainly, the one we are
interested in. The problem we are going to study regards load balancing,
which is a very discussed issue in Computer Science research field. Load
balancing is defined as the process of distributing a set of tasks across mul-
tiple servers (which form a server farm) with the aim of making the overall
processing of the tasks as efficient as possible. A server farm is a collection
of computer servers used to accomplish jobs for which multiple machines are
needed.
(i) n1 ≥ 1 cheap servers, with a holding cost equal to c1 per unit of traffic,
j ∈ S2 if and only if j = n1 + 1, . . . , N .
7
8 2.1. Non-Cooperative Routing Game
Our next step is to set up a feasible routing strategy, that is, a possible
path for the jobs to route. Let us give the following three definitions:
xne ne ne ne ne
i ∈ arg min Ti (x1 , . . . , xi−1 , z, xi+1 , . . . , xK ), ∀i ∈ C (2.2)
z∈Xi
Remark 2.1.1. The authors in [6] perform the same analysis as in this
work considering a similar model in which the cost function Ti (x) is defined
as X c1 xij X c2 xij
Ti (x) = + . (2.3)
1 − yj 1 − yj
j∈S1 j∈S2
Note that our problem and the one in [6] are very similar. In fact, the cost
function considered in both models is increasing and convex in yj .
We recall the result in equation (2.1) and we define the overall cost of
the decentralised routing scheme as follows:
X
DK (λ, p) = Ti (x).
i∈C
where
Fk (y) = ck y(1 + y), k = 1, 2.
X X
DK (λ, p) = F (yne ) = F1 (yjne ) + F2 (yjne )
j∈S1 j∈S2
X X
= c1 yjne (1 + yjne ) + c2 yjne (1 + yjne ) (2.4)
j∈S1 j∈S2
DK (λ, p) F (yne )
IK (p) = sup = sup ∗
(2.6)
λ∈Λ(λ) D1 (λ, p) λ∈Λ(λ) F (y )
Inefficiency Analysis
Let us emphasize that the result obtained in (3.2) depends on the total
traffic λ and not on each dispatcher’s own traffic λi .
Let us now have a closer look at this game. This sort of strategic games
are called symmetric because all players have the same routing strategy set.
13
14 3.1. Worst traffic conditions for a fixed total traffic
As it is shown in [8], for this type of games there is a unique NE. Under this
setting, symmetric games belong to what we call potential games. We next
provide a convex optimization problem introduced and proved in [9], which
will considerably ease the characterisation of the decentralised solution.
N
X
s.t. yj = λ,
j=1
0 ≤ yj , j = 1, . . . , N
yj
then the strategy x such that xij = K for all i ∈ C and j = 1, . . . , N is the
NE of the symmetric game.
min F (y)
y∈RN
N
X
s.t. − yj ≤ 0, ∀j = 1, . . . , N and λ − yj = 0.
j=1
P2 P
Note that F (y) = k=1 j∈Sk Fk (yj ). We also define the Lagrange
function for our problem:
2 X
X N
X N
X
L(y, µ1 , . . . , µN , γ) = Fk (yj ) + µj (−yj ) + γ(λ − yj ) (3.3)
k=1 j∈Sk j=1 j=1
is an optimal routing solution if and only if the following four KKT condi-
tions hold:
(i) Stationarity.
We equal to zero the derivative with respect to yj∗ of the Lagrange
function defined above. That is,
∂L
= 0.
∂yj∗
∂L
= Fk0 (yj∗ ) − µj − γ = 0.
∂yj∗
Hence,
Fk0 (yj∗ ) = µj + γ, ∀j = 1, . . . , N, k = 1, 2.
16 3.2. Characterisation of routing strategies
−yj∗ ≤ 0, j = 1, ..., N.
N
X
λ− yj∗ = 0.
j=1
∗
Note that λ is equally distributed among all type 1 servers so that
∗
∗
yj = nλ1 for all j ∈ S1 , while type 2 servers remain unexploited. Therefore,
from equation (3.5) and using F10 (yj∗ ) = c1 [(1 + yj∗ ) + yj∗ ] and F20 (0) = c2 , we
obtain that
∗ ∗
" ! #
λ λ
c1 1+ + = c2 . (3.6)
n1 n1
Bearing in mind that c2 ≥ c1 , we reach two different distributions for
the optimal routing strategy:
∗
• If λ ≤ λ , the centralised routing solution distributes the total traffic
λ equally among type 1 servers so that
(
λ
yj∗ = n1 , if j ∈ S1
0, if j ∈ S2
Chapter 3. Inefficiency Analysis 17
∗
• If λ > λ , the centralised routing solution distributes the total traffic
among all N servers so that yj∗ > 0 for all j = 1, . . . , N and, therefore,
F10 (yj∗ ) = F20 (yk∗ ), ∀j ∈ S1 and ∀k ∈ S2 . Pointing out once again that
Fk0 (y) = ck [(1 + y) + y] for k = 1, 2, F10 (yj∗ ) = F20 (yk∗ ) leads to
X X
F (y∗ ) = F1 (yj∗ ) + F2 (yk∗ ) = n1 F1 (y1∗ ) + n2 F2 (yN
∗
) (3.8)
j∈S1 k∈S2
We next study the KKT conditions for the minimisation problem in propos-
ition (3.1.1).
(i) Stationarity.
We equal to zero the derivative with respect to yjne of the Lagrange
function defined above. That is,
∂L
= 0.
∂yjne
Hence,
−yjne ≤ 0, j = 1, . . . , N.
N
X
λ− yjne = 0.
j=1
Remark that Fk0 (yjne ) = ck [(1 + yjne ) + yjne ]. It follows from (3.10) that
From equation (3.10), we obtain that ck [K(1 + yjne ) + yjne ] is constant for
either value of k. That is,
ne
As it came to happen in the centralised case, λ is equally distributed
among all type 1 n1 servers, while type 2 servers remain unexploited.
Taking into account that c2 ≥ c1 , we take on two different distributions
for the decentralised routing solutions:
ne
• If λ ≤ λ , the decentralised routing solution distributes the total
traffic λ equally among type 1 servers so that
(
λ
ne n1 , j ∈ S1
yj =
0, j ∈ S2 ,
ne
• If λ > λ , the decentralised routing solution distributes the total
traffic λ among all N servers so that yjne > 0 for all j = 1, . . . , N .
Hence, by equation (3.13), we get the following:
and
ne ne
" ! #
λ λ
c1 K 1+ + = c2 K
n1 n1
c2
We isolate the constant c1 in both equations so we can equal them to
get
ne ne ∗ ∗ ne ∗
! !
λ λ λ λ λ 1 2λ
1+ + = 1+ + ⇐⇒ 1+ = (3.17)
n1 Kn1 n1 n1 n1 K n1
and ne
λ 2
∗ =
1 + K1
λ
ne ne ∗
1 3 λ
≥ 34 . Hence, λ
Since K ≥ 2, 1 + K ≤ 2 and, therefore, ∗ >λ .
λ
Proof. First of all, let us recall some expressions we have already used
throughout this work: F1 (y) = c1 y(1 + y) and F10 (y) = c1 [(1 + y) + y].
Substituting in our inequality, we get the following:
n2 yN λ λ λ
c1 1 + 2 c1 1+ >
λ n1 n1 n1
λ λ λ
c1 (1 + 2y1 ) c1 1+ − c1 1 + 2 c1 y1 (1 + y1 ) (3.18)
n1 n1 n1
Since c1 6= 0, we get rid of them in both RHS and LHS of the above
expression to get
n2 yN λ λ λ
1+2 1+ >
λ n1 n1 n1
λ λ λ
(1 + 2y1 ) 1+ − 1+2 y1 (1 + y1 ) (3.19)
n1 n1 n1
λ
as it still holds. Appropriately, we can get rid of n1 in both LHS and RHS.
We show this result below.
n 2 yN λ λ λ λ λ λ λ
1+2 1+ > (1 + 2y1 ) 1+ − 1+2 (1 + y1 )
λ n1 n1 n1 n1 n1 n1 n1
⇐⇒ n2λyN 1 + 2 nλ1 1 + nλ1 > (1 + 2y1 ) 1 + nλ1 − 1 + 2 nλ1 (1 + y1 )
Taking into account that the LHS is positive, it is enough for us to prove
that the RHS is negative or zero. Decomposing the RHS, we get
2y1 λ λ 2λ 2y1 λ λ
1 + 2y1 + + − 1 − y1 − − = y1 − ,
n1 n1 n1 n1 n1
λ
which is negative or zero since n1 ≥ y1 .
Using the above result and the previous two sections, we can characterise
the inefficiency in our model, that is, the ratio
λ
DK K 1, p
D1 (λ, p)
λ
DK K
1,p
Proposition 3.3.3. The Inefficiency ratio D1 (λ,p)
as a function of λ is
∗
I. 1 if λ ∈ [0, λ )
∗ ne
II. strictly increasing with λ if λ ∈ (λ , λ )
ne
III. strictly decreasing with λ if λ ∈ (λ , ∞)
Proof. We next prove the three different cases one by one. Note that
λ
DK 1, p = F (yne ) and D1 (λ, p) = F (y∗ ) .
K
∗
I. For λ ∈ [0, λ ), the ratio equals 1.
ne ∗ ∗
Since λ > λ and λ < λ , we have the following from equations (3.7)
and (3.15):
λ
F (y∗ ) = F (yne ) = n1 F1
n1
Consequently,
λ
DK K 1, p F (yne )
= =1
D1 (λ, p) F (y∗ )
22 3.3. Characterisation of the inefficiency
ne
Figure 3.2: Inefficiency is achieved at λ = λ .
∗ ne
II. For λ ∈ (λ , λ ), the ratio is strictly increasing.
λ
DK K
1,p
We know that the ratio D1 (λ,p)
is strictly increasing if and only if
its partial derivative with respect to λ is greater than zero. That is,
we have to show
λ
∂ D K K 1, p
> 0.
∂λ D1 (λ, p)
2 X
0 ∗
X dyj∗
F (y ) = Fk0 (yj∗ ) (3.21)
k=1 j∈Sk
dλ
Therefore,
from equation (3.20) and since (F (y∗ ))2 > 0, the ratio
λ
DK K
1,p
D1 (λ,p)
is strictly increasing if and only if
2 X ∗
dy
λ X j n1 F1 λ
F10 ∗ 0 ∗
F (y ) > Fk yj (3.22)
n1 dλ n1
k=1 j∈S k
λ
DK K
1,p
which needs to be proved to show that the ratio D1 (λ,p)
is strictly
∗ ne
increasing for λ ∈ (λ , λ ].
Before we continue, we have to prove the convexity of the function F2 ,
which will extremely ease the end of this prove. But first, let us recall
the definition appearing in [11] for a convex function.
Definition 3.3.1. A function f: Rn → R is convex if dom f is a
convex set and for all x,y ∈ dom f, and θ with 0 ≤ θ ≤ 1, we have
Let us get rid of the c constants in both RHS and LHS to achieve
∗
F2 (yN ) ≥ F2 (0) + F20 (0)(yN
∗
− 0) = F20 (0)(yN
∗
) (3.26)
ne
since F2 (0) = 0.h By
definition, λ iis the unique value of λ for which
ne ne ne
the equality c1 K 1 + n1 + λn1 = c2 K holds. Thus for λ < λ ,
λ
λ̄ne λ̄ne
λ λ
c2 K = c1 K 1+ + > c1 K 1 + + .
n1 n1 n1 n1
Let us bring back F20 (y) = c2 [(1 + y) + y] and divide above inequality’s
both RHS and LHS by K to achieve
Chapter 3. Inefficiency Analysis 25
λ λ
F20 (0) = c2 > c1 1 + +
n1 Kn1
λ
Bearing in mind that Kn1 > 0, we can get rid of it to get
λ λ λ
F20 (0) > c1 1 + + > c1 1 + .
n1 Kn1 n1
n1
Since F1 nλ1 = c1 nλ1 1 + nλ1 , we obtain λ 1
F λ
n1 = c1 1 + λ
n1 ,
and, by the expression above,
n1 λ
F20 (0) > F1
λ n1
yielding, by equation (3.26),
∗
n 1 yN
∗ λ ne
F2 (yN )> F1 , ∀λ < λ .
λ n1
Hence, substituting the above inequality in (3.24), which is the
expression we seek to prove, we reach
∗
n 1 n 2 yN
λ λ λ
F10 ∗
n1 F1 (y1 ) + F1 0 ∗
> n1 F1 (y1 ) F1
n1 λ n1 n1
Let us divide both RHS and LHS by n1 6= 0 to get
∗
n2 yN
0 λ ∗ 0 λ λ 0 ∗ λ
F1 F1 (y1 ) + F1 F1 > F1 (y1 ) F1
n1 λ n1 n1 n1
∗
n2 yN 0 λ
λ λ λ
⇐⇒ F1 F1 > F10 (y1∗ ) F1 − F10 F1 (y1∗ )
λ n1 n1 n1 n1
(3.27)
c2
Diving both sides by K and setting β = c1 , we obtain
ne ) + y ne ]
c1 [K(1 + y1ne ) + y1ne ] c2 [K(1 + yN N
= ⇐⇒
K K
1 1
y1ne 1 + + 1 = β yN ne
1+ +1 (3.28)
K K
λ−n y ne
By n1 y1ne + n2 yN
ne = λ, we get y ne =
N n2
1 1
and substitute to achieve
λ − n1 y1ne
ne 1 1
y1 1 + =β 1+ +1 −1
K n2 K
We simplify the above equation to get y1ne = mλ + sK , where
β
β−1 n2
sK = and m =
1
1+ K 1+ n1 β 1 + nn12β
n2
∗
From the characterisation of the centralised routing scheme for λ > λ ,
and choosing y1∗ ∈ S1 and yN∗ ∈ S , we have
2
c2
We now divide both sides of the ratio by n1 c1 and we use β = c1 ,
ne = λ−n1 y1ne ∗ = λ−n1 y1∗
yN n2 and yN n2 , in order it to become
ne λ−n1 y1ne
λ y ne (1 + y ne ) + n2 β λ−n1 y1 1 +
DK ( K 1, p) 1 1 n1 n2 n2
= ∗ λ−n y ∗
D1 (λ, p) λ−n y
y1∗ (1 + y1∗ ) + nn21 β n21 1 1 + n21 1
Chapter 3. Inefficiency Analysis 27
1 + mλ + sK + nn21 β λ(1−n1 nm)−n 1 sK λ(1−n1 m)−n1 sK
mλ + sK 2
1 + n2
= n λ(1−n1 m)−n1 s1
λ(1−n1 m)−n1 s1
mλ + s1 1 + mλ + s1 + n12 β n2 1 + n2
n2 λ(1−n1 m) n1 sK λ(1−n1 m) n1 sK
mλ + sK 1 + mλ + sK + n1 β n2 − n2 1 + n2 − n2
= n2 λ(1−n1 m) n1 s1
λ(1−n1 m) n1 s1
mλ + s1 1 + mλ + s1 + n1 β n2 − n2 1 + n2 − n2
See that, in the last two steps, we just arranged all the coefficients
λ−n1 (mλ+sK ) λ−n1 (mλ+s1 )
of λ in n2 and n2 together to ease the next step.
After making some calculations, we get a quadratic function in both
above and below expressions. That is,
λ 2
DK ( K 1, p) aλ + bK λ + cK
= 2
D1 (λ, p) aλ + b1 λ + c1
2
where a = m2 + nn21β (1−nn12m) , bK = m+2sK m+ nn21 β 1−n1 m
n2 − 2sK n1 (1−n1 m)
n22
2
sK
and cK = (1 − β) K+1 .
We know that the ratio
λ 2
DK ( K 1, p) aλ + bK λ + cK
= 2 (3.30)
D1 (λ, p) aλ + b1 λ + c1
λ
DK ( K 1,p)
By equation (3.30) and because of the definition of the ratio D1 (λ,p)
,
2 2
we know that aλ + bK λ + cK > aλ + b1 λ + c1 , so it is enough for us
28 3.3. Characterisation of the inefficiency
Note that in the last step we just arranged the coefficients of sK and
s1 in the LHS and RHS, respectively. Since
β−1 β−1
sK = and s1 = ,
n1 β n1 β
1 + K1 1 + n2 2 1+ n2
we get
n1 β β−1 n1 β β−1
sK 1+ = 1 and s1 1 + n = ,
n2 1+ K 2 2
respectively. We substitute those expressions in our equation to achieve
which happens to be true since in both LHS and RHS we are sub-
tracting the same expressions. For this reason, both RHS and LHS
are equal to zero, meaning that the inequality we sought to proof holds
and, as a consequence, the ratio is decreasing as a function of λ for
ne
λ ∈ [λ , ∞).
Chapter 3. Inefficiency Analysis 29
λ
DK K
1,p
Proposition 3.3.4. The ratio D1 (λ,p)
is continuous over [0, +∞) as a
function of λ.
Proof.
First
of all, let us note that, since D1 (λ, p) 6= 0, the domain of
λ
DK K
1,p
D1 (λ,p)
is the real line R. From proposition (3.3.3), we see that the func-
∗ ∗ ne ne
tion D K
D1is split in three different intervals: [0, λ ), (λ , λ ) and (λ , ∞).
∗ ne
Therefore, we have to proof the continuity at λ = λ and λ = λ . We recall
λ
DK 1, p = F (yne ) and D1 (λ, p) = F (y∗ ).
K
∗
• The ratio DK
D1 is continuous at λ = λ if and only if
λ λ
DK K 1, p DK K 1, p
lim = lim .
λ→λ
∗− D1 (λ, p) λ→λ
∗+ D1 (λ, p)
Let us first have a look at the limit approaching from the left. By the
∗
first proof of proposition (3.3.3), for λ ≤ λ , we know that the ratio
equals 1 since F (yne ) = F (y∗ ) holds. Hence, we have to show
λ
DK K 1, p F (yne )
lim = lim = 1.
∗+ D1 (λ, p) ∗+ F (y∗ )
λ→λ λ→λ
ne
• The ratio DK
D1 is continuous at λ = λ if and only if
λ λ
DK K 1, p DK K 1, p
lim = lim .
λ→λ
ne− D1 (λ, p) λ→λ
ne+ D1 (λ, p)
ne
λ ≥ λ , the cost of the decentralised routing
On the other hand, for
λ
scheme becomes DK K 1, p = F (yne ) = n1 F1 (y1ne ) + n2 F2 (yN
ne ).
ne
Take into consideration that λ is the unique value of λ such that all
ne
the traffic deviates towards type 1 servers. Consequently. at λ = λ ,
ne
we get that y1ne = λn1 and yN ne = 0. We recall F (y) = c y(1 + y) so
k k
ne
that F2 (0) = 0. Hence, at λ = λ ,
ne ne
! !
λ λ
DK 1, p = n1 F1 .
K n1
which happens to be equal to the one approaching from the left. This
ne
result proves the continuity of the ratio at λ = λ .
Taking into account the results obtained above, it is shown that the
ratio D
D1 is continuous over [0, ∞) as a function of λ.
K
λ
DK K
1,p ne
Corollary 3.3.5. The ratio D1 (λ,p)
achieves its maximum at λ = λ .
Recall that the main target of this chapter was to show that the NE is
an inefficient solution for our load balancing problem. We have just proved
that the inefficiency ratio, which is the measure we chose to determine how
efficient the NE is, reaches its maximum value when the overall traffic of the
system is equal to the overall traffic at the NE. Moreover, we know that,
the higher value the ratio Ik gets, the further the solution for the decentral-
ised routing scheme from the optimal routing solution is. We conclude by
ne
showing the inefficiency ratio at λ = λ , which is
ne
λ
ne
F (y ) n F
1 1 n1
Ik (p) = ∗
= ne ∗ (λne ))
(3.33)
F (y ) n1 F1 (y1∗ (λ )) + n2 F2 (yN
Chapter 4
λ 2
DK ( K 1, p) aλ + bK λ + cK
Ik (p) = = 2
D1 (λ, p) aλ + b1 λ + c1
ne
First of all, we need an expression of λ for λ = λ . Recall from the charac-
terisation of the decentralised routing strategy the following equality, shown
in equation (3.14):
ne ne
" ! #
λ λ
c1 K 1 + + = c2 K.
n1 n1
c2
We set β = c1 and divide both LHS and RHS by K to get
ne ne
λ λ K +1 ne
+ = β − 1 ⇐⇒ λ = n1 (β − 1)
n1 Kn1 K
33
34
That is,
ne K
λ = n1 (β − 1) (4.1)
K +1
ne ne
a(λ )2 + bK λ + cK
IK (p) = ne ne ,
a(λ )2 + b1 λ + c1
2
where a = m2 + nn21 β (1−nn12m) , bK = m+2sK m+ nn21 β 1−mn
n2
1
− 2sK n1 (1−mn1 )
2
n2
2
sK
and cK = (1 − β) K+1 . Bear in mind that m and sK are defined in the
previous chapter, concretely, in the third proof of the characterisation of the
inefficiency ratio.
Note that we seek to rewrite every single expression in terms of n1 , n2 ,
c1 , c2 and K, with the aim of using α and β when possible. Therefore, we
bring the expressions of m and sK back to get
β
n2 β
m= =
1 + nn12 β n2 (1 + αβ)
and
β−1 β−1
sK = 1 n1 β
= 1 .
1+ K(1 + n2 )
1+ (1 + αβ)
K
2
n1 β
n2 (1 − n1 m)2 β2 β 1 − n2 (1+αβ)
a = m2 + β 2 = 2 +
n1 n2 n2 (1 + αβ)2 α n22
2
αβ
β2 β 1 − 1+αβ β2 β 1
= 2 + 2 = 2 +
n2 (1 + αβ)2 α n2 n2 (1 + αβ)2 α (1 + αβ)2 n22
β 1 β(1 + αβ) β
= 2 2
β+ = 2 2
= 2
n2 (1 + αβ) α αn2 (1 + αβ) αn2 (1 + αβ)
Chapter 4. Characterisation of the PoA 35
n2 1 − mn1 2sK n1 (1 − mn1 )
bK = m + 2sK m + β −
n1 n2 n22
αβ αβ
β 2(β − 1) β β 1− 2n 1 (β − 1) 1 − 1+αβ
1+αβ
= + 1
+ − 2 1
n2 (1 + αβ) 1 + K (1 + αβ) n2 (1 + αβ) α n2 n2 1 + K (1 + αβ)
" #
β 2(β − 1)β β 1 2α(β − 1)
= + + −
1 + K1 (1 + αβ)2 n2 α n2 (1 + αβ) n2 1 + K1 (1 + αβ)2
n2 (1 + αβ)
" #
β 2(β − 1)β β 2α(β − 1)
= + + 1−
1 + K1 (1 + αβ)2 n2 αn2 (1 + αβ) 1 + K1 (1 + αβ)
n2 (1 + αβ)
" #
β 2(β − 1) 1 2α(β − 1)
= 1+ + −
1 + K1 (1 + αβ) α α 1 + K1 (1 + αβ)
n2 (1 + αβ)
β 1 β(α + 1)
= 1+ =
n2 (1 + αβ) α αn2 (1 + αβ)
ne
As a consequence, the inefficiency ratio at λ = λ in terms of α, β and K
is the one displayed below:
K(β−1)(βK+1)
(K+1)2
IK (α, β) = β−1
4(1+αβ)(K+1)2
[4K 2 αβ(β − 1) + 4Kβ(α + 1)(K + 1) + (1 − β)(K + 1)2 ]
4K(βK + 1)(1 + αβ)
= (4.2)
4K 2 αβ(β − 1) + 4Kβ(α + 1)(K + 1) + (1 − β)(K + 1)2
.
Consequently, the derivative of IK (α, β) with respect to α becomes
∂IK GFα − F Gα
= ,
∂α G2
where
Fα = 4Kβ(βK + 1)
and
Gα = 4K 2 β(β − 1) + 4Kβ(K + 1) = 4Kβ(βK + 1)
Note that Fα = Gα = 4Kβ(βK + 1). Since G2 > 0, it is enough for us
to show
GFα − F Gα ≤ 0 ⇐⇒ GGα − F Gα ≤ 0 ⇐⇒ Gα (G − F ) ≤ 0.
What does this mean? We have just shown that the ratio IK (α, β)
is non-increasing with α if and only if β ≥ 1. Take into consideration
that we defined β = cc12 , leading us to β ≥ 1 since c2 ≥ c1 . Hence, the
above proposition holds and IK (α, β) happens to be non-increasing with α.
Therefore, the worst inefficiency as a function of α is achieved at
1
4K(βK + 1) 1 + Nβ−1
IK ,β =
N −1 4βK 2 (β−1)
+ 4Kβ N 1−1 + 1 (K + 1) + (1 − β)(K + 1)2
N −1
4K(βK + 1)(N + β − 1)
=
4βK 2 (β − 1) + 4KβN (K + 1) + (N − 1)(1 − β)(K + 1)2
(4.3)
1 1
lim IK ,β =1 and lim IK ,β = 1. (4.4)
β→∞ N −1 β→1 N −1
38
Figure 4.1: This graphic shows the behaviour of the ratio as a function of β
for N = 10 and K = 2, 5 and 10.
Conclusions
39
40
For this case, the ratio is displayed in equation (3.33). From that point on,
the inefficiency ratio is decreasing as a function of λ. Apart from that, we
proved the continuity of the inefficiency ratio as a function of λ over [0, ∞).
In the fourth chapter, we aimed to characterise the P oA using the inef-
ficiency ratio. Let us recall that the P oA for the model in [6] is achieved for
n1 = 1, n2 = N − 1 and cc12 → ∞. Hence, we rewrote the inefficiency ratio
as a function of α and β, having defined those as α = nn12 and β = cc21 . Then,
keeping β constant, we managed to show that the ratio is non-increasing as
a function of α being its maximum at α = N 1−1 . Consequently, we proved
that the inefficiency ratio as a function of α achieves its maximum when
there is just one cheap server and N − 1 expensive servers to distribute the
jobs among.
Finally, for α = N 1−1 and N = 10, we found that the ratio as a function
of β is non-monotone. This is shown in figure 4.1. We set N = 10 (it holds
for any natural number greater than 1) and displayed the behaviour of the
ratio as a function of β for three different values of K. The image shows how
the ratio achieves a maximum, which seems to increase when the value of K
increases. In addition, we achieved a couple of interesting results regarding
the behaviour of the inefficiency. For α = N 1−1 and any value of K, we
obtained the following from equation (4.4):
• If β → 1, that is, if the costs for using expensive and cheap servers are
equal, the distinction between two types of servers vanishes. Therefore,
the system distributes the overall traffic equally among N servers in
both routing schemes. Hence, the strategy adopted by the system at
the NE becomes efficient.
Appendix A
Alternative proof of
representing the inefficiency
ratio as a function of α and β
Let us recall the expression in equation (3.33), which is the inefficiency ratio
ne
at λ = λ . As we showed in corollary (3.3.5), this value happens to be the
maximum for any λ > 0, that is, the worst inefficiency.
ne
λ
ne
F (y ) n 1 F1 n1
Ik (p) = ∗
= ∗ ne ∗ (λne ))
F (y ) n1 F1 (y1 (λ )) + n2 F2 (yN
We define
ne
!
λ ne ne
A = n1 F1 , B = n1 F1 (y1∗ (λ )) ∗
and C = n2 F2 (yN (λ )).
n1
That is,
ne K
λ = n1 (β − 1) (A.1)
K +1
We also defined Fk (y) = ck y(1 + y) previously. Hence,
41
42
ne ne ne
! !
λ λ λ
F1 = c1 1+
n1 n1 n1
ne
We next substitute the expression of λ obtained in (A.1) to get
ne
!
λ c1 n1 K n1 K(β − 1)
F1 = (β − 1) 1 +
n1 n1 (K + 1) n1 (K + 1)
Consequently,
ne
!
λ c1 n1 K K(β − 1)
A = n1 F1 = (β − 1) 1 +
n1 K +1 K +1
Kc1 n1 (β − 1)(Kβ + 1)
= (A.2)
(K + 1)2
ne ne β Kn1 (β − 1) β−1
y1∗ (λ ) = mλ + s1 = +
n2 (1 + αβ) K + 1 2(1 + αβ)
Kn1 β(β − 1) β−1
= +
n2 (1 + αβ)(K + 1) 2(1 + αβ)
β−1 αβK 1
= +
1 + αβ K + 1 2
β−1 αβK 1 β − 1 2αβK + K + 1
1+ + =1+
1 + αβ K +1 2 1 + αβ 2(K + 1)
(β + 1)(K + 1) + 2αβ(1 + βK)
=
2(K + 1)(1 + αβ)
Appendix A. Alternative proof of representing the inefficiency ratio as a
function of α and β 43
β−1 αβK 1 (β + 1)(K + 1) + 2αβ(1 + βK)
B = n1 c1 +
1 + αβ K + 1 2 2(K + 1)(1 + αβ)
(β − 1)(2αβK + K + 1) (β + 1)(K + 1) + 2αβ(1 + βK)
= n1 c1
2(K + 1)(1 + αβ) 2(K + 1)(1 + αβ)
n1 c1
= [(β − 1)(2αβK + K + 1)][(β + 1)(K + 1) + 2αβ(βK + 1)]
4(K + 1)2 (1 + αβ)2
ne
∗ = λ −n1 y1∗
Let us recall that yN n2 . We use y1∗ obtained above to get
h i
Kn1 β−1 αβK 1
ne K+1 (β − 1) − n1 1+αβ K+1 + K2 1
αβK 1
∗
yN (λ ) = = α(β − 1) − +
n2 K + 1 1 + αβ K + 1 2
K αβ 1 α(β − 1) K 1
= α(β − 1) 1− − = −
K +1 1 + αβ 2(1 + αβ) 1 + αβ K + 1 2
α(β − 1) K −1
=
1 + αβ 2(K + 1)
∗ ne α(β − 1) K −1 α(β − 1) K −1
C= n2 F2 (yN (λ ))
= n2 c2 1+
1 + αβ 2(K + 1) 1 + αβ 2(K + 1)
α(β − 1) K −1 2(1 + αβ)(K + 1) + α(β − 1)(K − 1)
= n2 c2
1 + αβ 2(K + 1) 2(1 + αβ)(K + 1)
n2 c2
= [α(β − 1)(K − 1)][2(1 + αβ)(K + 1) + α(β − 1)(K − 1)]
4(K + 1)2 (1 + αβ)2
n1 c1
B+C = [(β − 1)(2αβK + K + 1)][(β + 1)(K + 1) + 2αβ(βK + 1)]
4(K + 1)2 (1 + αβ)2
n2 c2
+ [α(β − 1)(K − 1)][2(1 + αβ)(K + 1) + α(β − 1)(K − 1)]
4(K + 1)2 (1 + αβ)2
n1 c1 D + n2 c2 E
=
4(K + 1)2 (1 + αβ)2
where
and
Kn1 c1 (β−1)(Kβ+1)
F (yne ) A (K+1)2 4Kn1 c1 (β − 1)(Kβ + 1)(1 + αβ)2
Ik (p) = = = =
F (y∗ ) B+C n1 c1 D+n2 c2 E
4(K+1)2 (1+αβ)2
n1 c1 D + n2 c2 E
and
This result shows that the inefficiency ratio depends on n1 and n2 only
through α = nn12 and on c1 and c2 only through β = cc21 . Therefore, the
inefficiency ratio can be expressed as follows:
[6] Doncel, J., Ayesta, U., Brun, O., Prabhu, B. (2014). Is the price of
anarchy the right measure for load-balancing games?. ACM Transac-
tions on Internet Technology (TOIT), 14(2-3), 1-20.
45
46 Bibliography