An Adaptive Virtual Queue (AVQ) Algorithm For Active Queue Management
An Adaptive Virtual Queue (AVQ) Algorithm For Active Queue Management
ScholarlyCommons
Departmental Papers (ESE) Department of Electrical & Systems Engineering
April 2004
R. Srikant
University of Illinois
Recommended Citation
Srisankar S. Kunniyur and R. Srikant, "An Adaptive Virtual Queue (AVQ) Algorithm for Active Queue Management", . April 2004.
Copyright 2004 IEEE. Reprinted from IEEE/ACM Transactions on Networking, Volume 12, Issue 2, April 2004, pages 286-299.
Publisher URL: [Link]
This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of the
University of Pennsylvania's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this
material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by
writing to pubs-permissions@[Link]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.
Keywords
Active queue management (AQM), ECN marking, Internet congestion control
Comments
Copyright 2004 IEEE. Reprinted from IEEE/ACM Transactions on Networking, Volume 12, Issue 2, April
2004, pages 286-299.
Publisher URL: [Link]
This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way
imply IEEE endorsement of any of the University of Pennsylvania's products or services. Internal or personal
use of this material is permitted. However, permission to reprint/republish this material for advertising or
promotional purposes or for creating new collective works for resale or redistribution must be obtained from
the IEEE by writing to pubs-permissions@[Link]. By choosing to view this document, you agree to all
provisions of the copyright laws protecting it.
Abstract—Virtual queue-based marking schemes have been re- packets to be marked in a manner that conveys information
cently proposed for Active Queue Management (AQM) in Internet about the current state of the network to the users. Algorithms
routers. We consider a particular scheme, which we call the Adap- that the routers employ to convey such information are called
tive Virtual Queue (AVQ), and study its following properties: its
stability in the presence of feedback delays, its ability to maintain Active Queue Management (AQM) schemes. An AQM scheme
small queue lengths, and its robustness in the presence of extremely might mark or drop packets depending on the policy at the
short flows (the so-called web mice). Using a linearized model of router. In this paper, we use the term “marking” more generally
the system dynamics, we present a simple rule to design the pa- to refer to any action taken by the router to notify the user of
rameters of the AVQ algorithm. We then compare its performance incipient congestion. The action can, in reality, be ECN-type
through simulation with several well-known AQM schemes such as
RED, REM, Proportional Integral (PI) controller, and a nonadap- marking or dropping (as in RED) depending upon the policy
tive virtual queue algorithm. With a view toward implementation, set for the router. As in earlier work on studying AQM schemes
we show that AVQ can be implemented as a simple token bucket [6], [7], [15], this distinction is blurred in the mathematical
using only a few lines of code. analysis to allow for the development of simple design rules
Index Terms—Active queue management (AQM), ECN for the choice of AQM parameters. However, our simulations
marking, Internet congestion control. consider marking and dropping schemes separately.
Designing robust AQM schemes has been a very active
research area in the Internet community. Some AQM schemes
I. INTRODUCTION
that have been proposed include RED [4], a virtual queue-based
The update equation at each link can now be written as III. SIMULATIONS
The above theorem shows that by choosing according
(3)
to (7), one can guarantee the local stability of the TCP/AQM
where is the total flow into the link and scheme. However, the fluid model does not take into account
is the smoothing parameter. Note that determines how fast the discrete packet behavior of the network as well as the
one adapts the marking probability at the link to the changing inherent nonlinearities in the TCP algorithm. As a result,
network conditions. We will present a design rule that specifies it becomes important to verify the analytical results using
how to choose for a given feedback delay , utilization , and simulations in which the nonlinearities of the system are taken
a lower bound on the number of users . In fact, as we will into account. In this section, we conduct experiments that
show in Section IV, one can derive bounds on any of the four simulate various scenarios in the network and show that the
parameters , , , or , given the other three using the same AVQ algorithm performs as predicted by the analytical model
design rule. However, in practice, it would seem most natural to in all the experiments. Even though each experiment shows that
choose given the other three parameters. AVQ results in small queues, low loss and high utilization at
Let , , , and denote the equilibrium values of the link, it is important to note that each experiment simulates
, , and . The equilibrium point of the nonlinear a different scenario and the performance of AVQ is tested in
TCP/AQM model is given by this scenario.
In this section, we use the packet simulator ns-2 1 to simu-
late the AVQ scheme. We show that the simulation results agree
with the convergence results shown in the previous section. In
particular, we select an , using Theorem 2.1 that will ensure
stability for a given round-trip delay and a lower bound on the
number of users, . We then present a single set out of many
experiments that we did to show that indeed stabilizes the
system even in the presence of arrivals and departure of short
Let us assume that connections. We then compare this scheme with many other
AQM schemes.
A. Simulation Setup
The linearized version of the nonlinear TCP/AQM model can Throughout this section, we consider a single link of capacity
now be written as 10 Mb/s that marks or drops packets according to some AQM
scheme. For AVQ, unless otherwise stated, we let , the desired
(4) utilization, be 0.98. We use TCP-Reno as the default transport
(5) protocol with the TCP data packet size set to 1000 bytes. Each
TCP connection is placed in one of five classes which differ only
where in their round-trip propagation delays. Class 1 has a round-trip
delay of 40 ms, Class 2 has a round-trip delay of 60 ms, Class 3
has a round-trip delay of 80 ms, Class 4 has a round-trip delay
of 100 ms, and Class 5 has a round-trip delay of 130 ms. The
and buffer size at the link is assumed to be 100 packets.
In the first five experiments, we assume that the link marks
packets and thus, any packet loss is due to buffer overflow.
In these experiments, we demonstrate that the AVQ scheme
achieves high utilization and low packet loss. Further, the al-
For analytical tractability, we assume that gorithm responds quickly to changing network conditions such
as varying number of TCP flows. In the first experiment, we
study the convergence properties of the AVQ algorithm both in
(6) the absence and in the presence of short flows. In the remaining
experiments, we compare the AVQ algorithm with other AQM
We will now state the main result of this paper which serves schemes like RED, REM, PI, and GKVQ. In the second experi-
as the design for the AVQ algorithm. The proof of this result is ment, we compare the performance of various AQM schemes
given in Section IV. in the presence of long-lived flows. In the third experiment,
Theorem 2.1: Suppose that the feedback delay , number of we compare the transient behavior of the AQM schemes when
users , and the utilization , are given. Let be given by long-lived flows are dropped and added to the network. In the
fourth experiment, we compare the AQM schemes in the pres-
(7) ence of short flows in the network. In the fifth experiment, we
study the sensitivity of the AVQ algorithm to the smoothing
Then, for all , the system is locally stable. 1[Online.] Available: [Link]
290 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 12, NO. 2, APRIL 2004
Fig. 4. Experiment 1. Evolution of the virtual capacity with time for the AVQ Fig. 5. Experiment 1. Queue length versus time for the AVQ scheme.
scheme.
TABLE I
EXPERIMENT 1. MEAN AND THE STANDARD DEVIATION OF THE QUEUE SIZE
parameter as well as to the desired utilization parameter . BEFORE AND AFTER THE INTRODUCTION OF SHORT FLOWS
In the last experiment, we compare the AVQ scheme with other
schemes when the link drops packets (as opposed to marking) to
indicate congestion. Again, the AVQ scheme is shown to have
smaller queue lengths compared to other schemes.
We design the AVQ controller for a maximum delay of
ms. Using the design rule in Theorem 2.1, any , will
ensure stability. In the experiments, to account for nonlinearities due to the addition of short flows in the system. Another impor-
in the system, we let be 0.15. In all experiments, we consider tant performance measure is the number of packets dropped due
two types of flows: FTP flows that persist throughout the du- to buffer overflow in the system. Since ECN marking is used,
ration of the simulations and FTP flows of 20 packets each (to we expect the number of packets lost due to buffer overflow
model the short flows). to be small. Indeed, only 10 out of roughly 250 000 packets are
Experiment 1: In this experiment, we study the convergence dropped. These drops are primarily due to the sudden additional
properties and buffer sizes at the queue for the AVQ scheme load brought on by the short flows. Another performance mea-
alone. A total of 180 FTP flows with 36 in each delay class per- sure that is of interest is the utilization of the link. The utilization
sist throughout the duration of the simulations, while short flows was observed to be 0.9827, which is very close to the desired uti-
(of 20 packets each) arrive at the link at the rate of 30 flows lization of 0.98. We note that the apparent discrepancy between
per second. The short flows are uniformly distributed among Fig. 5, where the queue length never reaches the buffer size of
the five delay classes. To simulate a sudden change in network 100 packets, and the fact that there are ten dropped packets is
conditions, we start the experiment with only FTP flows in the due to the fact that the queue length is sampled only once every
system and introduce the short flows after 100 s. The evolution 100 ms to plot the graphs.
of the virtual capacity is given in Fig. 4. After an initial transient, We will now compare the AVQ scheme with other AQM
the virtual capacity settles down and oscillates around a partic- schemes that have been proposed. Since there are many AQM
ular value. Note that the oscillations in the virtual capacity are schemes in the literature, we will compare the AVQ scheme with
due to the packet nature of the network which is not captured a representative few. In particular, we will compare the AVQ
by the analytical model. At 100 s, there is a drop in the vir- scheme with:
tual capacity since the AVQ algorithm adapts to the changing 1) Random Early Discard (RED) proposed in [4]. In our ex-
number of flows. Beyond 100 s, the virtual capacity is lower periments, we use the “gentle” version of RED. Unless
than it was before 100 s since the links marks packets aggres- otherwise stated, the parameters were chosen as recom-
sively due to the increased load. The queue length evolution for mended in [20].
the system every 100 ms is given in Fig. 5. Except during tran- 2) Random Early Marking (REM) proposed in [1]. The
sients introduced by load changes, the queue lengths are small REM scheme tries to regulate the queue length to a
(less than 20 packets). At 100 s, the queue length jumps up due desired value (denoted by ) by adapting the marking
to the short flows. However, the system stabilizes and the queue probability. The REM controller marks each packet with
lengths are small once again. Table I gives the average and the a probability which is updated periodically (say, every
standard deviation of the queue length before and after the in- seconds) as
troduction of short flows. Note that there is a small increase in
the average queue length as well as in the standard deviation
KUNNIYUR AND SRIKANT: AVQ ALGORITHM FOR ACTIVE QUEUE MANAGEMENT 291
Fig. 9. Experiment 3. Evolution of the queue length at varying loads for PI.
Fig. 8. Experiment 2. Queue length at the link for varying number of FTP
connections for the different AQM schemes.
Fig. 12. Experiment 4. Packet losses at the link for various AQM schemes. Fig. 13. Experiment 4. Utilization of the link for various AQM schemes.
Fig. 15. Experiment 5. Evolution of the queue length for different values of Fig. 17. Experiment 5. Number of dropped packets versus time for different
the smoothing parameter . values of
.
Fig. 18. Experiment 5. Achieved utilization versus time for different values
Fig. 16. Experiment 5. Evolution of the queue length for different values of
. of
.
sudden load of the short flows at s is more pronounced Note that when , packet drops are primarily caused by the
when is small. Hence, even though a very small value of sudden load change at 100 s. After a transient period in which
can guarantee stability, it can make the link sluggish to changes the algorithm tries to adapt to the new load, there are no more
in network load. A theoretical analysis of the transient behavior packet drops. But the duration of the transient period seems to
is required to precisely quantify the impact of on the system increase as is increased. When , the transients caused by
performance. This could be a topic for future research. new short flows is sufficient to cause buffer overflow in certain
In the second part of the experiment, we fix the value of to instances. The achieved utilization (averaged over one second)
be equal to 0.5 and vary the value of . We use four different is shown in Fig. 18. We can see that irrespective of the value of
values of (0.90, 0.98, 0.99, and 1.0) to study the sensitivity of , AVQ tracks the desired utilization quite well. For a desired
the algorithm to . The rest of the simulation setup is identical average queue length (or loss probability), an upper bound on
to the first part. We increase the burstiness of the short flows by the value of would depend on the traffic characteristics. Given
splitting a single short flow of 20 packets into two short flows of the traffic characteristics, desired loss probability, or desired av-
10 packets each. Fig. 16 shows the evolution of the queue length erage queue length, analytically computing an appropriate value
for the different values of . We can see that smaller values of for is a topic for future research.
results in smaller queue sizes. As a result, smaller values of re- Experiment 6: Until now, we have assumed that the router
sults in smaller number of dropped packets as shown in Fig. 17. marks packets upon detecting congestion. Instead, one can drop
KUNNIYUR AND SRIKANT: AVQ ALGORITHM FOR ACTIVE QUEUE MANAGEMENT 295
Note: Instead of marking or dropping a packet in the real Note that, while this is not differentiable everywhere in or
queue when the virtual queue overflows, one can mark or drop , it is differentiable in the region . Substituting for
packets in the real queue by applying RED (or any other AQM , and and using the fact that
algorithm) in the virtual queue. Thus, if there are desirable fea- , we find that
tures in other AQM schemes, they can be easily incorporated in
the AVQ algorithm. When marking is employed, our experience (9)
is that a simple mark-tail would be sufficient as shown in Exper-
iments 1 through 4. In the case when the link drops the packets, Note that . Let denote the Laplace transform
many successive packet drops from the same flow could cause of and let denote the Laplace transform of .
timeouts. To avoid this, one could randomize the dropping by Taking the Laplace transforms of (4) and (5), we get
using a mechanism like RED in the virtual queue to prevent
bursts of packets of the same flow to be dropped. Hence, in this (10)
experiment, we also consider an AVQ scheme that had RED im- (11)
plemented in its virtual queue.
Our experience has been that, if RED is employed in the vir- Substituting (11) in (10), we get the so-called characteristic
tual queue, the performance of the AQM scheme is not very sen- equation
sitive to the choice of the RED parameters. Even though, there
is no significant difference in the goodputs, we believe that the (12)
fairness of the AVQ scheme can be improved using a proba-
bilistic dropping scheme in the virtual queue at the expense of Next, we use the fact that the roots are continuous functions of
increased computation at the router. We intend to study the fair- the round-trip delay . As a result, if the system is stable with
ness properties in our future research work. Note that a proba- for a fixed value of , then the roots are strictly in the
bilistic AQM scheme on the virtual queue is required only when left half-plane. Therefore, we can choose small enough such
the link drops packets and not when the link marks packets be- that the roots still remain in the left half-plane. This will help
cause multiple marks within a single window does not cause us to find the maximum feedback delay for which the system is
TCP to time out or go into slow-start. stable for a given . We will then show that we can use the same
technique to show that given a feedback delay , one can find
IV. STABILITY ANALYSIS OF THE AVQ SCHEME the maximum value of for which the system is stable. We will
formalize these ideas in this section.
In this section, we will prove the main result of the paper,
When , i.e., there is no feedback delay in the system,
which was stated in Theorem 2.1. The starting point of the anal-
the characteristic equation reduces to
ysis is the linearized version of the TCP/AQM model derived in
(4) and (5). We summarize the main ideas behind the proof as
follows. (13)
• The stability of a linear delay-differential equation can Solving the quadratic equation, we get
be analyzed using its characteristic equation. The charac-
teristic equation of the linear delay-differential equation
can be obtained by taking its Laplace transform. For the
linearized system to be stable, its characteristic equation
should have all its roots in the left half-plane (i.e., if is a If , then the system has all real roots
root of the characteristic equation, then ). which lie strictly in the left half-plane. If
• We will first show that for , , and fixed, the system is , then the system has complex roots that also lie strictly
stable in the absence of feedback delays, i.e., . This in the left half-plane. Thus, for all values of , the system
implies that all the roots of the characteristic equation lie in is stable.
the left half-plane. The roots of the characteristic equation The following theorem gives the necessary condition on the
are continuous functions of its parameters. Therefore, the RTT for the stability of the system given by (4) and (5).
roots of the characteristic equation are continuous function Theorem 4.1: Fix , the number of TCP users , and
of the feedback delay . By increasing , one can find the the utilization . Find the smallest such that
smallest feedback delay at which one of the roots hits
the imaginary axis (if there is no such , then the system is
stable for all .). Hence, for all , the system has all
its roots in the left half-plane and, hence, it is stable. This (14)
is the key idea behind the stability analysis in this section. satisfies
Recall that the linearized TCP/AQM system was given in (4)
and (5). For analytical tractability, we assume that (15)
Proof: The characteristic equation of the TCP/AQM Theorem 4.2: Fix , the number of TCP users , and
system (12) can be rewritten as the utilization . Define to be
(16) (19)
Let be one of the roots of the characteristic equation at the
smallest such that the roots hits the imaginary axis. where solves
Since the roots on the imaginary axis are complementary, we (20)
will concern ourselves only with . From (16), we get
and is as given in (14). Then for all the system is stable.
Moreover, is unique.
Proof: Note that and do not depend on . Also,
To satisfy the last condition, the following conditions must be . Therefore, as increases, decreases
met simultaneously. and increases. Note that we can easily show that is a unique
Condition on magnitude: solution to (20). Also, note that . Hence
Therefore
(22)
(or)
Also, since , . Thus
(25) (27)
V. CONCLUSION
at high utilizations with minimal loss at the routers. This con- [12] , “Analysis and design of an adaptive virtual queue (AVQ) algo-
clusion also holds in the presence of short flows arriving and de- rithm for active queue management,” in Proc. ACM SIGCOMM, San
Diego, CA, Aug. 2001.
parting at the link. We also show that AVQ responds to changing [13] , “A time-scale decomposition approach to adaptive ECN
network conditions better than other AQM schemes (in terms of marking,” in Proc. IEEE INFOCOM, Anchorage, AK, Apr. 2001, pp.
average queue length, utilization, and losses). 1330–1339.
[14] L. Massoulie and J. Roberts, “Bandwidth sharing: objectives and
We also study the performance of AVQ when dropping (in- algorithms,” in Proc. IEEE INFOCOM, New York, Mar. 1999, pp.
stead of marking) is employed at the routers. While AVQ per- 1395–1403.
forms better than other AQM schemes in terms of utilization [15] V. Misra, W. Gong, and D. Towlsey, “A fluid-based analysis of a network
of AQM routers supporting TCP flows with an application to RED,” in
and average queue length, the fairness of AVQ can be improved Proc. ACM SIGCOMM, Stockholm, Sweden, Sept. 2000, pp. 151–160.
using a probabilistic AQM scheme (like RED) on AVQ. We note [16] T. J. Ott, T. V. Lakshman, and L. H. Wong, “SRED: stabilized RED,” in
that a probabilistic AQM scheme on the virtual queue is required Proc. IEEE INFOCOM, New York, Mar. 1999, pp. 1346–1355.
[17] J. Padhye, V. Firoiu, D. Towsley, and J. Kurose, “Modeling TCP
only when the link drops packets and not when the link marks throughput: a simple model and its empirical validation,” in Proc. ACM
packets because multiple marks within a single window does not SIGCOMM, Vancouver, BC, Canada, 1998, pp. 303–314.
cause TCP to time out or go into slow-start. The fairness prop- [18] S. Shakkottai and R. Srikant, “Mean FDE models for Internet congestion
control under a many-flows regime,” IEEE Trans. Inform. Theory, 2004,
erties of AVQ with packet dropping is a topic of future research. to be published.
An important feature of the AVQ algorithm is that one can [19] S. Shakkottai and R. Srikant, “How good are deterministic fluid models
employ any AQM algorithm in the virtual queue. Thus, if there of Internet congestion control?,” in Proc. IEEE INFOCOM, 2002, pp.
497–505.
are desirable properties in any other marking schemes, one can [20] S. Floyd. (1997) RED: Discussions of setting parameters. [Online].
easily incorporate it into the AVQ scheme. However, when Available: [Link]
marking is employed, our experience has been that a simple
mark-tail would suffice.
Srisankar S. Kunniyur (M’98) received the B.E. de-
REFERENCES gree in electrical and electronics engineering from
B.I.T.S., Pilani, India, in 1996 and the M.S. and Ph.D.
[1] S. Athuraliya, D. E. Lapsley, and S. H. Low, “Random early marking degrees in electrical engineering from the University
for Internet congestion control,” in Proc. IEEE Globecom, 1999, pp.
of Illinois at Urbana-Champaign in 1998 and 2001,
1747–1752. respectively.
[2] W. Feng, D. Kandlur, D. Saha, and K. Shin, “Blue: A New Class of
He is currently an Assistant Professor of electrical
Active Queue Management Schemes,” Univ. Michigan, Tech. Rep. and systems engineering at the University of Penn-
CSE-TR-387-99, Apr. 1999.
sylvania, Philadelphia. His research interests include
[3] S. Floyd, “TCP and explicit congestion notification,” ACM Comput. design and performance analysis of communication
Commun. Rev., vol. 24, pp. 10–23, Oct. 1994.
networks, congestion control, and pricing in hetero-
[4] S. Floyd and V. Jacobson, “Random early detection gateways for con- geneous networks.
gestion avoidance,” IEEE/ACM Trans. Networking, vol. 1, pp. 397–413,
Aug. 1993.
[5] R. J. Gibbens and F. P. Kelly, “Distributed connection acceptance con-
trol for a connectionless network,” in Proc. 16th Int. Teletraffic Congr.,
Edinburgh, Scotland, June 1999, pp. 941–952. R. Srikant (M’91–SM’01) received the [Link]. de-
[6] C. V. Hollot, V. Misra, D. Towlsey, and W. Gong, “A control theo- gree from the Indian Institute of Technology, Madras,
retic analysis of RED,” in Proc. IEEE INFOCOM, Anchorage, AK, Apr. in 1985, and the M.S. and Ph.D. degrees from the
2001, pp. 1510–1519. University of Illinois at Urbana-Champaign in 1988
[7] , “On designing improved controllers for AQM routers supporting and 1991, respectively, all in electrical engineering.
TCP flows,” in Proc. IEEE INFOCOM, Anchorage, AK, Apr. 2001, pp. He was a Member of Technical Staff at AT&T
1726–1734. Bell Laboratories from 1991 to 1995. He is currently
[8] F. P. Kelly, “Mathematical modeling of the Internet,” in Mathe- with the University of Illinois at Urbana-Champaign
matics Unlimited—2001 and Beyond, B. Engquist and W. Schmid, where he is an Associate Professor in the Depart-
Eds. Berlin, Germany: Springer-Verlag, 2001, pp. 685–702. ment of Electrical and Computer Engineering and
[9] F. P. Kelly, P. Key, and S. Zachary, “Distributed admission control,” a Research Associate Professor in the Coordinated
IEEE J. Select. Areas Commun., vol. 18, pp. 2617–2628, Dec. 2000. Science Laboratory. He was an associate editor of Automatica. His research
[10] S. Kunniyur and R. Srikant, “End-to-end congestion control: utility interests include communication networks, stochastic processes, queueing
functions, random losses and ECN marks,” in Proc. IEEE INFOCOM, theory, information theory, and game theory.
Tel Aviv, Israel, Mar. 2000, pp. 1323–1332. Dr. Srikant is currently on the editorial boards of the IEEE/ACM
[11] S. Kunniyur and R. Srikant, “End-to-end congestion control: utility TRANSACTIONS ON NETWORKING and IEEE TRANSACTIONS ON AUTOMATIC
functions, random losses and ECN marks,” IEEE/ACM Trans. Net- CONTROL. He was the Chair of the 2002 IEEE Computer Communications
working, vol. 11, pp. 689–702, Oct. 2003. Workshop in Santa Fe, NM.