ETH Zürich Analysis I Lecture Notes 2025
ETH Zürich Analysis I Lecture Notes 2025
Alessio Figalli
The guiding philosophy is simple: definitions and theorems are introduced only when they
are truly needed, proofs are written with an emphasis on structure rather than length, and
examples are used to illuminate ideas rather than to replace them. While many topics will
look familiar from high school (limits, derivatives, integrals), the viewpoint is different: we
develop a rigorous theory that explains why the methods of calculus work and how they fit
together. The course requires little beyond basic algebra and an intuitive understanding of
functions; from there, we build the logical framework needed to support later studies, starting
from multivariable calculus in Analysis II.
The organization mirrors the flow of a first encounter with rigorous analysis. An introduc-
tory chapter places classical problems (such as the quadrature of the parabola) in a historical
and conceptual perspective, and it is followed by practical advice on studying effectively.
We then introduce the real numbers through their algebraic and order properties and isolate
completeness as the key axiom; consequences such as the Archimedean principle and dec-
imal expansions are discussed. Complex numbers are introduced early to streamline later
discussions of series and power series.
With this foundation, we turn to sequences, limits, and the first qualitative properties of
functions (boundedness, monotonicity, continuity). Compactness on closed intervals leads to
fundamental results such as the intermediate value property, existence of extrema, and uniform
continuity, and prepares the ground for a precise treatment of exponential and logarithmic
functions. The material on limits of functions and Landau notation formalizes the asymptotic
language used throughout analysis and applications. A short chapter on sequences of functions
(pointwise versus uniform convergence) anticipates the role of uniformity in interchange of
limits, differentiation, and integration.
Series are handled in parallel with sequences: we discuss non-negative and conditionally
convergent series, absolute convergence and its criteria, reordering, and products. Power se-
ries are studied both in the real and complex settings, with radius of convergence, termwise
operations, and the construction of the elementary functions (exponential, trigonometric, log-
arithmic) from their series expansions, including polar coordinates and the complex logarithm.
Differential calculus begins with the derivative as a limit and its geometric meaning, pro-
ceeds through the calculus rules, and culminates in the mean value theorem and its conse-
quences (monotonicity, convexity, l’Hôpital’s rule). Integration is developed via step functions
and Riemann sums, followed by integrability criteria and basic properties. The Fundamental
Theorem of Calculus binds differentiation and integration, after which we present standard
i
Chapter 0.0
techniques (parts, substitution, rational functions), improper integrals, and a first look at
special functions such as the Gamma function. A chapter on Taylor polynomials and analytic
functions closes the circle between local approximation and global information.
The final part provides a concise introduction to ordinary differential equations: linear and
autonomous first-order equations, linear second-order equations with constant coefficients, and
an existence–uniqueness theorem for first-order problems. The emphasis is on illustrating how
the tools developed earlier—continuity, differentiability, integration, and series—combine to
yield both qualitative and quantitative information about solutions.
Throughout, proofs are included for the core results used later in the text; when an argument
is instructive but not essential, it will be marked as “Extra material”. Numerous examples
and exercises are interspersed to consolidate understanding; serious engagement with them is
indispensable, as mastery in mathematics is achieved primarily through problem solving.
These notes will continue to evolve. I have aimed for a balance between brevity and com-
pleteness, avoiding unnecessary generality while keeping the pathway to further topics as
transparent as possible. I hope the text will serve both as a reliable companion during the
semester and as a reference to which students can return in later studies.
1 Introduction 2
1.1 Quadrature of the Parabola . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.2 Naive Set Theory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.3 Tips on Studying . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
iii
Chapter 0.0 CONTENTS
1
Chapter 1
Introduction
1
1
x
0 1
This region, bounded above by a parabola, was already studied by Archimedes (ca. 287–212
BC), who computed it as the first example of a curvilinear area in the 3rd century BC.
2
Chapter 1.2
For now, let us assume that we understand the symbols in (1.1) and that P corresponds
to the colored region in the figure. In particular, we take for granted the existence of the real
numbers R.
Of course, once we know integral calculus, the computation is straightforward. But at this
stage we do not want to rely on integrals. Instead, we must face the more basic question:
What is an area?
If we cannot answer this question precisely, then the task of “computing the area of P ” is
not well defined. To proceed, we reformulate our aim as follows.
3. For sets F, G in R2 without common points, the area of the union F ∪ G is the sum of
the areas of F and G.
1
Then the area of the set P defined in (1.1) (if it exists) must be equal to 13 .
In other words, without deciding in general how area is defined, we can already prove that
1
3 is the only consistent value for the area of P .
For the proof of Proposition 1.1 we need the following lemma:
n3 n2 n
12 + 22 + · · · + n2 = + + . (1.2)
3 2 6
The proof of this result uses a standard technique that will appear many times throughout
your studies: the principle of mathematical induction. The idea of induction is the following:
(i) First, you verify that the statement holds for the initial natural number where it is intended
to be true (usually n = 1). This is called the base case.
(ii) Then, you assume that the statement is true for some number n, and under this assump-
tion, you prove that it is also true for n + 1. This is called the induction step.
(iii) If both steps (i) and (ii) succeed, one concludes that the statement is valid for all natural
numbers because starting from n = 1, the induction step allows one to go to n = 2, then to
n = 3, then to n = 4, and so on.
1 1 1
+ + = 1.
3 2 6
n3 n2 n
12 + 22 + · · · + n2 = + + . (1.3)
3 2 6
(n + 1)3 (n + 1)2 n + 1
12 + 22 + · · · + n2 + (n + 1)2 = + + . (1.4)
3 2 6
To this aim, we can rely on the assumption that the formula already holds for n. So, using
(1.3) and expanding (n + 1)2 we get
n 3 n2 n
2 2 2
1 1 + · · · + n + (n + 1) = + + + (n2 + 2n + 1)
3 2 6
n3 3n2 13n
= + + + 1.
3 2 6
On the other hand, expanding the terms (n + 1)3 and (n + 1)2 , we get
Proof of Proposition 1.1. Assume that there is a notion of area satisfying the three properties
of the proposition, and that it is defined for P . Let A denote the area of P .
Fix n ≥ 1. We partition the interval [0, 1] into n subintervals of equal length n1 . Above each
subinterval we place a rectangle of width n1 . If we choose the right endpoint of each subinterval
to determine the height, we obtain the rectangles shown in Figure 1.1 (left images).
1 1
P P
0 k−1 k 1 0 k−1 k 1
n n n n
1 1
P P
0 k−1 k 1 0 k−1 k 1
n n n n
Figure 1.1: The cases n = 6 and n = 10. In the left pictures the k-th rectangle has height
k 2 k−1 2
, while in the right pictures it has height .
n n
k 2
In this construction, the k-th rectangle has height n . Hence, by additivity of the area
1 12 22 n2
A≤ + + · · · +
n n2 n2 n2
1
= 3 (12 + 22 + · · · + n2 )
n
1 n3 n2 n
= 3 + +
n 3 2 6
1 1 1
= + + .
3 2n 6n2
(The line segments where the rectangles meet have zero area and can be ignored.)
Similarly, if instead we choose the left endpoint of each subinterval, we obtain the rectangles
2
shown in Figure 1.1 (right images). In this case, the k-th rectangle has height k−1 n , and
12 (n − 1)2
1 0
A≥ + + · · · +
n n2 n2 n2
1 2 2 2
= 1 + 2 + · · · + (n − 1)
n3
1 (n − 1)3 (n − 1)2 n − 1
= + +
n3 3 2 6
3
n2 n
1 n
= + + − n2
n3 3 2 6
1 1 1
= − + .
3 2n 6n2
1 1 1 1 1
− + ≤ A− ≤ + . (1.5)
2n 6n2 3 2n 6n2
1 Remark 1.3. — In the language of Riemann integration (that we will discuss in Chapter 6),
we have shown that the lower sums converge to 13 from below, while the upper sums converge
to 31 from above; therefore, A = 31 .
To make the last step rigorous, one must prove that the only real number satisfying (1.5)
for all n ≥ 1 is 0. Intuitively, this is clear: as n grows, both bounds 2n
1
+ 6n1 2 and − 2n
1
+ 6n1 2
shrink toward 0, leaving no other possible value. At this stage, however, we cannot yet give
a fully rigorous proof, because we have not defined the real numbers precisely.
Moreover, we have not yet settled the question of which subsets of R2 admit an area, or
what exactly we mean by “area”. Here we have worked under the implicit assumption that such
a notion exists for sets like P . These foundational questions will be addressed in later classes,
with the introduction of the Riemann and Lebesgue integrals and the concept of measurable
sets.
{x ∈ X | A(x)}
denotes the set of all elements x in X for which A(x) holds (set-builder notation).
The empty set, written ∅ (or sometimes {}), is the set containing no elements.
In addition, Zermelo–Fraenkel set theory assumes the axiom of regularity, which implies
that no set is an element of itself.
X = {x1 , x2 , . . . , xn }.
More often, we describe sets using a property that characterizes their elements. According to
postulate (3), this is done using the so-called set-builder notation. For instance, both
For convenience, we summarize below some of the logical symbols that will be used through-
out these notes. With time and practice, this mathematical language will become familiar.
Logical Symbols
• ∀ : “for all” or “for every”.
• ∃ : “there exists”.
For example,
x2 > 4 ⇏ x > 2, x ∈ Q ⇒ x ∈ R, x = 3 ⇔ 3x = 9.
Mathematics is learned by doing. You cannot learn mathematics by watching others, just
as you cannot learn to ski or play tennis by watching competitions on television. You have to
practice. Treat mathematics like a language: use it, speak it, and write it.
Exercises are the best teachers. The most effective way to learn is through solving problems.
Work on as many exercises as you can, try to explain the solutions to yourself and to others,
and attempt variations until you feel comfortable. Discussing the material with classmates is
also extremely helpful: explaining a proof or a solution often reveals whether you have really
understood it.
Asking questions is a strength. Never hesitate to ask questions. Many of your classmates
will have the same doubts, and raising them helps everyone. It also provides valuable feedback
to lecturers and assistants about which points need further explanation. Learning to formulate
precise questions is itself an important skill, and the first year is the perfect time to practice
it.
We begin with the notion of group. Loosely speaking, a group is a set equipped with an
“operation” that satisfies a list of properties. For our purposes, it is enough to know that a
operation is something that takes two elements of a set and gives back a third element of the
set. We now specify the properties that the operation must satisfy so that we can speak of a
group.
10
Chapter 2.1
• Associativity: No matter how you place parentheses, the result is the same: for
all a, b, c ∈ G,
(a ⋆ b) ⋆ c = a ⋆ (b ⋆ c).
a ⋆ e = e ⋆ a = a.
a ⋆ a−1 = a−1 ⋆ a = e.
Note that, in general, one does not require that a⋆b = b⋆a. If the order of the operation
2 does not matter, i.e. a ⋆ b = b ⋆ a for all a, b ∈ G, the group is called commutative or
abelian.
• Addition is associative.
• 0 is the neutral element.
• Every integer has an inverse: the inverse of n is −n.
with the multiplication ·. One can easily check that the multiplication is associative and
commutative, the neutral element is 1, and the inverse of pq is pq . Also, pq · rs = rs · pq .
Hence (Q∗ , ·) is a commutative group.
4. Permutations of three objects. Imagine we have three objects {1, 2, 3}. A permutation
is just a way of rearranging them. There are 6 possible rearrangements and together
they form the set S3 , whose elements are the following:
id (do nothing)
(1 2) (swap 1 and 2, leave 3)
(1 3) (swap 1 and 3, leave 2)
(2 3) (swap 2 and 3, leave 1)
(1 2 3) (send 1 7→ 2, 2 7→ 3, 3 7→ 1)
(1 3 2) (send 1 7→ 3, 3 7→ 2, 2 7→ 1).
2 The operation in this group is composition: do one rearrangement after another. More
explicitly, if σ and τ are two permutations, then σ ◦ τ means “first apply τ , then apply
σ”. With this operation, one can check all the properties:
Therefore (S3 , ◦) is a group, but in this case it is not commutative. For instance, let
σ = (1 2) and τ = (2 3).
- If we compute σ ◦ τ : τ sends 1 7→ 1, 2 7→ 3, 3 7→ 2. Then σ swaps 1 and 2. So overall
we get 1 7→ 2, 2 7→ 3, 3 7→ 1, which is the permutation (1 2 3).
- If we compute τ ◦ σ: σ swaps 1 and 2. Then τ swaps 2 and 3. So overall we get
1 7→ 3, 3 7→ 2, 2 7→ 1, which is the permutation (1 3 2).
Since (1 2 3) ̸= (1 3 2), we conclude that σ ◦ τ ̸= τ ◦ σ. Hence S3 is not commutative.
3. The inverse of the inverse of an element is the element itself, namely (a−1 )−1 = a
for all a ∈ G.
Proof. (i) Assume that, in addition to e ∈ G, we have a second element e′ with the property
that e′ ⋆ a = a ⋆ e′ = a for all elements a ∈ G. Then, we can choose a = e to obtain
e ⋆ e′ = e.
e ⋆ e′ = e′ .
2 e = e ⋆ e′ = e′ .
b = b ⋆ e = b ⋆ (a ⋆ c) = (b ⋆ a) ⋆ c = e ⋆ c = c.
This proves that the inverse element of a is unique, so we can speak of the inverse element,
and the notation a−1 makes sense.
(iii) Since a ⋆ a−1 = e, we deduce that a is the inverse of a−1 , thus
Groups capture the idea of combining elements with a single operation. But to describe
the arithmetic of numbers more faithfully, we also need a second operation (as we do with
addition and multiplication). This leads us to the notions of rings and fields.
a · (b + c) = a · b + a · c, (b + c) · a = b · a + c · a for all a, b, c ∈ R.
(k · l) · m = k · (l · m).
• Neutral element for the multiplication: The neutral element for the multiplication
is 1 ∈ Z as, for all integers k ∈ Z, we have
1 · k = k · 1 = k.
k · (l + m) = k · l + k · m
and
(k + l) · m = k · m + l · m.
2. The rational numbers Q. With the usual addition and multiplication, Q is a commutative
ring. Moreover, every nonzero rational number pq has a multiplicative inverse pq , which
is also rational. Hence Q is a field.
So, in short: rings generalize the integers, while fields generalize the rationals.
Example 2.6. — A non-commutative ring. We consider the set M2 (Z) of all 2 × 2 tables
of integers (called “matrices”) usually written as
!
a b
.
c d
!
0 0
This structure satisfies the axioms of a ring with neutral elements for addition and
0 0
!
1 0
for multiplication, but multiplication is not commutative. Let us check explicitly
0 1
with ! !
0 1 0 0
A= , B= .
0 0 1 0
First compute AB:
! ! ! !
0 1 0 0 0·0+1·1 0·0+1·0 1 0
AB = · = = .
0 0 1 0 0·0+0·1 0·0+0·0 0 0
We see that ! !
1 0 0 0
AB = ̸= = BA.
0 0 0 1
• The additive inverse of a is written −a, and the multiplicative inverse of a ̸= 0 is written
a−1 .
• In the current context, (2.1) applied to both addition and multiplication implies that
Proof. (i) Since 0 is the neutral element for the addition, we have 0 = 0 + 0. Hence, using
distributivity, we get
0 · a = (0 + 0) · a = (0 · a) + (0 · a).
Adding −0 · a (i.e., the inverse of 0 · a for the addition), we deduce that 0 · a = 0. The case of
a · 0 is analogous.
a · b + a · (−b) = a · (b + (−b)) = a · 0 = 0.
So a·(−b) is the additive inverse of a·b, i.e., −(a·b) = a·(−b). Taking b = 1 gives −a = (−1)·a.
The validity of (−a) · b = −(a · b) follows exchanging a and b in the argument above.
(iii) By (ii) we know that −(a · b) = a · (−b). Hence, recalling (2.2),
a · b = −(a · (−b)).
On the other hand, applying (ii) with (−b) instead of b, we also have
Combining the two identities above, we conclude that (−a) · (−b) = a · b. Finally, taking
b = a−1 yields (−a) · (−(a−1 )) = a · a−1 = 1, which gives the second assertion.
Remark 2.8. — A natural question one may ask is the following: Can 0 (the additive
neutral element) and 1 (the multiplicative neutral element) be the same? If 0 = 1, then for
any a ∈ F , we would have
a = a · 1 = a · 0 = 0.
So the field would collapse to just one element, namely {0}. From now on, we will always
assume that a field has at least two distinct elements, therefore 0 ̸= 1.
Order relation
Next, we introduce the second ingredient of an ordered field: the order relation. To get there,
we first need a few basic notions.
Cartesian Product
2
Let X and Y be two sets. The cartesian product X × Y is the set of ordered pairs
of elements of X and Y :
X × Y = {(x, y) | x ∈ X, y ∈ Y }.
Subsets
Let P and Q be sets.
Because of the axioms of naive set theory, two sets P and Q are equal exactly when both
P ⊂ Q and Q ⊂ P hold. For example, {x, y} = {z} holds if x = y = z. Notice that
multiplicities do not matter: {x, x, x} = {x}.
3. Symmetric: if x ∼ y, then y ∼ x.
• The usual relation ≤ (“less than or equal to”). This relation satisfies the following
properties:
So ≤ is an order relation.
Ordered Fields
We now introduce the concept of an ordered field. From now on, we use the arrow “ =⇒ ” to
denote implication: A =⇒ B means “A implies B”.
x ≤ y =⇒ x + z ≤ y + z.
0 ≤ x and 0 ≤ y =⇒ 0 ≤ x · y.
x≤y<z=a
Example 2.13. — A standard example of an ordered field is the field of rational numbers
′
Q with the usual order. For two fractions pq and pq′ (with p, p′ ∈ Z and q, q ′ ∈ N), we define
3 p p′
≤ ′ if pq ′ ≤ p′ q,
q q
where the inequality on the right is the usual order on the integers. It is easy to check that
this order is compatible with addition and multiplication, so (Q, ≤) is indeed an ordered field.
Given (F, ≤) an ordered field, we want to prove a series of properties that follow from the
definitions. To simplify the notation, it is customary to write · for multiplication only if it
would otherwise be confusing. This is why, in proofs, · may disappear. For example, we may
write xy instead of x · y.
(b) If x < y and y ≤ z, then x < z. (Analogously, x ≤ y and y < z imply x < z.)
(g) 0 < 1.
(l) If x + y ≤ x + z, then y ≤ z.
Proof. (a) By linearity of the order, for any x, y at least one of x ≤ y or y ≤ x holds. If x ≤ y
and y ≤ x, antisymmetry gives x = y. Otherwise, exactly one strict inequality holds, giving
x < y or y < x.
(b) From x < y we have in particular x ≤ y. Since y ≤ z, transitivity yields x ≤ z. So, to
prove x < z, we need to exclude that x = z.
To see that, assume by contradiction that x = z. Then y ≤ z yields y ≤ x, which contradicts
x < y. Hence x < z.
The variant in parentheses is analogous.
(c) From x ≤ y, compatibility with addition (Definition 2.12) gives x + z ≤ y + z. From
z ≤ w we get y + z ≤ y + w. Transitivity yields x + z ≤ y + w.
For the strict variant, use (b).
(d) If x ≤ y, add −x to both sides to obtain 0 ≤ y − x. Conversely, if 0 ≤ y − x, add x to
get x ≤ y.
(e) Apply (d) with y = 0.
as desired.
(k)–(m) These follow by combining (h)–(i) with (c) and (d). Detailed arguments are
assigned to Exercise 2.15.
Now that we have a notion of an ordered field, we can construct the integers and rational
numbers.
2 = 1 + 1, 3 = 2 + 1, . . . , −n = (−1) · n
(ii) Every fraction pq −1 with p, q ∈ Z, q ̸= 0, lies in F and the set of all such elements
is denoted by Q. Also,
3
Z ⊊ Q ⊆ F.
Proof. (i) By Lemma 2.14(g), we have 0 < 1. Then Lemma 2.14(c) yields 0 < 1 < 2 < 3 < · · · ,
and taking negatives gives · · · < −2 < −1 < 0. Hence all these elements are distinct.
(ii) For q ̸= 0, q is invertible in F ; define pq = pq −1 . The set of such fractions is a field
contained in F , which we denote by Q.
To show that Q strictly contains Z, consider 12 (the inverse of 2). Since 2 > 1, it follows
from Lemma 2.14(j) that 0 < 12 < 1, so 12 ̸∈ Z.
3
+ 4 ≥ 0 = {x ∈ R \ {0} | −3 ≤ x ≤ −1 or x > 0} .
x ∈ R \ {0} | x + x
(x+3)(x+1)
Hint: note that x + 3
x +4= x .
Functions
A function f from a set X to a set Y is an assignment of an element of Y to each
element of X. The element y ∈ Y to which x ∈ X is assigned is denoted f (x). We
write f : X → Y for a function from X to Y and sometimes also speak of a map,
mapping, or transformation.
The set X is the domain and Y the codomain.
We refer to the set X as domain, and the set Y as domain of values or codomain.
The set
{(x, f (x)) | x ∈ X} ⊂ X × Y
f :X → Y
x 7→ f (x),
3
where f (x) could be a concrete formula. We pronounce “7→” as “is mapped to”.
Two functions f1 : X1 → Y1 and f2 : X2 → Y2 are said to be equal if X1 = X2 , Y1 = Y2 ,
and f1 (x) = f2 (x) for all x ∈ X1 .
(b) |x| ≥ 0, and |x| = 0 if and only if x = 0 (by trichotomy, Lemma 2.14 a).
−y ≤ 0 ≤ x ≤ y.
Exchanging the roles of x and y we also have |y| − |x| ≤ |y − x| = |x − y|, Combining these
two inequalities yields
−|x − y| ≤ |x| − |y| ≤ |x − y|,
Exercise 2.20. — For which x, y ∈ R does equality hold in the triangle inequality? And
3
in the inverse triangle inequality?
Then X and Y are non-empty, and every x ≤ y for every x ∈ X and y ∈ Y . However, there
is no rational number c with x ≤ c ≤ y for all such x, y (since there is no c ∈ Q with c2 = 2).
This “gap” shows that Q fails the completeness property below. To rule out such gaps we add
the completeness axiom. The need for such an axiom was already felt by the ancient Greeks
(Pythagoras, Euclid, Archimedes), but a precise formalisation came only in the 19th century
through the work of Weierstrass, Heine, Cantor, Dedekind, and others.
We will often visualise the real numbers as points on a straight line, also called the number
line.
−1 0 1 2 3 x y
Given x, y ∈ R, we interpret the relation x < y as “on the straight line, the point y lies to
the right of the point x”. With this representation of the real numbers, the following figure
represents the completeness axiom.
X c Y
Figure 2.1: Given X, Y ⊂ R with x ≤ y for all x ∈ X and y ∈ Y , there exists a number c in
between.
We note that while the number line is a helpful aid to build intuition, it should not replace
rigorous proofs.
X Y X Y
f
f
Figure 2.2: Left: injective but not surjective. Right: surjective but not injective.
f −1 (B) = { x ∈ X | f (x) ∈ B }.
Example 2.25. — Let X, Y be finite sets with the same number of elements. Then for any
f : X → Y , injectivity and surjectivity are equivalent.
Proof. Suppose X and Y both have n elements, and list X = {x1 , . . . , xn }. If f is
injective, the n values f (xi ) are all distinct, so f (X) = {f (x1 ), . . . , f (xn )} has n elements.
Since f (X) ⊂ Y and |Y | = n, we must have f (X) = Y , i.e. f is surjective.
Conversely, to show that surjectivity implies injectivity, we prove that if f is not injective
then f is not surjective. So, assume there exist xi ̸= xj with f (xi ) = f (xj ). Then f (X) has
at most n − 1 elements, so it cannot coincide with Y and, therefore, f cannot be surjective.
Remark 2.26. — For infinite sets, injectivity and surjectivity need not be equivalent.
Consider f1 , f2 : N → N defined by
0, n = 0,
f1 (n) = n + 1, f2 (n) =
n − 1, n ≥ 1.
Then f1 is injective but not surjective, while f2 is surjective but not injective.
√
Exercise 2.28. — Show the existence and uniqueness of a bijective function · : R≥0 →
√
R≥0 with ( a)2 = a for all a ∈ R≥0 .
c2 − a
(c − ε)2 = c2 − 2cε + ε2 > c2 − 2cε = c2 − 2c · = a.
2c
2. (Uniqueness) Prove that for every a ∈ R≥0 there is at most one c ∈ R≥0 with c2 = a.
Hint: First, prove that for all x, y ∈ R≥0 , the statements x < y and x2 < y 2 are
equivalent. Then use this fact to deduce the uniqueness of c.
√ √
Define · : R≥0 → R≥0 by a = c where c is as above. Show that:
√ √ √
3. · is increasing: if 0 ≤ x < y then x< y;
√
4. · is bijective;
√ √ √
5. xy = x y for all x, y ∈ R≥0 .
√
Exercise 2.29. — For all x ∈ R, show that x2 = |x|2 and x2 = |x|.
Working rules. In a field of real numbers as in Definition 2.22, the usual arithmetic rules
4
and equation manipulations hold (as always, division by 0 is undefined). The order relations
≤ and < satisfy the familiar laws for inequalities; in particular, multiplying an inequality by
a negative number reverses its direction. We will use these laws freely from now on. The new
ingredient is the completeness axiom, whose power will become clear as we apply it to prove
further results.
Do such numbers actually exist? Why do we say the real numbers? At this point
it is not obvious that a completely ordered field really exists. Moreover, we often speak of the
real numbers as if there were only one such object. In this course we will assume (in line with
your school experience) that a field of real numbers exists and is unique. In particular, you
may safely use R with its usual arithmetic, order rules, and completeness, and you can think
of R as the rational line with all gaps filled.
For those interested, the following section provides a brief and concrete explanation of why
this assumption is reasonable, with complete proofs reserved for later classes.
Extra material: Why the real numbers exist and are unique
In what follows, we sketch (without all details) the construction of R via Dedekind cuts and
the uniqueness argument for complete ordered fields.
Existence. Start from the rationals Q. Many real numbers are not rational, but we can
still “identify them” by stating which rationals lie to their left. This leads to the idea of
Dedekind cuts.
A Dedekind cut is a set C ⊂ Q with the following properties:
√
Intuitively, C collects all rationals “to the left” of a real number. For example, the cut of 2
is
{ q ∈ Q | either q < 0, or q ≥ 0 and q 2 < 2 }.
Define RDed to be the set of all Dedekind cuts with the following addition and multiplication:
C + D = {q + r | q ∈ C, r ∈ D}, C · D = {q · r | q ∈ C, r ∈ D}.
Thus, at an intuitive level, real numbers exist: they can be realized as precise “cuts” of the
rational line filling all the “gaps”.
Uniqueness. Suppose K and L are two completely ordered fields, and let 0K , 1K and
0L , 1L denote their neutral elements for addition and multiplication. We identify 0K with 0L
and 1K with 1L . In this way, as a consequence of how the rationals are constructed inside any
ordered field (see Lemma 2.16), the rationals in K and in L are “the same” (i.e. the rational
q in K corresponds to the same q in L). In particular, we may regard a single set of rationals
Q as contained in both K and L.
Now, for x ∈ K, consider the sets
Xx = { q ∈ Q | q < x in K } ⊂ Q, Yx = { q ∈ Q | q > x in K } ⊂ Q.
These are nonempty, and we have q ≤ r for all q ∈ Xx and r ∈ Yx . Since Q ⊂ L, both Xx
and Yx are also contained in L. By completeness of L, there exists c ∈ L with
One checks that this map preserves addition, multiplication, and order, and fixes every rational
(i.e. IK,L (q) = q for all q ∈ Q).
Repeating the construction with K and L swapped gives a map IL,K : L → K, and one
can check that
IL,K IK,L (x) = x for all x ∈ K, IK,L IL,K (y) = y for all y ∈ L.
Thus IK,L and IL,K are inverses, so IK,L : K → L is a bijection that “identifies” K and L.
In short, once the rationals are fixed inside a completely ordered field, every other element
is uniquely determined by how it “cuts” the rationals. This justifies speaking of the real
numbers and writing R.
2.1.3 Intervals
4
• the unbounded closed intervals
The intervals (a, b], [a, b), and (a, b) are non-empty exactly when a < b, while [a, b] is
non-empty exactly when a ≤ b (with [a, a] = {a} a degenerate interval). If an interval is
non-empty and bounded, we call a its left endpoint, b its right endpoint, and b − a its
length. Intervals of the forms [a, b], (a, b], [a, b), (a, b) are also called bounded intervals,
to distinguish them from the unbounded ones.
Some texts write open and half–open intervals using inverted square brackets, e.g. ]a, b[
instead of (a, b). In these notes we always use round brackets for open endpoints.
Set operations
Let P and Q be sets. The intersection P ∩ Q, the union P ∪ Q, the relative
complement P \ Q, and the symmetric difference P △Q are defined by
P ∩ Q = { x | x ∈ P and x ∈ Q },
P ∪ Q = { x | x ∈ P or x ∈ Q },
P \ Q = { x | x ∈ P and x ∈
/ Q },
P △Q = (P \ Q) ∪ (Q \ P ) = (P ∪ Q) \ (P ∩ Q).
These definitions are illustrated in the following pictures. Sketches of this kind are called
Venn diagrams.
P Q P Q
P ∩Q P \Q
5
P Q P Q
P ∪Q P △Q
If it is clear from the context that all sets under consideration are subsets of a given ambient
set X, then the complement of P in X is denoted by P c and defined as P c = X \ P.
Pc X
P
[1, ∞).
Exercise 2.32. — Let X be a set and let A ⊆ P(X) be a collection of subsets of X. Show
the De Morgan laws for unions and intersections of sets:
5
!c !c
[ \ \ [
A = Ac , A = Ac
A∈A A∈A A∈A A∈A
2. When is the union of two intervals an interval again? In that case, what can you say
when you unite two intervals of the same type (open, closed, half–open)?
Example 2.35. — Both [−1, 1] and Q ∪ [−1, 1] are neighbourhoods of 0 ∈ R (they contain,
say, (− 21 , 12 )), while [0, 1] is not a neighbourhood of 0.
(x − δ, x + δ) = { y ∈ R | |x − y| < δ },
Open intervals are open, and closed intervals are closed. Intuitively, a set is open if every
point x in the set comes with a small interval around x still lying in the set. Note that “open”
is not the opposite of “closed”: the sets ∅ and R are both open and closed (their complements
5 are R and ∅, respectively). By contrast, Q ⊂ R and [a, b) ⊂ R are neither open nor closed.
Exercise 2.37. — Show that U ⊆ R is open if and only if for every x ∈ U there exists
δ > 0 such that (x − δ, x + δ) ⊆ U .
Exercise 2.38. — Let U be a family of open subsets of R, and let F be a family of closed
subsets of R. Show that
[ \
U is open, and C is closed.
U ∈U C∈F
(Optional.) Prove also: finite intersections of open sets are open, and finite unions of closed
sets are closed.
C = R2 = {(x, y) | x, y ∈ R}.
We denote elements z = (x, y) ∈ C in the form z = x + iy, where i is the imaginary unit.
Here x ∈ R is the real part of z, written x = Re(z), and y ∈ R is the imaginary part,
written y = Im(z). Elements with Im(z) = 0 are called real, while those with Re(z) = 0 are
purely imaginary. Via the injective map R ∋ x 7→ x + i0 ∈ C, we identify R with the subset
of real numbers inside C.
iR
iy x + iy
−1 + i i 1+i
−1 0 1 x
5 i i R
−1 − −
2 2
Figure 2.4: The graphical representation of C is the complex plane. In this picture, the real
numbers lie on the real axis and the purely imaginary numbers on the imaginary axis.
As you may expect from previous knowledge, we want i to satisfy i2 = −1. To achieve this,
we define addition and multiplication on C so that it becomes a field. Additionally, we want
these operations to coincide with the usual addition and multiplication when considering real
numbers.
Since i2 = −1, using commutativity and distributivity we get
Proof. Additive properties follow immediately from the corresponding properties in R: (0, 0)
is the additive identity and (−x, −y) is the additive inverse of (x, y).
We now check all the properties of multiplication by direct computation. We start from
the associativity.
Given (x1 , y1 ), (x2 , y2 ), (x3 , y3 ) ∈ C, we compute
(x1 , y1 ) · (x2 , y2 ) · (x3 , y3 ) = (x1 x2 − y1 y2 , x1 y2 + y1 x2 ) · (x3 , y3 )
= (x1 x2 x3 − y1 y2 x3 − x1 y2 y3 − y1 x2 y3 , x1 y2 x3 + y1 x2 x3 + x1 x2 y3 − y1 y2 y3 ).
Analogously, we have
(x1 , y1 ) · (x2 , y2 ) · (x3 , y3 ) = (x1 , y1 ) · (x2 x3 − y2 y3 , x2 y3 + y2 x3 )
= (x1 x2 x3 − y1 y2 x3 − x1 y2 y3 − y1 x2 y3 , x1 y2 x3 + y1 x2 x3 + x1 x2 y3 − y1 y2 y3 ).
Since the two expressions on the right-hand side coincide, the multiplication is associative.
5 Commutativity is also easy to check: indeed,
Indeed,
(x, y) · x
x2 +y 2
, x2−y
+y 2
= x · x2 +yx −y
2 − y · x2 +y 2 , y ·
x
x2 +y 2
+x· −y
x2 +y 2
2 2
= xx2 +y
+y 2 , yx−xy
2
x +y 2 = (1, 0).
From now on we write x + iy instead of (x, y), and abbreviate x + i0 as x, 0 + iy as iy, and
i1 simply as i. Then i2 = −1, and R naturally embeds into C. For z, w ∈ C we write zw for
their product. If z ̸= 0, its multiplicative inverse can be denoted by z −1 or z1 . For example,
i−1 = 1i = −i.
iR
z = x + iy
y
5
0 x R
−y
z = x − iy
(ii) z + w = z + w.
(iii) zw = z w.
Proof. Property (i) follows from the fact that, for z = x + iy, (x + iy)(x − iy) = x2 + y 2 . Also,
x2 + y 2 = 0 if and only if x + iy = 0.
Properties (ii) and (iii) follow from a direct computation, writing z = x1 +iy1 and w = x2 +iy2 :
z+z z−z
Re(z) = , Im(z) = ,
2 2i
Since i2 = −1 < 0, property (f) in Lemma 2.19 implies that no order compatible with field
operations can exist on C. Nevertheless, calculus can be carried out on C, and this will be
studied in detail in the course on complex analysis. The reason is that C satisfies a suitable
extension of the completeness axiom, which you will meet in future courses.
√ √
For x ∈ R, we have xx = x2 = |x|, so the complex absolute value extends the real one
from Definition 2.18 and the notation is consistent.
Note that |z| ≥ 0 for all z ∈ C, with equality if and only if z = 0 (see Lemma 2.42(i)).
Also, the absolute value is multiplicative:
√ √ √
|zw| = zw zw = zz ww = |z||w| for all z, w ∈ C.
In particular, for z ̸= 0,
z
z −1 = .
|z|2
These properties follow directly from Lemma 2.42. Also, geometrically, |z| = x2 + y 2 is the
p
iR
w
z
z+w
0 R
w
Figure 2.6: A visual representation of the triangle inequality: Placing w at the tip of z forms
a triangle with third side z + w. The length of this side is at most the sum of the other two,
namely, |z + w| ≤ |z| + |w|.
x1 x2 + y1 y2 ≤ |z||w|. (2.3)
|x1 x2 + y1 y2 | ≤ |z||w|.
Proof of Proposition 2.45. For z = x1 + iy1 and w = x2 + iy2 , using Lemma 2.46 we have
Because |z − w| represents the distance between z and w, this motivates the following defi-
nition:
B(z, r) = {w ∈ C | |z − w| ≤ r}.
In other words, the open disk B(z, r) is the set of points at distance strictly less than r
from z. We note that this definition is compatible with the one of neighborhood in R: if x ∈ R
and r > 0, then
B(x, r) ∩ R = (x − r, x + r).
iR
6
Exercise 2.48. — Let z1 , z2 ∈ C and r1 , r2 > 0. Show that, for every z ∈ B(z1 , r1 ) ∩
B(z2 , r2 ), there exists r > 0 such that
s = max(X).
r = min(X).
6
• X is called bounded if it is both bounded from above and bounded from below.
A closed interval [a, b] with a < b has both a minimum and a maximum: a = min([a, b])
and b = max([a, b]). But not all sets have a maximum. For instance, the open interval (a, b)
does not have a maximum because the endpoint b, though an upper bound, is not contained
in the set. Similarly, R and unbounded intervals such as [a, ∞) or (a, ∞) have no maximum.
A := {a ∈ R | x ≤ a for all x ∈ X}
be the set of all upper bounds of X. If A has a minimum, we call this minimum the
supremum of X and write
sup(X) = min(A).
In other words, the supremum of X is the smallest real number that is greater than or
equal to every element of X. Note that we can describe the supremum s = sup(X) as follows:
This means that for every t < s, there exists some x ∈ X such that x > t. That is,
Remark 2.53. — If a set X has a maximum, then this element is also the supremum.
Indeed, the maximum is an upper bound of X, and since it lies in X, no smaller upper bound
can exist.
1
| n ≥ 1 = 0, 21 , 23 , 34 , . . . .
X := 1 − n
• No number smaller than 1 is an upper bound, because for any t < 1 we can find n
large enough such that 1 − n1 > t. (We will justify this fact rigorously later using the
Archimedean Principle, see Corollary 2.60.)
sup(X) = 1
Note that not every set has a supremum. If X = ∅ or if X is unbounded from above,
then sup(X) does not exist. However, for any nonempty and bounded-above subset of R, the
supremum always exists:
Proof. Since X is bounded from above, the set A := {a ∈ R | x ≤ a for all x ∈ X} of upper
bounds is nonempty. Since x ≤ a for any x ∈ X and a ∈ A, we can apply the completeness
The first inequality implies that c is itself an upper bound (so c ∈ A), while the second
inequality tells us that c is smaller than or equal to every other upper bound. Hence, c =
min(A) = sup(X).
X + Y := {x + y | x ∈ X, y ∈ Y } and X · Y := {x · y | x ∈ X, y ∈ Y }.
Then the sets X ∪ Y , X ∩ Y , and X + Y are also bounded from above. Moreover, if
X, Y ⊂ R≥0 (that is, x ≥ 0 and y ≥ 0 for all x ∈ X and y ∈ Y ), then X · Y is bounded
from above as well.
In these cases, the following formulas hold:
(3) Let x0 = sup(X) and y0 = sup(Y ). For any z ∈ X + Y , there exist x ∈ X and y ∈ Y
such that z = x + y. Since x ≤ x0 and y ≤ y0 , we have
z = x + y ≤ x 0 + y0 ,
ε := x0 + y0 − z0 > 0.
Since x0 = sup(X), by the characterization (2.5) there exists x ∈ X such that x > x0 − ε/2.
Likewise, there exists y ∈ Y such that y > y0 − ε/2. Setting z = x + y, we obtain
ε ε
z > x0 − + y0 − = x0 + y0 − ε = z0 ,
2 2
(4) The proof is analogous. If all elements of X and Y are non-negative, and we set
x0 = sup(X) and y0 = sup(Y ), then for any z = x · y ∈ XY , we have
z = x · y ≤ x 0 · y0 ,
which shows that x0 · y0 is an upper bound for X · Y . Using a similar “ε-argument” as done
above when proving (3), one shows that this upper bound is sharp, i.e., x0 · y0 is the least
upper bound.
If X ⊆ R is nonempty and bounded from below, the largest lower bound of X is called
the infimum, denoted by inf(X). An existence result analogous to Theorem 2.55 holds for
infima as well. Moreover, the infimum can be expressed using the supremum:
This means that most results about infima can be deduced directly from those about suprema.
6 In this section, we extend the notions of supremum and infimum to arbitrary subsets of R.
To do so, we introduce two formal symbols:
+∞ and − ∞,
which are not real numbers. We define the extended real number line (also called the
two-point compactification of R) by
R = R ∪ {−∞, +∞}.
Figure 2.8: The extended real number line R, obtained by adding −∞ on the far left and +∞
on the far right of the usual real line.
We now introduce some standard (but informal) computation rules involving these symbols.
For all x ∈ R, we adopt the conventions:
∞ + x = ∞ + ∞ = ∞, −∞ + x = −∞ − ∞ = −∞.
If x > 0, then
x · ∞ = ∞ · ∞ = ∞, x · (−∞) = ∞ · (−∞) = −∞,
These rules are widely used as notational shorthand, but one must handle them with care.
Expressions like
∞ − ∞, 0 · ∞, or similar
• If X = ∅, we define inf(∅) = ∞.
In other words:
n ≤ x < n + 1.
E = {n ∈ Z | n ≤ x}.
7
Since 0 ∈ E and x is an upper bound, E is a non-empty subset of R bounded from above.
Hence, by Theorem 2.55, the supremum s0 = sup(E) exists. From the definition of supremum
we deduce:
(ii) there exists n0 ∈ E with s0 − 1 < n0 (otherwise s0 − 1 would also be an upper bound).
(iii) n0 + 1 ∈
/ E (otherwise s0 would not be an upper bound for E).
Moreover, since m ≤ s0 for every m ∈ E, we have m < n0 + 1 for all m ∈ E. As all elements
of E are integers,
m < n0 + 1 ⇐⇒ m − n0 < +1 ⇐⇒ m − n0 ≤ 0 ⇐⇒ m ≤ n0 .
m ≤ −x < m + 1,
which is equivalent to
−m − 1 < x ≤ −m.
If x = −m, then set n = −m. If x < −m, set n = −m − 1. In both cases, we obtain
n ≤ x < n + 1.
1
< ε.
n
1
m≤ < m + 1.
ε
For every a, b ∈ R with a < b, there exists r ∈ Q such that a < r < b.
n ≤ ma < n + 1,
or equivalently,
n n+1
≤a< .
m m
Since 1
m < ε, by the two inequalities above we obtain
n+1 1
a< ≤a+ < a + ε = b.
m m
Thus r = n+1
m is a rational number between a and b.
Exercise 2.63. — Show the following analogue of Theorem 2.58: For every x ∈ R with
x ≥ 1, there exists exactly one n ∈ N such that
10−n < ε.
While the Archimedean principle looks “obvious”, it is actually more subtle than one may
think. Indeed, there exist ordered fields for which the Archimedean principle fails, as the
following exercise shows.
where R[x] denotes the set of polynomials with real coefficients (e.g. p(x) = 3x4 − 5x + 7,
q(x) = 2x2 − 1), and q(x) is different from the polynomial that is identically zero. Inside this
field, the set Z corresponds to the constant polynomial f (x) ≡ n ∈ Z.
We define the following order: f > g in F if f (x) − g(x) > 0 for all sufficiently large x ∈ R.
a0 , a1 , a2 , a3 , . . .
x0 = a0 , y0 = a0 + 1,
a1 a1 1 a1 + 1
x1 = a0 + , y1 = a0 + + = a0 + ,
10 10 10 10
a1 a2 a1 a2 1 a1 a2 + 1
x2 = a0 + + , y2 = a0 + + + = a0 + + ,
10 100 10 100 100 10 100
a1 an a1 an + 1
xn = a0 + + ... + n yn = a0 + + ... + . (2.6)
10 10 10 10n
7 Note that all the numbers xn and yn are rational. Also, since 0 ≤ ak ≤ 9 for k ≥ 1, one can
check that
x0 ≤ x1 ≤ · · · ≤ xn ≤ xn+1 ≤ · · · ≤ yn+1 ≤ yn ≤ · · · ≤ y1 ≤ y0 .
Thus, if we consider the sets X = {x0 , x1 , x2 , . . .} and Y = {y0 , y1 , y2 , . . .}, by the completeness
axiom there exists c ∈ R such that
Also, Exercise 2.64 shows that such a c is uniquely determined: since yn − xn = 10−n , if
c, d ∈ R both satisfy (2.7), then
which implies |d − c| = 0, i.e., c = d. We therefore define c to be the real number with decimal
expansion
c = a0 .a1 a2 a3 . . .
c
x1 x2 x3 y3 y2 y1
Figure 2.9: The rational numbers xn give better and better lower estimates for c, while the
rational numbers yn provide increasingly accurate upper estimates. The number c lies between
all of them.
Remark 2.66. — Alternatively, the number c may be defined either as the supremum of
the set X = {x0 , x1 , x2 , . . .} or as the infimum of the set Y = {y0 , y1 , y2 , . . .}.
If a0 < 0, we proceed as follows: consider the decimal expansion of the (−a0 , a1 , a2 , a3 , . . .),
apply the previous construction, and then define the desired number to be the negative of the
result.
a0 = −33, a1 = 1, a2 = 6, an = 0 for n ≥ 3.
Then the construction above applied to (−a0 , a1 , a2 , . . .) gives 33.16, so the corresponding real
number is
c = −33.16.
0.1999 . . . = 0.2000 . . . = 51 .
This phenomenon occurs exactly when the expansion eventually becomes all 9s. To avoid
ambiguity, we define a real decimal fraction as a sequence
a0 , a1 , a2 , a3 , . . .
with 0 ≤ an ≤ 9 for all n ≥ 1, such that for every n0 ≥ 1 there exists n ≥ n0 with an ̸= 9.
Cardinality
Let X and Y be sets.
• A set X has finite cardinality |X| = n if there is a bijection with {1, . . . , n}.
is a bijection, so N ∼ Neven .
Explicitly:
0 7→ 0, 1 7→ 2, 2 7→ 4, 3 7→ 6, ..., −1 7→ 1, −2 7→ 3, −3 7→ 5, ...
3. Q is countable.
Q ≲ Z × N ∼ N × N.
(m + n)(m + n + 1)
f5 : N × N → N, f5 (m, n) = + n.
2
One can prove that f5 is a bijection (although only injectivity is needed here), as one
can also convince oneself by looking at Figure 2.10, hence
N × N ∼ N.
N ≲ Q ≲ Z × N ∼ N × N ∼ N,
54
9
(0,9)
44 53
8
(0,8) (1,8)
35 43 52
7
(0,7) (1,7) (2,7)
27 34 42 51
6
(0,6) (1,6) (2,6) (3,6)
20 26 33 41 50
5
(0,5) (1,5) (2,5) (3,5) (4,5)
14 19 25 32 40 49
7 4
(0,4) (1,4) (2,4) (3,4) (4,4) (5,4)
9 13 18 24 31 39 48
3
(0,3) (1,3) (2,3) (3,3) (4,3) (5,3) (6,3)
5 8 12 17 23 30 38 47
2
(0,2) (1,2) (2,2) (3,2) (4,2) (5,2) (6,2) (7,2)
2 4 7 11 16 22 29 37 46
1
(0,1) (1,1) (2,1) (3,1) (4,1) (5,1) (6,1) (7,1) (8,1)
0 1 3 6 10 15 21 28 36 45
0
(0,0) (1,0) (2,0) (3,0) (4,0) (5,0) (6,0) (7,0) (8,0) (9,0)
0 1 2 3 4 5 6 7 8 9
Figure 2.10: A representation of the function f5 . This map enumerates all elements of N × N.
The value of f5 (m, n) is in black; the coordinate (m, n) is in blue.
We now want to construct a new number x ∈ [0, 1) that is not in the list above. A possible
way to do this is the following: write x = 0.b1 b2 b3 b4 and define
5 if a0,1 ̸= 5, 5 if a1,2 ̸= 5, 5 if a ̸= 5,
2,3
b1 = , b2 = , b3 = ,
6 if a = 5,
0,1
6 if a = 5, 1,2
6 if a = 5, 2,3
8
and, more in general,
5 if a ̸ 5,
i,i+1 =
bi = for all i ≥ 1.
6 if a
i,i+1 = 5.
We now observe that the number x = 0.b1 b2 b2 . . . cannot be in the list, since for every i ≥ 0 it
differs from xi in the (i + 1)-th decimal place. This contradicts the assumption that we have
listed all real numbers. Therefore [0, 1) (and hence also R) is uncountable.
We have seen that sets like Z and Q are countable, whereas the set of real numbers R is
fundamentally larger. In this section, we present an alternative proof of this fact and discuss
in more detail the question: “How large is R?”
Power Set
Let X be a set. The power set P(X) of X is the set of all subsets of X:
P(X) := {A ⊆ X}.
P(X) = {∅, {0}, {1}, {2}, {0, 1}, {0, 2}, {1, 2}, {0, 1, 2}}.
Proof. First of all, since there is an injective map i : X → P(X) given by i(x) = {x}, we see
that |X| ≤ |P(X)|.
Now, assume for contradiction that there exists a bijection f : X → P(X) and define the
set
A := {x ∈ X | x ∈/ f (x)}.
Since f is surjective, there exists a ∈ X such that f (a) = A. However we now see that this is
impossible. Indeed:
• If a ∈
/ A, then by the definition of A it follows that a ∈ f (a) = A, again a contradiction.
We now show that the set of real numbers has the same cardinality as P(N).
|R| = |P(N)|.
Given a subset A ⊂ N, define φ(A) as the real number with binary expansion
1 if n ∈ A,
φ(A) := 0.a0 a1 a2 a3 . . . where an =
0 if n ∈
/ A.
If A ̸= B, let n be the smallest element of A△B. Then φ(A) and φ(B) differ in the n-th digit,
so φ(A) ̸= φ(B). Hence φ is injective.
Conversely, we show that |[0, 1)| ≲ |P(N)|. Every real number x ∈ [0, 1) has a binary
expansion of the form
x = 0.b0 b1 b2 . . . with bi ∈ {0, 1}.
Ax := {n ∈ N | an = 1} ⊆ N.
This gives a map [0, 1) → P(N). There is only one subtlety: some numbers have two binary
expansions (for example, 0.011111 . . . = 0.100000 . . .). To avoid ambiguity, we agree to always
choose the expansion that ends with infinitely many zeros rather than the one ending with
infinitely many ones. With this convention, each real number in [0, 1) corresponds uniquely to a
subset of N. Therefore, we have defined an injection [0, 1) ,→ P(N), and hence |[0, 1)| ≲ |P(N)|.
By the Schröder–Bernstein Theorem, we obtain |[0, 1)| = |P(N)|.
Finally, it remains to see that [0, 1) and R have the same cardinality. An explicit injection
is given by
x 1
f : R → (0, 1), f (x) = + .
2(1 + |x|) 2
Thus |R| ≲ |(0, 1)| ≲ |[0, 1)|. Since trivially |[0, 1)| ≲ |R|, we conclude that
The cardinality of P(N) is denoted c and called the continuum. Hence, we have proved
that
|R| = c and ℵ0 < c.
A famous question, posed by Cantor, is whether there exists a set whose cardinality lies
strictly between ℵ0 and c. This is the Continuum Hypothesis. Remarkably, this question
can neither be proved nor disproved from the standard axioms of set theory (ZFC): it is
independent of them. This was shown by Gödel (1938) and Cohen (1963).
Since we primarily use the letter x to denote a real number, for sequences of real numbers
we shall mostly write (xn )n∈N , (xn )∞
n=0 , or (xn )n≥0 .
Remark 2.76. — Throughout these notes we usually write sequences as (xn )∞ n=0 , but the
starting index is not essential. A sequence may equally well be defined from n = 1, or from
any other integer, without changing any of the notions or results below. In particular, shifting
the starting index does not affect the concepts of convergence, boundedness, or monotonicity,
which we will discuss later.
8
n=1 given by xn = n .
(ii) (xn )∞ 1
Let (xn )∞
n=0 be a sequence in R. We say that (xn )n=0 converges (or is convergent)
∞
A priori it is not clear that a convergent sequence has only one limit. The following lemma
shows that the limit is indeed unique, so the notation (2.9) is justified.
Example 2.81. — A constant sequence (xn )∞ n=0 with xn = A ∈ R for all n converges to
A. Similarly, an eventually constant sequence converges to the value it eventually takes.
∞
Example 2.82. — The sequence n1 n=1 converges to 0, i.e., limn→∞ n1 = 0. Indeed, given
ε > 0, by Archimedes’ principle (Theorem 2.58) there exists N ∈ N with N1 < ε. Then, for all
n ≥ N , we have n1 − 0 = n1 ≤ N1 < ε.
8
Example 2.83. — The sequence (xn )∞ n=0 defined by xn = (−1) is not convergent, since
n
its terms alternate between 1 and −1 and do not approach any real number.
x0 , x1 , x4 , x9 , x16 , x25 , . . .
Let (xn )∞
n=0 be a sequence. A subsequence is a sequence of the form (xnk )k=0 , where
∞
k=0 is a strictly increasing sequence of nonnegative integers, i.e. nk+1 > nk for all
(nk )∞
k ∈ N.
Remark 2.85. — Since nk+1 > nk for all k ∈ N, it follows by induction that nk ≥ k for
every k ∈ N.
Let (xn )∞ ∞
n=0 be a sequence converging to A ∈ R. Then every subsequence (xnk )k=0 also
converges to A.
(x2n )∞
n=0 and (x2n+1 )∞
n=0
if for every ε > 0 and every N ∈ N there exists n ≥ N such that |xn − A| < ε.
Let (xn )∞ ∞
n=0 be a sequence in R. A point A ∈ R is an accumulation point of (xn )n=0 if
and only if there exists a convergent subsequence of (xn )∞
n=0 with limit A.
so limk→∞ xnk = A.
Conversely, assume that there exists a subsequence (xnk )∞
k=0 converging to A. Fix ε > 0
and N ∈ N. Since limk→∞ xnk = A, there exists N0 such that |xnk − A| < ε for all k ≥ N0 .
Hence, if we choose k = max{N0 , N }, because nk ≥ k (recall Remark 2.85) we have nk ≥ N
and |xnk − A| < ε. Thus A is an accumulation point.
A convergent sequence has exactly one accumulation point, namely its limit.
Example 2.91. — The sequence (xn )∞ n=0 , defined by xn = (−1) , has two accumulation
n
points: 1 and −1. Indeed, the subsequence (x2n )∞n=0 is constantly equal to 1, hence it converges
to 1, while the subsequence (x2n+1 )n=0 is constantly equal to −1, and therefore converges to
∞
−1.
Exercise 2.92. — Let (xn )∞ n=0 be a sequence in R, and let E ⊆ R be the set of its
Exercise 2.93. — Construct a sequence (xn )∞ n=0 in R whose set of accumulation points is
the entire interval [0, 1].
Hint: Enumerate the rational numbers in [0, 1].
tiplication, and study how these operations affect their limits. Moreover, one can compare
sequences using inequalities and relate these inequalities to the corresponding limits.
Proof. We only prove (1) and (4), leaving (2) and (3) as exercises for the reader. To prove
(2), see Exercise 2.101 below.
(1) Fix ε > 0. Because limn→∞ xn = A and limn→∞ yn = B, there exist NA , NB ∈ N such
that
|xn − A| < 2ε ∀ n ≥ NA , |yn − B| < 2ε ∀ n ≥ NB .
ε ε
|(xn + yn ) − (A + B)| ≤ |xn − A| + |yn − B| < 2 + 2 = ε.
|A|
(4) Since A ̸= 0, we can apply the definition of limit with ε = 2 to find N0 ∈ N such that
for all n ≥ N0 ,
|A|
|xn − A| < .
2
Using the reverse triangle inequality (Lemma 2.19(h)), this gives
|A|
|xn | ≥ |A| − |xn − A| > ∀ n ≥ N0 ,
2
so
1 2
< ∀ n ≥ N0 .
|xn | |A|
9 Hence, we have proved that
xn − A |xn − A| 2
x−1
n −A
−1
= = < |xn − A| ∀ n ≥ N0 .
xn A |xn | |A| |A|2
|A|2
|xn − A| < ε ∀ n ≥ N1 .
2
2
x−1
n −A
−1
< |xn − A| < ε ∀ n ≥ N.
|A|2
Let (xn )∞ ∞
n=0 and (yn )n=0 be sequences converging to A, B ∈ R, respectively.
Proof. We first prove (1). Let ε = 13 (B − A) > 0, so that A + ε < B − ε. We know that there
exist NA , NB ∈ N such that
proving (1).
For (2), suppose by contradiction that A > B. Then (1) implies the existence of N0 such
that xn > yn for all n ≥ N0 , contradicting the assumption xn ≤ yn for large n.
Remark 2.96. — In Proposition 2.95(2), even if xn < yn for all n, one cannot conclude
A < B. For instance, take
xn = − n1 , yn = n1 .
9 Then xn < yn for all n, but both sequences converge to 0.
xn ≤ yn ≤ zn ∀ n ≥ N.
7n4 + 15 n2 + 5 n5 − 10
lim , lim , lim .
n→∞ 3n4 + n3 + n − 1 n→∞ n3 + n + 1 n→∞ n2 + 1
A sequence (xn )∞
n=0 in R is called bounded if there exists a real number M ≥ 0 such
that
|xn | ≤ M ∀ n ∈ N.
Proof. Let (xn )∞n=0 be a convergent sequence with limit A ∈ R. Choosing ε = 1 in the
definition of limit, there exists N ∈ N such that |xn − A| ≤ 1 for all n ≥ N . By the triangle
inequality (see Lemma 2.19(g)),
Since (xn )∞
n=0 converges, Lemma 2.100 guarantees that |xn | ≤ M for some M ∈ R. Use this
to conclude.
We will see later that every bounded sequence has at least one accumulation point, or
equivalently, a convergent subsequence. Before that, we introduce the notion of monotonicity,
which will allow us to identify a large class of automatically convergent sequences.
A sequence (xn )∞
n=0 is called:
• (xn )∞
n=0 is increasing if xn+1 ≥ xn for all n;
• (xn )∞
n=0 is strictly increasing if xn+1 > xn for all n;
• (xn )∞
n=0 is decreasing if xn+1 ≤ xn for all n;
10 • (xn )∞
n=0 is strictly decreasing if xn+1 < xn for all n.
Monotone bounded sequences are always convergent. This is proved in the next theorem
and illustrated in Figure 2.11.
xn → S
x0 x1 x2 x3 x4
S M
Figure 2.11: A monotonically increasing sequence (xn )∞n=0 represented along a single axis.
Each term xn is shown as a vertical segment; the sequence moves rightward, approaching the
supremum S without ever reaching the upper bound M . The limit of the sequence equals S.
If (xn )∞
n=0 is increasing, then lim xn = sup(X);
n→∞
If (xn )∞
n=0 is decreasing, then lim xn = inf(X).
n→∞
Proof. If (xn )∞
n=0 converges, Lemma 2.100 shows that it is bounded.
Conversely, let (xn )∞ n=0 be a bounded monotone sequence. Without loss of generality,
assume it is increasing (otherwise consider (−xn )∞ n=0 ). Since (xn )n=0 is bounded from above,
∞
Then, for all n ≥ N , using (ii) and monotonicity we deduce that xn ≥ xN > A−ε. Combining
this with (i), we conclude that
proving limn→∞ xn = A.
Remark 2.105. — If (xn )∞ n=0 is monotone and admits a bounded subsequence (xnk )k=0 ,
∞
then the whole sequence is bounded and, therefore, convergent by Theorem 2.104.
Indeed, assume for instance that (xn )∞
n=0 is increasing and (xnk )k=0 is bounded above by
∞
so (xn )∞
n=0 is bounded. The case of a decreasing sequence is analogous.
Exercise 2.107. — Let (xn )∞ n=0 be monotonically increasing and (yn )n=0 monotonically
∞
decreasing, with xn ≤ yn for all n ∈ N. Show that both sequences converge and that
lim xn ≤ lim yn .
n→∞ n→∞
The concept of limit can be restated in terms of these tails: the sequence (xn )∞
n=0 converges
to A if and only if, for every ε > 0, there exists N ∈ N such that
X≥N ⊂ (A − ε, A + ε).
However, since not every sequence has a limit, we now introduce a related notion (the superior
and inferior limits), which always exist for bounded sequences.
For each n ∈ N, define
Thus, (sn )∞
n=0 is a monotonically decreasing sequence, while (in )n=0 is monotonically increas-
∞
ing. Moreover, since (xn )∞ n=0 is bounded, both (sn )n=0 and (in )n=0 are bounded as well.
∞ ∞
Hence, by Theorem 2.104, both sequences converge. Their limits will be called the superior
limit and the inferior limit of (xn )∞
n=0 , respectively.
That is, the index range “k ≥ n” indicates that we are taking the supremum or infimum over
all terms of the sequence with index greater than or equal to n. With this notation,
sn = sup xk , in = inf xk .
k≥n k≥n
Example 2.110. — Let (xn )∞ n=1 be defined by xn = (−1) + n . We compute the corre-
n 1
n 1 2 3 4 5 6 7 8 ...
3
xn 0 2 − 23 5
4... − 45 7
6 − 67 9
8
3 3 5 5 7 7 9 9
sn 2 2 4 4... 6 6 8 8
in −1 −1 −1 −1 −1 −1 −1 −1 . . .
Instead, since xn ≥ −1 and limn→∞ x2n+1 = −1, we get in = −1 for all n ≥ 1, therefore
lim inf n→∞ xn = −1.
in s5 s3 s1
−1 0 1
x5 x3 x1 x6 x4 x2
Figure 2.12: Representation of the sequence xn = (−1)n + n1 . Green bars below the axis show
the first few values of xn : even indices approach 1, odd indices approach −1. Blue bars above
the axis illustrate the superior bounds sn = supk≥n xk : here s1 (= s2 ), s3 (= s4 ), and s5 (= s6 )
are labeled, while the unlabeled bars suggest the continued decrease toward 1. The red bar
at −1 marks in = inf k≥n xk = −1 for all n.
in = inf xk , sn = sup xk ,
k≥n k≥n
and set
I = lim in = lim inf xn , S = lim sn = lim sup xn .
n→∞ n→∞ n→∞ n→∞
First, suppose that I = S. Since in ≤ xn ≤ sn (see (2.10)), the Sandwich Lemma 2.97
implies that the sequence (xn )∞
n=0 converges, and its limit equals I = S.
A − ε ≤ in ≤ sn ≤ A + ε.
A − ε ≤ I ≤ S ≤ A + ε.
A = lim sup xn .
n→∞
This construction shows that for any ε > 0 and any N ∈ N, there exists n1 ≥ N such that
A − ε < xn1 < A + ε. Thus A is an accumulation point of (xn )∞
n=0 .
We now prove (1) and (2). From (2.11) we have xn < A + ε for all n ≥ N0 , so only finitely
many terms satisfy xn ≥ A + ε. This shows (1).
Also, since A is an accumulation point, it follows from Corollary 2.89 that infinitely many
terms of the sequence lie within any interval (A − ε, A + ε).
Every bounded sequence has at least one accumulation point and therefore possesses a
convergent subsequence.
10 A = lim sup xn
n→∞
is always an accumulation point of (xn )∞ n=0 . Moreover, by Proposition 2.88, every accumula-
tion point is the limit of a convergent subsequence. Hence every bounded sequence admits at
least one convergent subsequence.
Exercise 2.114. — Let (xn )∞ n=0 be a bounded sequence in R, and let E ⊆ R be the set of
accumulation points of (xn )n=0 . Show that
∞
Exercise 2.115. — Let (an )∞ n=0 , (bn )n=0 , (cn )n=0 be convergent sequences with limits
∞ ∞
an , if n = 3k, k ∈ N,
xn = bn , if n = 3k + 1, k ∈ N,
cn , if n = 3k + 2, k ∈ N.
Compute lim sup xn , lim inf xn , and describe the set of accumulation points of (xn )∞
n=0 .
n→∞ n→∞
to 0. Set
10 A = lim inf xn , B = lim sup xn .
n→∞ n→∞
A sequence (xn )∞
n=0 in R is called a Cauchy sequence if for every ε > 0 there exists
N ∈ N such that
|xn − xm | < ε ∀ m, n ≥ N.
|xn − xN | ≤ 1 ∀ n ≥ N.
A sequence (xn )∞
n=0 of real numbers converges if and only if it is a Cauchy sequence.
ε
|xn − A| < 2 ∀ n ≥ N.
ε ε
|xn − xm | ≤ |xn − A| + |xm − A| < 2 + 2 = ε,
hence (xn )∞
n=0 is a Cauchy sequence.
ε
|xn − xm | < 2 ∀ m, n ≥ N0 ,
ε
|xnk − A| < 2 ∀ k ≥ N1 .
ε ε
|xn − A| ≤ |xn − xnN | + |xnN − A| < 2 + 2 = ε.
11
Thus (xn )∞
n=0 converges to A.
which is equivalent to saying that limn→∞ |xn+1 − xn | = 0. We note that this condition is not
equivalent to convergence. Indeed, consider the sequence
0, 1, 1 + 21 , 2, 2 + 31 , 2 + 32 , 3, 3 + 14 , 3 + 42 , 3 + 34 , 4, 4 + 51 , 4 + 25 , 4 + 35 , 4 + 45 , 5, 5 + 16 , . . .
which progresses between consecutive integers n − 1 and n in steps of size n1 . This sequence
is unbounded and hence not convergent, but the distances between successive elements tend
to zero. Therefore, the condition limn→∞ |xn+1 − xn | = 0 is insufficient for convergence.
lim xn = +∞,
n→∞
if for every M > 0 there exists N ∈ N such that xn > M for all n ≥ N .
Similarly, (xn )∞
n=0 diverges to −∞ if for every M > 0 there exists N ∈ N such that
xn < −M for all n ≥ N .
In both cases, we say that (xn )∞
n=0 has an improper limit.
An unbounded sequence need not diverge to +∞ or −∞. For instance, the sequence
Exercise 2.123. — Let (xn )∞ n=0 be an unbounded sequence of real numbers. Show that
there exists a subsequence which diverges either to +∞ or to −∞.
11 The notion of improper limit allows us to extend the definitions of superior and inferior
limits to unbounded sequences. If (xn )∞
n=0 is not bounded from above, then
sup xk = +∞ ∀ n ∈ N,
k≥n
and we write
lim sup xn = +∞.
n→∞
If (xn )∞
n=0 is bounded from above but not from below, then we define
lim sup xn = lim sup xk ,
n→∞ n→∞ k≥n
where the right-hand side is a real limit if the decreasing sequence supk≥n xk is bounded, and
the improper limit −∞ otherwise. The definition of lim inf extends analogously.
Exercise 2.124. — (Prove the sandwich principle for improper limits.) Let (xn )∞
n=0 and
(yn )n=0 be two sequences with xn ≤ yn for all n ∈ N. Show that:
∞
z0 , z1 , z2 , . . .
where each element zn belongs to C. As in the real case, we are mainly interested in their
convergence, divergence, and limit behavior.
To analyze sequences in C, it is often sufficient to consider separately the corresponding
sequences of real and imaginary parts in R.
zn = xn + iyn ,
11 lim zn = A + iB.
n→∞
Remark 2.126. — As for sequences of real numbers, one can consider subsequences of
sequences in C. Given a strictly increasing sequence of nonnegative integers (nk )∞
k=0 , the
corresponding subsequence is
(znk )∞ ∞
k=0 = (xnk + iynk )k=0 .
Exercise 2.127. — Let (zn )∞ n=0 be a convergent sequence in C. Show that the sequence
of moduli (|zn |)n=0 converges, and determine its limit. Conversely, does the convergence of
∞
Determine the set of all complex numbers z for which the sequence (z n )∞
n=0 converges.
Remark 2.129. — Most of the properties of convergent sequences in R remain valid for
11
complex sequences. In particular, limits in C are unique, and all standard limit rules (linearity,
product, quotient, etc.) hold. Each statement can be proved by applying the corresponding
property separately to the real and imaginary parts.
In this chapter we study real-valued functions defined on subsets of R, typically intervals. The
central concept is continuity.
F(D) = {f | f : D → R} .
(f1 + f2 )(x) = f1 (x) + f2 (x), (αf1 )(x) = α f1 (x), (f1 f2 )(x) = f1 (x)f2 (x).
11
Given a ∈ R, we write f ≡ a for the constant function x 7→ a on D.
Remark 3.1. — With the operations above, F(D) is a commutative ring (the additive
identity is f ≡ 0 and the multiplicative identity is f ≡ 1).
f1 ≤ f2 ⇐⇒ f1 (x) ≤ f2 (x) ∀ x ∈ D,
76
Chapter 3.1 Real-valued Functions
Exercise 3.3. — Verify that the relation ≤ defined above on F(D) is an order relation.
We say that f is bounded from below if there exists M > 0 such that
f (x) ≥ −M ∀ x ∈ D.
We say that f is bounded if it is both bounded from above and from below. Equiva-
lently, f is bounded if there exists M > 0 such that
|f (x)| ≤ M ∀ x ∈ D.
• For any D ⊆ R and any odd integer n ≥ 1, the map x 7→ xn on D is strictly increasing.
• The rounding function ⌊·⌋ : R → R (see Definition 2.59) is increasing but not strictly
increasing.
−1
11
Figure 3.1: A strictly monotone function is always injective but need not be surjective. For
example, f : R → R, f (x) = 18 x + sgn(x), is strictly increasing but not surjective (e.g. 12 is
not in the image).
Exercise 3.7. — Let D ⊆ R, and let f1 , f2 ∈ F(D) be strictly increasing. Show that:
(ii) for a ∈ R, the function af1 is strictly increasing if a > 0, and strictly decreasing if a < 0;
3.1.2 Continuity
Remark 3.9. — It suffices to verify the implication above for small ε. Precisely:
Assume there exists ε0 > 0 such that for every ε ∈ (0, ε0 ] there is a δ > 0 with
Then f is continuous at x0 .
Indeed, for ε > ε0 we can choose the number δ > 0 corresponding to ε0 to get
The next figure shows a continuous function on D = [a, b) ∪ (c, d] ∪ {e}. For every x0 ∈ D
and every ε > 0, there exists δ > 0 such that all x ∈ D with |x−x0 | < δ satisfy |f (x)−f (x0 )| <
ε.
f
f (x0 ) + ε
f (x0 )
f (x0 ) − ε
a x0 − δ x0 x0 + δ b c d e
• The absolute value f (x) = |x| is continuous. Indeed, give ε > 0 simply choose δ = ε.
Then |x − x0 | < δ implies |f (x) − f (x0 )| = ||x| − |x0 || ≤ |x − x0 | < ε by inverse triangle
inequality.
• The rounding function f (x) = ⌊x⌋ is not continuous at integers. Indeed, if x0 ∈ Z, then
for any small δ > 0,
⌊x0 − 2δ ⌋ − ⌊x0 ⌋ = 1,
f (x) = ⌊x⌋
f (x) = |x| 1
Figure 3.3: The absolute value function (left) and the floor function (right).
√
Exercise 3.11. — Show that f : R → R, f (x) = x2 , and g : [0, ∞) → R, g(x) = x, are
both continuous.
Restriction
Let D ⊆ R and f : D → R. For any D′ ⊆ D the restriction of f to D′ is the function
f |D′ : D′ → R defined by
Proof. We first prove the result for the sum. Let ε > 0. Since f1 and f2 are continuous at x0 ,
there exist δ1 , δ2 > 0 such that
12
|x − x0 | < δ1 ⇒ |f1 (x) − f1 (x0 )| < 2ε , |x − x0 | < δ2 ⇒ |f2 (x) − f2 (x0 )| < 2ε .
|(f1 + f2 )(x) − (f1 + f2 )(x0 )| ≤ |f1 (x) − f1 (x0 )| + |f2 (x) − f2 (x0 )| < ε,
|f1 (x)f2 (x) − f1 (x0 )f2 (x0 )| = |f1 (x)f2 (x) − f1 (x0 )f2 (x) + f1 (x0 )f2 (x) − f1 (x0 )f2 (x0 )|
≤ |f1 (x)f2 (x) − f1 (x0 )f2 (x)| + |f1 (x0 )f2 (x) − f1 (x0 )f2 (x0 )|
= |f2 (x)| |f1 (x) − f1 (x0 )| + |f1 (x0 )| |f2 (x) − f2 (x0 )|.
Now, first choose δ0 > 0 so that |x − x0 | < δ0 implies |f2 (x) − f2 (x0 )| < 1, so that
ε
|x − x0 | < δ1 ⇒ |f1 (x) − f1 (x0 )| < ,
2(1 + |f2 (x0 )|)
ε
|x − x0 | < δ2 ⇒ |f2 (x) − f2 (x0 )| < .
2(1 + |f1 (x0 )|)
So, choosing δ = min{δ0 , δ1 , δ2 }, for |x − x0 | < δ we get
ε ε
|f1 (x)f2 (x) − f1 (x0 )f2 (x0 )| < |f2 (x)| + |f1 (x0 )|
2(1 + |f2 (x0 )|) 2(1 + |f1 (x0 )|)
ε ε
< (1 + |f2 (x0 )|) + |f1 (x0 )|
2(1 + |f2 (x0 )|) 2(1 + |f1 (x0 )|)
ε ε
< + = ε,
2 2
thus f1 f2 is continuous at x0 .
Finally, the statement about af1 follows by choosing f2 ≡ a (a constant function) and
using the product case proved above: since f1 and f2 are continuous at x0 , their product
f1 f2 = af1 is continuous at x0 .
Composition of Functions
Let f : X → Y and g : Y → Z. The composition is g ◦ f : X → Z, defined by
(g ◦ f )(x) = g(f (x)) for all x ∈ X.
Associativity. If f : W → X, g : X → Y , and h : Y → Z, then
h ◦ (g ◦ f ) = (h ◦ g) ◦ f.
Proof. Let ε > 0. By continuity of g at f (x0 ), there exists η > 0 such that
12
∀ y ∈ D2 , |y − f (x0 )| < η ⇒ |g(y) − g(f (x0 ))| < ε.
|x − x0 | < δ =⇒ |f (x) − f (x0 )| < η =⇒ |g(f (x)) − g(f (x0 ))| < ε.
Remark 3.16. — Applying Proposition 3.15 with g(y) = |y| (see Example 3.10), we see
that if f : D → R is continuous then x 7→ |f (x)| is continuous.
Exercise 3.18. — Let a < b < c and let f1 : [a, b] → R, f2 : [b, c] → R be continuous.
Define f : [a, c] → R by
f (x), x ∈ [a, b),
1
f (x) =
f (x), x ∈ [b, c].
2
Let (xn )∞
n=0 ⊆ R and x̄ ∈ R. We write
xn → x̄ or xn −−−→ x̄
n→∞
to mean
lim xn = x̄.
n→∞
Proof. Assume that f is continuous at x̄. Then, given ε > 0, there exists δ > 0 such that
Thus
n ≥ N =⇒ |f (xn ) − f (x̄)| < ε,
To prove the converse, assume that f is not continuous at x̄. This means that there exists
ε > 0 such that, for every δ > 0, there is x ∈ D with
12
Now, for every n ∈ N, we apply this property with δ = 2−n to find a point xn ∈ D such that
Then the sequence constructed in this way satisfies xn → x̄ but f (xn ) ̸→ f (x̄).
f (b)
(x̄, c)
y=c
f (a)
x
a x̄ b
Figure 3.4: A continuous function f : [a, b] → R must cross every horizontal line between f (a)
13 and f (b).
X = {x ∈ [a, b] | f (x) ≤ c} .
Since a ∈ X and X ⊆ [a, b], the set X is nonempty and bounded from above. By Theorem 2.55,
its supremum
x̄ = sup(X) ∈ [a, b]
(x̄ − δ, x̄ + δ) ∩ [a, b] ⊂ X.
y ∈ (x̄, x̄ + δ) ∩ [a, b] ⊂ X.
Then y ∈ X and y > x̄, which contradicts the defining property of the supremum: x̄ is an
upper bound of X, so X cannot contain elements larger than x̄. This contradiction shows
13 that f (x̄) ≥ c.
Together with f (x̄) ≤ c proved above, we conclude f (x̄) = c, as desired.
Remark 3.25. — If f : [a, b] → R is continuous with f (a) ≥ f (b), the theorem still holds
in the following form:
For every real number c with f (a) ≥ c ≥ f (b) there exists x̄ ∈ [a, b] such that f (x̄) = c.
The function g is called the inverse function (or inverse mapping) of f , and is
denoted by f −1 .
In this subsection we show that every continuous strictly monotone function has an inverse
function that is also continuous.
13 y
y=x
(x, f (x))
(f (x), x)
f −1
x
f
Figure 3.5: The graphs of a strictly increasing function f and its inverse f −1 are reflections
across the line y = x. The points (x, f (x)) and (f (x), x) are mirror images.
Proof. We may assume that I is non-empty and not a single point. Also, without loss of
generality, suppose f is strictly increasing (otherwise replace f with −f ).
Let J = f (I). Since f is strictly monotone, it is injective. Also, since by definition J =
f (I), it is surjective, hence bijective. Therefore there exists a unique inverse g = f −1 : J → I.
[y1 , y2 ] ⊂ f ([x1 , x2 ]) ⊂ J.
Since y1 < y2 were two arbitrary points in J, this proves that J is an interval.
It remains to show that g = f −1 is continuous. Fix ȳ ∈ J, and suppose by contradiction
that g is not continuous at ȳ. Then, by Remark 3.22, there exist ε > 0 and a sequence
n=0 ⊂ J such that
(yn )∞
either xn ≤ x̄ − ε or xn ≥ x̄ + ε.
In particular, at least one of these cases must occur infinitely often. Without loss of generality,
assume xn ≤ x̄ − ε for infinitely many n, and extract a subsequence (xnk )∞ k=0 with xnk ≤ x̄ − ε
for all k. Since I is an interval, x̄ − ε ∈ I, and by strict monotonicity of f we obtain
Taking the limit and using Proposition 2.95 gives (recall that yn → ȳ, see (3.2))
13
(x, f (x))
(f (x), x)
√
f −1 (x) = x
x
f (x) = x2
√
Figure 3.6: The function f (x) = x2 and its inverse f −1 (x) = x are reflections of each other
across the line y = x.
Proof. Assume by contradiction that f is unbounded. Then, for every n ∈ N, there exists
xn ∈ [a, b] such that |f (xn )| ≥ n. By Lemma 3.30, there is a subsequence (xnk )∞ k=0 converging
to some x̄ ∈ [a, b].
Since f is continuous, so is |f | (recall Remark 3.16), therefore |f (xnk )| → |f (x̄)| ∈ R. This
contradicts |f (xnk )| ≥ nk → ∞, so f must be bounded.
• We say that f takes its maximum value at x0 ∈ D if f (x) ≤ f (x0 ) for all x ∈ D.
Then f (x0 ) is the maximum of f .
• We say that f takes its minimum value at x0 ∈ D if f (x) ≥ f (x0 ) for all x ∈ D.
Then f (x0 ) is the minimum of f .
Proof. Theorem 3.31 guarantees that f is bounded, or equivalently, that f ([a, b]) ⊂ R is a
bounded subset of R. Thus, Theorem 2.55 implies that
exists. By definition of the supremum, for each n ∈ N there exists yn ∈ f ([a, b]) such that
S − 2−n ≤ yn ≤ S. Hence yn → S. Also, since yn ∈ f ([a, b]), there exists xn ∈ [a, b] such that
14 f (xn ) = yn .
Now, by Lemma 3.30, we can find subsequence (xnk )∞ k=0 such that xnk → x̄ ∈ [a, b]. By
continuity of f ,
f (x̄) = lim f (xnk ) = lim ynk = S,
k→∞ k→∞
Exercise 3.35. — Does every continuous function f on the open interval (0, 1) attain its
maximum?
Remark 3.37. — The difference between the usual definition of continuity and the one of
uniform continuity lies in how the choice of δ depends on the points considered.
For a function that is continuous at each x0 ∈ D, the δ in the definition may depend on
both ε and x0 : for every ε > 0 and each x0 , we can find a δ = δ(ε, x0 ) that works near x0 .
Uniform continuity is stronger: there exists a single δ = δ(ε) that works simultaneously
for all x, y ∈ D. In other words, the control on the variation of f does not deteriorate as
we move along the domain. This property is automatically satisfied on compact intervals for
continuous functions, as we will prove below.
Set
1 δ
yδ = , xδ = yδ + .
δ 2
Then |xδ − yδ | = δ
2 < δ, and
2
δ2
1 δ 1
|f (xδ ) − f (yδ )| = x2δ − yδ2 = + − = 1 + ≥ 1.
δ 2 δ2 4
Proof. Assume, by contradiction, that f is not uniformly continuous on [a, b]. Then there
exists ε > 0 such that for every δ > 0 one can find x, y ∈ [a, b] with
|ynk − x̄| ≤ |ynk − xnk | + |xnk − x̄| < 2−nk + |xnk − x̄| −−−→ 0,
k→∞
therefore
|f (xnk ) − f (ynk )| ≤ |f (xnk ) − f (x̄)| + |f (x̄) − f (ynk )| −−−→ 0,
k→∞
Exercise 3.40. — Does Theorem 3.39 remain true for continuous functions on the open
interval (0, 1)?
Give examples of Lipschitz continuous functions, and show that any such function is
uniformly continuous.
√
2. Let f (x) = x on R≥0 . Show that:
(1 + a)n ≥ 1 + na.
14 Remark 3.43. — Using Bernoulli’s inequality and Archimedes’ principle one can prove the
following statement: For all x > 1 and all y ∈ R, there exists n ∈ N such that xn ≥ y.
Indeed, assume y > 0 (otherwise the inequality xn ≥ y is true for every n ∈ N) and apply
Bernoulli’s inequality with a = x − 1 > 0 to obtain (1 + a)n ≥ 1 + na ≥ na. Choosing n ≥ ay
(using Archimedes’ principle), it follows that xn ≥ y.
x x+n 1
≤ = ≤ 1,
(n + 1)(n + x) (n + 1)(n + x) n+1
or equivalently
x
− ≥ −1 ∀ n ≥ n0 .
(n + 1)(n + x)
Hence, by Bernoulli’s inequality (Lemma 3.42) applied with a = − (n+1)(n+x)
x
and n + 1 in
place of n, we get
n+1
an+1 n+x x n+x x
= 1− ≥ 1 − (n + 1)
an n (n + 1)(n + x) n (n + 1)(n + x)
n+x x
= 1− = 1,
n n+x
x
0<1+ ≤ 1,
n
so x n
0< 1+ ≤ 1.
n
Hence (an )∞n=n0 is an increasing sequence bounded above by 1, and therefore convergent. In
particular, x n x n
lim 1 + = sup 1 + > 0.
n→∞ n n≥n0 n
so −n
x n
x −n (−x)
1≤ 1+ ≤ 1− = 1+ .
n n n
n
(−x)
In other words, if we define bn = 1 + n , then
1
1 ≤ an ≤ ∀ n > x. (3.4)
bn
14
Since
bn converges to a positive limit by Case 1, Proposition 2.94(4) implies that the sequence
1
bn also converges, and therefore it is bounded (Lemma 2.100). Recalling (3.4), we
n>x
conclude that the increasing sequence (an )∞
n=1 is also bounded, and therefore convergent.
e = 2.71828 18284 59045 23536 02874 71352 66249 77572 47093 69995 . . .
15
A useful consequence of Lemma 3.45 is the following bound.
an ≤ an+1 ≤ · · · ≤ exp(x).
exp(0) = 1, (3.6)
exp(−x) = exp(x)−1 , (3.7)
exp(x + y) = exp(x) exp(y), (3.8)
for all x, y ∈ R.
x2 x 2 n
1− ≤ 1− 2 ≤1 ∀ n ≥ |x|.
n n
where
x+y
cn = −(x2 + y 2 ) − xy + xy .
n
x+y
For n ≥ |x| + |y| we have n ≤ 1, hence
x+y
−2|xy| ≤ −xy + xy ≤ 2|xy|.
n
−2(x2 + y 2 ) ≤ cn ≤ 0,
2 2) 2 2)
and in particular ncn2 ≥ − 2(x n+y
2 ≥ − 2(x n+y ≥ −1 for all sufficiently large n. There-
fore, by Bernoulli’s inequality,
x2 + y 2 cn cn n
1−2 ≤1+ ≤ 1+ 2 ≤1 for n large,
n n n
exp(x + y) x n y n x + y n cn n
= lim 1 − 1− 1+ = lim 1 + 2 = 1,
exp(x) exp(y) n→∞ n n n n→∞ n
exp(x) ≥ 1 + x ∀ x ∈ R, (3.9)
15
which follows from Corollary 3.47 for x > −1, and is trivial for x ≤ −1 (since exp(x) > 0).
Using (3.7) together with (3.9) we obtain
1 1
exp(x) = ≤ ∀ x < 1. (3.10)
exp(−x) 1−x
Indeed, the right inequality x < exp(x) follows from (3.9). For the left inequality, apply (3.9)
with y = x1 > 0:
1 1 1 1 1 −1 1 −1
exp ≥1+ > =⇒ exp − = exp < = x.
x x x x x x
1 1 δ
| exp(x) − exp(0)| = exp(x) − 1 ≤ −1< −1= .
1−x 1−δ 1−δ
(ii) If x ∈ (−δ, 0] we now have exp(x) < exp(0) = 1 (again by the monotonicity of exp),
so it follows from (3.9) that
δ
| exp(x) − exp(0)| = 1 − exp(x) ≤ 1 − (1 + x) = −x < δ ≤ .
1−δ
δ
x ∈ (−δ, δ) =⇒ | exp(x) − 1| < = ε,
1−δ
3. Bijectivity. First of all, strict monotonicity implies injectivity. For surjectivity, fix a > 0
and set x0 = −a−1 and x1 = a. Then, thanks to (3.11),
Hence, by the continuity of exp and the Intermediate Value Theorem 3.24 applied on
[x0 , x1 ], there exists x ∈ [x0 , x1 ] with exp(x) = a. This shows surjectivity and concludes
the proof.
log(1) = 0, (3.12)
log(a−1 ) = − log(a), (3.13)
log(ab) = log(a) + log(b), (3.14)
Proof. This follows directly from Theorem 3.48 and the Inverse Function Theorem 3.28. Equa-
tions (3.12), (3.13), and (3.14) follow from the corresponding properties of the exponential,
choosing x = log a and y = log b.
15
log(x)
exp(x) 1
Figure 3.7: Graphs of the exponential function and the logarithm. The auxiliary dashed lines
show that exp(x) ≥ x + 1 and log(x) ≤ x − 1.
The logarithm defined here is also called the natural logarithm to distinguish it from
logarithms with another base a > 1 (for instance a = 10 or a = 2). For any a > 1, we define
log x
loga (x) = ∀ x > 0.
log a
For example, log10 (10n ) = n for all n ∈ Z. Unless stated otherwise, log(x) always denotes the
natural logarithm, i.e., the logarithm to base e.
We can now define powers with arbitrary real exponents. For a > 0 and x ∈ R we set
In particular, ex = exp(x log e) = exp(x) for all x ∈ R. Similarly, for x > 0 and a ∈ R,
√
x 10 x1
√
x 2
√
x1/ 2
x0
1
√
x− 2
15
1
Exercise 3.51. — Show that for x ∈ Q and a > 0, this definition agrees with the one for
rational powers from Example 3.29. Verify also the rules
Exercise 3.52. — Let a > 0. Show that there exists a constant Ca > 0 such that
log(x) ≤ Ca xa for all x > 0.
√
Exercise 3.53. — Given a ∈ R, consider the sequence (xn )∞
n=1 given by xn =
n
na . Show
that this sequence converges, with
√
lim n na = 1.
n→∞
D ∩ (x0 − δ, x0 + δ) ̸= ∅ (3.16)
for all δ > 0. Whenever this holds, we say that x0 is an accumulation point of D. Note
that if x0 ∈ D, then (3.16) is automatically satisfied.
Condition (3.16) ensures that there exists a sequence of points in D converging to x0 .
15 In general, the limit of f (x) as x → x0 may not exist. However, if it exists, it is uniquely
determined. Hence, we speak of the limit and write
lim f (x) = L
x→x0
to indicate that the limit exists and is equal to L. Informally, this means that the function
values f (x) are arbitrarily close to L whenever x ∈ D is sufficiently close to x0 .
The limit of a function satisfies properties analogous to those of Proposition 2.94. More
precisely:
If f and g are functions on D such that
then
lim (f + g)(x) = L1 + L2 , lim (f g)(x) = L1 L2 .
x→x0 x→x0
nevertheless exists. In this case, the point x0 is called a removable discontinuity of f , and
one also writes
L = x→x
lim f (x). (3.18)
0
x̸=x0
If we now define
f (x), x ∈ D \ {x0 },
fe(x) = (3.19)
L,
x = x0 ,
Let f : D → R. Then L = limx→x̄ f (x) if and only if, for every sequence (xn )∞
n=0 ⊂ D
converging to x̄, one has limn→∞ f (xn ) = L.
We now state a result describing the behaviour of limits under composition with a contin-
uous function.
We now introduce conventions for improper limits of functions, in analogy with improper
limits for sequences.
∀ x ∈ D, |x − x0 | < δ =⇒ f (x) ≥ M.
D ∩ (x0 , x0 + δ) ̸= ∅ (3.20)
for every δ > 0. In this case, we say that x0 is a right-hand accumulation point of D.
Analogously, if
D ∩ (x0 − δ, x0 ) ̸= ∅ (3.21)
lim f (x) = +∞
x→x+
0
x ∈ D ∩ (x0 , x0 + δ) =⇒ f (x) ≥ M.
Similarly, limx→x+ f (x) = −∞ means: for every M > 0 there exists δ > 0 such that
0
We say that f diverges to +∞ as x → +∞ if, for every M > 0, there exists R > 0
such that
x ∈ D ∩ (R, ∞) =⇒ f (x) ≥ M.
Then
lim f (x) = lim g(x),
x→+∞ x→0+
16
x1 x2 x3
Figure 3.9: At x1 the discontinuity is removable (both one-sided limits exist and are equal,
but f (x1 ) differs). At x2 the function is continuous from the left but not from the right, and
x2 is a jump point. At x3 the function is continuous from the right; the left-hand limit does
not exist, hence x3 is not a jump point.
Example 3.64. — Let D = (0, ∞) and f (x) = xx = exp x log x . We want to compute
y 4
0 ≤ ye−y ≤ y 2
≤ −−−→ 0
1+ y y→∞
2
(ii) lim x log x = 0. For this, given ε > 0, choose R > 0 so that |ye−y | < ε for all y > R
x→0+
(this is possible thanks to point (i) above). Now, set δ = e−R and take x ∈ (0, δ). Then
(iii) lim xx = 1. Indeed, thanks to (ii) and the continuity of the exponential function, we
x→0+
can apply Proposition 3.59 to get
x3 − x 2 − x − 2 3e2x + ex + 1 ex log x
lim , lim , lim , lim .
x→2 x−2 x→∞ 2e2x − 1 x→∞ xa x→∞ xa
Specify a suitable domain D (so that the functions are well defined) in each case.
16 We introduce two standard notations that compare the asymptotic behaviour of a function to
that of another function (often called relative asymptotics). They are named after Edmund
Landau (1877–1938).
f (x) = O g(x) as x → x0
f (x)
f (x) = O g(x) as x → x0 is bounded near x0 .
⇐⇒
g(x)
f (x) = O g(x) as x → +∞
The big-O notation hides the precise bound by an implicit constant M , which is often
irrelevant for the argument that one is interested in.
Example 3.68. — • If f and g are bounded and continuous near x0 with g(x0 ) ̸= 0,
then f (x) = O g(x) as x → x0 .
• As x → 0, one has x2 = O(x), but x ̸= O(x2 ) (since x/x2 is unbounded near 0).
3x3 3x3
• As x → +∞, = O(1), but ̸= O(xα ) for α < 0.
x3 + 3 x3 + 3
16
As discussed above, the big-O means that f is bounded by a multiple of g. One may also
consider a stronger condition, namely that f is asymptotically negligible with respect to g.
This leads to the following definition.
f (x) = o g(x) as x → x0
f (x)
f (x) = o g(x) as x → x0
⇐⇒ lim = 0.
x→x0 g(x)
f (x) = o g(x) as x → +∞
3x3 3
= |x|1−α −→ 0 as x → 0,
|x|α (2x2 + x10 ) 2 + x8
16 whenever α < 1.
f (x) + o g(x) as x → x0
1. xp = o(x) as x → 0;
2. x = o(xp ) as x → ∞;
3. xa = o(ex ) as x → ∞;
4. log x = o(xb ) as x → ∞.
x3 − 7x2 + 6x + 2
1
=x−7+O = x − 7 + o(1) = x + O(1) = x + o(x).
x2 x
It may seem surprising that all four expressions are correct (and even useful) in different
contexts. Depending on the desired precision, one may use the more accurate form with error
term −7 + O x1 or the coarser estimate involving o(x).
• If f1 (x) = o(g1 (x)) and f2 (x) = o(g2 (x)) as x → x0 , then f1 (x)f2 (x) = o g1 (x)g2 (x) .
• If f1 (x) = o(g1 (x)) and f2 (x) = O(g2 (x)) as x → x0 , then f1 (x)f2 (x) = o g1 (x)g2 (x) .
• If f1 (x) = O(g1 (x)) and f2 (x) = O(g2 (x)) as x → x0 , then f1 (x)f2 (x) = O g1 (x)g2 (x) .
16
3x2
Example 3.76. — Let f (x) = x + x3 + 4x4 + x7 and g(x) = x + . As x → 0 we have
1+x
3x2
f (x) = x+o(x2 ) (since x3 , x4 , x7 = o(x2 )), g(x) = x+O(x2 ) (since 1+x = 3x2 +O(x3 )).
Hence
Therefore,
f (x)g(x) = x2 + O(x3 ).
As for sequences of real numbers, the starting index of a sequence of functions is not
essential and may differ from 0.
Exercise 3.79. — Show that the pointwise limit of a sequence of functions, if it exists, is
uniquely determined.
In the following example we show that, in general, continuity is not preserved under point-
wise convergence.
Figure 3.10: The sequence fn (x) = xn converges pointwise on [0, 1] to the function f (x) = 0
for x < 1 and f (1) = 1, which is not continuous at x = 1.
In this definition we first fix x ∈ D and ε > 0, and then find an index N that may depend
on both x and ε. In contrast, in the definition of uniform convergence below, we change the
order of quantifiers to ensure that N depends only on ε, and not on the particular choice of
x ∈ D.
This gives a useful geometric interpretation of uniform convergence: (fn ) converges uniformly
to f if, for every ε > 0, the graph of fn eventually lies entirely within the ε-tube around the
graph of f (see Figure 3.11).
Figure 3.11: Illustration of uniform convergence: for all sufficiently large n, the graph of fn
lies entirely within the ε-tube around the graph of f .
Proof. o prove that f is continuous, we fix x̄ ∈ D and show that f is continuous at x̄.
Given ε > 0, the uniform convergence of fN to f provides N ∈ N such that
|f (x) − f (x̄)| ≤ |f (x) − fN (x)| + |fN (x) − fN (x̄)| + |fN (x̄) − f (x̄)|
ε ε ε
< 3 + 3 + 3 = ε,
Remark 3.84. — Intuitively, uniform convergence allows us to exchange the order of taking
limits. More precisely, assume that (fn )∞
n=0 is a sequence of continuous functions converging
pointwise to f . Then, by the pointwise convergence and the continuity of the functions fn ,
we have
f (x̄) = lim fn (x̄), fn (x̄) = lim fn (x), f (x) = lim fn (x) for all x ∈ D.
n→∞ x→x̄ n→∞
Hence,
f (x̄) = lim fn (x̄) = lim lim fn (x) , lim f (x) = lim lim fn (x) .
n→∞ n→∞ x→x̄ x→x̄ x→x̄ n→∞
Note that the function f is continuous at x̄ if and only if f (x̄) = limx→x̄ f (x), which by the
identities above is equivalent to
lim lim fn (x) = lim lim fn (x) .
x→x̄ n→∞ n→∞ x→x̄
As we have seen, for pointwise convergence this interchange of limits may fail because f need
not be continuous. However, Theorem 3.83 ensures that this equality holds under uniform
convergence.
Exercise 3.88. — Let (fn )∞n=0 be a sequence of uniformly continuous real-valued functions
on D converging uniformly to f : D → R. Show that f is uniformly continuous.
We have seen that any bounded sequence of points (xn )∞ n=0 admits a convergent subsequence.
Is there an analogous result for sequences of continuous functions? The Ascoli-Arzelà Theorem
addresses this question. We first need some definitions.
Let (fn )∞
n=0 be a sequence of functions fn : D → R. We say that the sequence is
equibounded on D if there exists M > 0 such that
Also, the sequence is equicontinuous on D if for every ε > 0 there exists δ > 0 such
that
|x − y| < δ =⇒ |fn (x) − fn (y)| < ε for all x, y ∈ D, n ∈ N.
Exercise 3.92. — Following Example 3.80, show that the family {xn | n ∈ N} is not
equicontinuous on [0, 1].
Hint: Fix ε = 12 . Then, for any δ > 0, choose x = 1, y = 1 − 2δ , and take n large enough so
n
that 1 − 2δ < 21 .
Exercise 3.93. — Let g(x) = max{(1 − |x|), 0} and define fn (x) = g(x − n) on R. Show
that (fn )∞
n=0 is equibounded and equicontinuous on R, fn (x) → 0 for each fixed x, but no
subsequence converges uniformly on R. Conclude that compactness of the domain cannot be
dropped from Theorem 3.90.
In this chapter we study series (infinite sums). They provide a framework to define many
classical functions; in particular, we will use series to define the trigonometric functions.
We call an the n-th term (or n-th summand) of the series. If the limit exists, its
17
value A is the sum of the series.
If the limit does not exist, the series is said to be not convergent. In particular, if the
sequence of partial sums (sn )∞ n=0 diverges to +∞ (respectively, to −∞), we say that
the series diverges to +∞ (respectively, to −∞). This situation is therefore a specific
case of a series that does not converge.
Remark 4.2. — Unless otherwise specified, all series will consist of real numbers.
117
Chapter 4.1 Series of Real Numbers
Pn
Proof. By assumption the partial sums sn = k=0 ak satisfy sn → A ∈ R. Then, for n ≥ 1,
an = sn − sn−1 −−−→ A − A = 0.
n→∞
P∞
Example 4.4 (Geometric Series). — For q ∈ R, the geometric series n=0 q
n converges if
and only if |q| < 1, and in this case
∞
X 1
qk = .
1−q
k=0
Indeed, if the series converges, then by Proposition 4.3 we must have q n → 0, hence |q| < 1.
Conversely, for |q| < 1 one proves by induction that
n
X 1 − q n+1
sn = qk = ∀ n ∈ N, q ̸= 1.
1−q
k=0
1 − q n+1 1
sn = −−−→ .
1 − q n→∞ 1 − q
17
Example 4.5 (Harmonic Series). — The converse of Proposition 4.3 fails: the harmonic
series ∞k=1 k does not converge. To see this, consider n = 2 with ℓ ∈ N. Grouping terms
1 ℓ
P
gives
2ℓ
X 1 1 1 1 1 1 1 1
=1+ + + + + ··· + + · · · + ℓ−1 + ··· + ℓ
k 2 3 4 5 8 2 +1 2
k=1
1 1 1 1 1 1 1 1 1
≥1+ + + + + + + +··· + ℓ + ··· + ℓ
2 |4 {z 4} |8 8 {z 8 8} |2 {z 2}
= 12 = 12 = 12
1 1 ℓ
=1+ + ··· + = 1 + ,
2
| {z 2
} 2
ℓ times
which is unbounded as ℓ → ∞.
∞
X ∞
X ∞
X
(αak + βbk ) = α ak + β bk .
k=0 k=0 k=0
∞
X N
X −1 ∞
X
ak = ak + ak .
k=0 k=0 k=N
Remark 4.9. — If ∞ k=0 ak has nonnegative terms, then (sn )n=0 is bounded if and only if
∞
P
Let ∞
P P∞
k=0 ak and k=0 bk be series with 0 ≤ ak ≤ bk for all k ∈ N. Then
∞
X ∞
X
0≤ ak ≤ bk ,
k=0 k=0
and in particular
∞
X ∞
X
bk convergent =⇒ ak convergent,
k=0 k=0
∞
X ∞
X
ak divergent to + ∞ =⇒ bk divergent to + ∞.
k=0 k=0
These implications remain true if the inequalities 0 ≤ an ≤ bn hold only for all n ≥ N ,
for some N ∈ N.
Pn Pn
Proof. From ak ≤ bk we get k=0 ak ≤ k=0 bk for all n ∈ N. Therefore
∞
X n
X n
X ∞
X
ak = lim ak ≤ lim bk = bk .
n→∞ n→∞
k=0 k=0 k=0 k=0
P∞
Example 4.11. — The series 1
k=1 k2 is convergent. Indeed, for k ≥ 2,
1 1
ak = 2
≤ = bk ,
k k(k − 1)
and since 1
k(k−1) = 1
k−1 − k1 ,
n n
X X 1 1 1
bk = − = 1 − −−−→ 1.
k−1 k n n→∞
k=2 k=2
P∞ P∞ P∞
By the comparison test, 1
k=2 k2 ≤ k=2 bk = 1, hence 1
k=1 k2 converges.
2n − 10
Example 4.12. — Consider an = . Since limn→∞ n2 an = 2, there exists
n3 − 10n + 100
N ∈ N such that for all n ≥ N , 0 ≤ n2 an ≤ 3, or equivalently
3
0 ≤ an ≤ ∀ n ≥ N.
n2
P∞
By Corollary 4.10 and Example 4.11, the series n=0 an converges.
∞
X ∞
X
ak converges ⇐⇒ 2k a2k converges.
k=0 k=0
Proof. Consider the partial sum of the series ∞ k=0 ak starting from k = 2 up to an index that
P
is a power of 2. Since the terms ak are decreasing, the following inequalities hold:
n+1
2X
ak = a2 + (a3 + a4 ) + (a5 + · · · + a8 ) + · · · + (a2n +1 + · · · + a2n+1 )
k=2
and similarly,
n+1
2X
18 ak = a2 + (a3 + a4 ) + (a5 + · · · + a8 ) + · · · + (a2n +1 + · · · + a2n+1 )
k=2
In other words,
n n+1
2X n+1
X
k 1X k
2 a2k ≥ aj ≥ 2 a2k .
2
k=0 j=2 k=1
By Remark 4.9 and Corollary 4.10, the partial sums of one series are bounded if and only if
those of the other are. Hence, the two series converge or diverge together.
P∞
Example 4.14. — For p ∈ R, the series 1
n=1 np converges exactly when p > 1. Indeed:
• If p ≤ 0, then 1
np ≥ 1, so the series diverges (e.g., by Proposition 4.3).
∞ ∞ ∞
X 1 X 1 X k
p
converges ⇐⇒ 2 k
k p
= 2 1−p converges.
n (2 )
n=1 k=0 k=0
Recalling Example 4.4, this holds exactly when 21−p < 1, i.e. p > 1.
Remark 4.15. — The argument in Example 4.14 provides another proof that the harmonic
series diverges (cf. Example 4.5).
P∞ 1
Exercise 4.16. — For p ∈ R, show that the series n=2 converges exactly when
n (log n)p
p > 1.
Hint: for p ≤ 0, compare with the harmonic series; for p > 0, use Proposition 4.13 and
Example 4.14.
P∞ 1
Exercise 4.17. — Decide whether the series n=3 converges or diverges.
n log n log log n
A striking feature of conditionally convergent series is that their terms can be rearranged
to obtain any prescribed limit.
Then define
min P \ {φ(0), . . . , φ(n)} , if sn < A,
φ(n + 1) =
min N \ {φ(0), . . . , φ(n)} , if sn ≥ A.
The map φ is injective by construction, and surjective because both subseries of positive and
negative terms diverge to +∞ (hence no index remains unused).
Since an → 0 as n → ∞, the successive corrections become arbitrarily small, and the
sequence of partial sums (sn )∞
n=0 converges to A. This establishes the theorem.
Exercise 4.20. — Fill in the details omitted in the proof of Theorem 4.19. Show also that
one can obtain A = ±∞ by a suitable rearrangement.
2n+1
X ∞
X 2n
X
(−1)k ak ≤ (−1)k ak ≤ (−1)k ak . (4.1)
k=0 k=0 k=0
Pn
Proof. Let sn = k=0 (−1)
ka
k. Since the sequence (an )∞
n=0 is decreasing and non-negative,
we have
In particular
0 ≤ B − A ≤ s2n+2 − s2n+1 = a2n+2 ∀ n ∈ N,
P∞
converges by Proposition 4.22, whereas 1
n=1 n diverges (Example 4.5); hence it is only
conditionally convergent.
P∞
Proof. By definition, the series k=0 ak converges if and only if the sequence of partial sums
n
X
sn = ak
k=0
Example 4.25. — To see once more that the harmonic series diverges, note that for any
N ∈ N,
2N
X 1 1 1
≥ N· = .
k 2N 2
k=N +1
Thus, the Cauchy condition fails for ε = 12 , and the series cannot converge.
Proof. Since ∞ n=0 |an | converges, by the Cauchy criterion (Theorem 4.24) there exists N ∈ N
P
We now establish two classical criteria guaranteeing absolute convergence. In their proofs, we
repeatedly use the following fact:
Remark 4.27. — If a sequence (xn )∞ n=0 converges to α ∈ R, then Proposition 2.95 implies
the following facts:
(i) for any q > α there exists N ∈ N such that xn < q for all n ≥ N ;
(ii) for any r < α there exists N ∈ N such that xn > r for all n ≥ N .
p
n
α = lim sup |an | ∈ R ∪ {∞}.
n→∞
Then
∞
X ∞
X
α < 1 =⇒ an converges absolutely, α > 1 =⇒ an does not converge.
n=0 n=0
Thus xn = supk≥n |ak | → α. Since α < q, Remark 4.27(i) implies the existence of N ∈ N
p
k
such that
p
k
xn = sup |ak | < q ∀ n ≥ N,
k≥n
therefore
|ak | < q k ∀ k ≥ N,
Since q < 1, ∞ k=N |ak | converges by comparison with the geometric series (Example 2.128),
P
P∞
so n=0 an converges absolutely.
If α > 1, since the limsup is an accumulation point (Theorem 2.112), Proposition 2.88
implies the existence of a subsequence (ank )∞ such that limk→∞ nk |ank | = α. Hence, thanks
p
k=0
to Remark 4.27(ii) with r = 1, nk |ank | > 1 for all k large, or equivalently, |ank | > 1 for large
p
|an+1 |
lim = α ∈ [0, ∞).
n→∞ |an |
Then
∞
X ∞
X
α < 1 =⇒ an converges absolutely, α > 1 =⇒ an does not converge.
n=0 n=0
Since q < 1, the geometric comparison test shows that ∞ n=0 |an | converges absolutely.
P
If α > 1, then Remark 4.27(ii) with r = 1 implies the existence of N ∈ N such that
|ak+1 |
>1 ∀ k ≥ N.
|ak |
In particular,
Hence (an )∞
n=0 does not tend to 0, and by Proposition 4.3 the series does not converge.
|an+1 | |an+1 |
α+ = lim sup , α− = lim inf .
n→∞ |an | n→∞ |an |
Show that
∞
X ∞
X
α+ < 1 =⇒ an converges absolutely, α− > 1 =⇒ an does not converge.
n=0 n=0
∞
X ∞
X
an = aφ(n) . (4.3)
n=0 n=0
P∞
Proof. Fix ε > 0. Since n=0 |an | converges, there exists N ∈ N such that
∞
X ε
|ak | < .
2
k=N +1
Let
M = max φ−1 (0), . . . , φ−1 (N ) .
Then
{a0 , . . . , aN } ⊂ {aφ(0) , . . . , aφ(n) } ∀ n ≥ M,
therefore
n
X N
X X
aφ(ℓ) − ak = aφ(ℓ) .
ℓ=0 k=0 0≤ℓ≤n
φ(ℓ)>N
Moreover, since all indices φ(ℓ) > N with 0 ≤ ℓ ≤ n correspond to terms among {|ak | | k ≥
N + 1}, we have
X ∞
X
|aφ(ℓ) | ≤ |ak |.
0≤ℓ≤n k=N +1
φ(ℓ)>N
n
X ∞
X n
X N
X ∞
X X ∞
X
aφ(ℓ) − ak = aφ(ℓ) − ak − ak = aφ(ℓ) − ak
ℓ=0 k=0 ℓ=0 k=0 k=N +1 0≤ℓ≤n k=N +1
φ(ℓ)>N
X ∞
X ∞
X
≤ |aφ(ℓ) | + |ak | ≤ 2 |ak | < ε.
0≤ℓ≤n k=N +1 k=N +1
φ(ℓ)>N
Proof. Consider first a bijection α : N → N × N, written α(n) = (α1 (n), α2 (n)), such that
j∈N
α(15) = (0, 3)
α(4) = (0, 2)
α(3) = (0, 1)
α(k) path
19 Figure 4.1: Illustration of the bijection α : N → N × N, which enumerates all lattice points
in N2 by following the blue path. For each n, the first n2 elements {α(k) | 0 ≤ k < n2 − 1}
exactly cover the square {0, 1, . . . , n − 1}2 .
we have
2 −1
nX ∞
! ∞
!
X X
sup |aα1 (k) ||bα2 (k) | ≤ |aℓ | |bm | < ∞.
n∈N k=0 ℓ=0 m=0
P∞
This implies that the series k=0 aα1 (k) bα2 (k) converges absolutely. In particular, since it
converges, its value can be computed along every subsequence, therefore
∞ 2 −1
nX
X
aα1 (k) bα2 (k) = lim aα1 (k) bα2 (k)
n→∞
k=0 k=0
∞ 2 −1
nX
X
aα1 (k) bα2 (k) = lim aα1 (k) bα2 (k)
n→∞
k=0 k=0
n−1 n−1 ∞ ∞
! ! ! !
X X X X
19 = lim aℓ lim bm = an bn ,
n→∞ n→∞
ℓ=0 m=0 n=0 n=0
∞ ∞ ∞ n
! ! !
X X X X
an bn = an−k bk ,
n=0 n=0 n=0 k=0
Proof. Consider the bijection α : N → N×N defined as the inverse of the function f5 : N×N →
20
N from Example 2.70(3), represented in Figure 2.10. Explicitly,
α(0) = (0, 0), α(1) = (1, 0), α(2) = (0, 1), α(3) = (2, 0), α(4) = (1, 1), ...
α(20) = (0, 5), . . . , α(31) = (4, 3), ..., α(49) = (5, 4), . . . , etc.
By Theorem 4.33,
∞ ∞ ∞
! !
X X X
an bn = aα1 (n) bα2 (n) .
n=0 n=0 n=0
Listing the terms explicitly and grouping them by diagonals as in Figure 4.2, we obtain
(0,3)
n=3
(0,2) (1,2)
n=2
∞
X
aα1 (n) bα2 (n) = a0 b0 + (a0 b1 + a1 b0 ) + (a2 b0 + a1 b1 + a0 b2 )
n=0
+ (a3 b0 + a2 b1 + a1 b2 + a0 b3 ) + · · ·
20
∞ ∞ n
! !
X X X X
= aj bk = an−k bk .
n=0 j,k≥0 n=0 k=0
j+k=n
Finally, absolute convergence follows from the triangle inequality and Theorem 4.33:
∞ X
X n ∞ X
X n ∞
X
an−k bk ≤ |an−k bk | = |aα1 (n) ||bα2 (n) | < ∞.
n=0 k=0 n=0 k=0 n=0
P∞ n
Example 4.35. — Let q ∈ R with |q| < 1. Then n=0 q converges absolutely (see
Example 4.4). Applying the Cauchy product to this series with itself yields
∞
!2 ∞ X
n ∞
1 X X X
= qn = q n−k q k = (n + 1)q n .
(1 − q)2
n=0 n=0 k=0 n=0
P∞
This gives us an explicit formula for the value of the series n=0 nq
n:
∞ ∞ ∞
X X X 1 1 q
nq n = (n + 1)q n − qn = 2
− = .
(1 − q) 1−q (1 − q)2
n=0 n=0 n=0
Hence, the series of real and imaginary parts are absolutely convergent.
Conversely, since |zn | ≤ |xn | + |yn |, the absolute convergence of ∞
P∞
n=0 xn and
P
n=0 yn
P∞
also implies the absolute convergence of n=0 zn . Therefore, absolute convergence in C is
equivalent to absolute convergence of the real and imaginary parts.
Our next goal is to investigate power series. These are series where the terms are powers of
the variable x ∈ R (or z ∈ C, if one considers complex power series) multiplied by coefficients.
where (an )∞
n=0 is a sequence in R and x ∈ R. Here, x is the variable, and an ∈ R is
the coefficient of xn .
By convention, we set x0 = 1 for all x ∈ R, including x = 0. In other words, the first
term of the power series is always a0 .
20
Addition and multiplication of power series are given by
∞
X ∞
X ∞
X
an xn + bn xn = (an + bn )xn ,
n=0 n=0 n=0
∞
X ∞
X X∞ X
n
an xn bn xn = an−k bk xn ,
n=0 n=0 n=0 k=0
A power series is a polynomial whenever only finitely many of its coefficients are nonzero.
The convergence of a power series depends on the coefficients (an )∞
n=0 and is characterized
in Theorem 4.41.
p
n
ρ := lim sup |an |.
n→∞
(Equivalently, R = 1
ρ with the conventions 1/0 = ∞ and 1/∞ = 0.)
In the following, when we write R ∈ [0, ∞], we mean that R is either a nonnegative real
number or R = ∞.
P∞
Exercise 4.40. — For each R ∈ [0, ∞], find a power series n=0 an x
n with radius of
convergence R.
Proof. Let x ∈ R, and write ρ = lim supn→∞ |an | as in Definition 4.39. Then
p
n
p p
n n
lim sup |an xn | = lim sup |an | |x| = ρ|x|.
n→∞ n→∞
P∞
By the root criterion (see Proposition 4.28), the series n=0 an x converges absolutely if
n
ρ|x| < 1, and does not converge if ρ|x| > 1 (in particular, if ρ = 0, then it converges
absolutely for all x ∈ R). Since R = ρ1 , the result follows.
Proof. By Theorem 4.41 with x = r, the series ∞ n=0 |an |r converges. Hence, for every ε > 0
n
P
P∞
there exists N ∈ N such that k=N +1 |ak |rk < ε. Thus, for all x ∈ [−r, r] and all n ≥ N ,
∞
X ∞
X ∞
X
k k
|fn (x) − f (x)| = ak x ≤ |ak | |x| ≤ |ak |rk < ε.
k=n+1 k=n+1 k=N +1
This shows that (fn )∞ n=0 converges uniformly to f on [−r, r]. Since each fn is continuous
(being a polynomial), Theorem 3.83 implies that f is continuous on [−r, r]. As r < R is
arbitrary, f is continuous on (−R, R).
Example 4.43. — In general, the partial sums fn (x) = nk=0 ak xk do not converge uni-
P
To see this, consider the geometric series ∞ n=0 x . Its radius of convergence is R = 1, and
n
P
P∞ n
on (−1, 1) we have f (x) = n=0 x = 1−x 1
(see Example 4.4). If the convergence on (−1, 1)
were uniform, then applying the notion of uniform convergence with ε = 1 would give N ∈ N
such that, for all n ≥ N and x ∈ (−1, 1),
n
X 1
xk − < 1.
1−x
k=0
Exercise 4.45. — Let ∞ n=0 an x be a power series with an ̸= 0 for all n ∈ N, and assume
n
P
|an |
that the limit limn→∞ |an+1 | exists. Then
|an |
R = lim .
n→∞ |an+1 |
all x ∈ R with |x| > L. Comparing this statement with Theorem 4.41, conclude that L = R.
Proof. By linearity and Corollary 4.34, the absolute convergence of an xn and bn xn for
P P
both converge absolutely for |x| < R. Since a power series cannot converge for |x| larger than
its radius of convergence, each has radius of convergence at least R.
P∞
Example 4.47. — If n=0 an x
n has radius of convergence at least 1, then
∞ ∞
1 X X
an xn = (a0 + · · · + an ) xn ∀ x ∈ (−1, 1). (4.6)
1−x
n=0 n=0
P∞
20 Indeed, since n=0 x
n = 1
1−x for x ∈ (−1, 1) and has radius 1, (4.6) follows from Proposi-
tion 4.46.
∞
X
Exercise 4.48. — Compute n 2−n .
n=1
where (an )∞
n=0 is a sequence in C and z ∈ C.
Again, by convention, we set z 0 = 1 for all z ∈ C, including z = 0.
The radius of convergence is defined exactly as in Definition 4.39, replacing |x| by |z|.
With these definitions, the following theorem holds, and the proof is identical to the real case.
20
Theorem 4.50: Convergence of Complex Power Series
Let ∞ an z n be a power series with radius of convergence R ∈ (0, ∞]. Then the series
P
P∞ n=0 n
n=0 an z converges absolutely for all z ∈ C with |z| < R, and diverges for all z ∈ C
with |z| > R. In particular, for |z| < R one can define the (complex-valued) function
∞
X
f (z) = an z n .
n=0
Before stating the analogue of Theorem 4.42, we recall the notions of continuity and uniform
convergence for functions defined on subsets of C.
These definitions are identical in form to the real case, with the only difference that | · | now
denotes the modulus on C. With these definition, some proofs about continuous functions can
be repeated verbatim. In particular, polynomial functions are continuous; also, Theorem 3.83
Proof. The proof is identical to the real case. Since ∞ n=0 |an |r < ∞ for every r < R, the
n
P
where
0! = 1, n! = 1 · 2 · . . . · n.
Since (n+1)!
n! 1
= n+1 → 0 as n → ∞, it follows directly from the quotient criterion (see
Exercise 4.45) that this series has infinite radius of convergence. Hence, Theorem 4.42 implies
that the right-hand side of (4.8) defines a continuous function on R.
n! ≥ n · (n − 1) · . . . · (N + 1) · N ≥ N n−N +1 ;
21 | {z
n−N +1 terms
}
p
n 1 1
ρ = lim sup |an | ≤ lim n−N +1 = .
n→∞ n→∞
N n N
The representation of the exponential function as a power series is, in many ways, more
flexible than its definition as a limit. Moreover, as we shall see, its complex version will
naturally connect with the sine and cosine functions.
Before discussing these connections, we first show that the two representations of the
exponential function (via series and via limit) coincide.
n n k−1
x n X n x k xk Y
X ℓ
1+ = = 1− .
n k nk k! n
k=0 k=0 ℓ=0
P∞ |x|k
Fix x ∈ R and ε > 0. Since k=0 k! < ∞, there exists N ∈ N such that
∞
X |x|k ε
< .
k! 2
k=N +1
In particular,
N ∞ ∞
X xk X xk X |x|k ε
− ≤ < . (4.9)
k! k! k! 2
k=0 k=0 k=N +1
Moreover, for n ≥ N ,
N N k−1 ∞
xk |x|k |x|k
Y
X x n X ℓ X
− 1+ ≤ 1− 1− + .
k! n k! n k!
k=0 k=0 ℓ=0 k=N +1
letting n → ∞ yields
N N
X xk x n X xk x n
− lim 1+ = lim − 1+
k! n→∞ n n→∞ k! n
k=0 k=0
N k−1 ∞
|x|k |x|k
Y
X ℓ X
≤ lim 1− 1− +
n→∞ k! n k!
k=0 ℓ=0 k=N +1
∞
X |x|k
= .
k!
k=N +1
∞ N ∞
X xk x n X xk x n X xk
− lim 1+ ≤ − lim 1 + +
k! n→∞ n k! n→∞ n k!
k=0 k=0 k=N +1
∞ ∞ ∞
X |x|k X xk X |x|k
≤ + ≤2 < ε.
k! k! k!
k=N +1 k=N +1 k=N +1
Figure 4.3: The exponential function and some of its partial sums.
21
Definition 4.56: The Complex Exponential Map
The complex exponential map is the function exp : C → C defined by
∞
X zn
exp(z) = , z ∈ C.
n!
n=0
Before proving the main properties of the exponential function, recall the binomial formula:
for all z, w ∈ C and n ∈ N,
n
X n n n!
(z + w) = n k
z w n−k
, = . (4.10)
k k k!(n − k)!
k=0
zn
Proof. Since the series ∞n=0 n! has infinite radius of convergence, Theorem 4.53 implies that
P
exp : C → C is continuous.
For z, w ∈ C, using (4.5) and (4.10), we obtain
∞ ∞ ∞ X
n
! !
z w
X zn X wn X z k wn−k
e e = =
n! n! k!(n − k)!
n=0 n=0 n=0 k=0
∞ n ∞
n k n−k X (z + w)n
X 1 X
= z w = = ez+w .
n! k n!
n=0 k=0 n=0
To compute the modulus, note that complex conjugation is continuous and satisfies z k = z k
(see Lemma 2.42(3)), therefore
n n n
X zk X zk X zk
ez = lim = lim = lim = ez .
21 n→∞ k! n→∞ k! n→∞ k!
k=0 k=0 k=0
Remark 4.58. — Note that the proof of Proposition 4.55 can be repeated verbatim to
n
show that ez = lim 1 + nz for all z ∈ C.
n→∞
This motivates the following definitions of the sine and cosine functions:
∞ ∞
X (−1)n 2n+1 X (−1)n
sin(x) = x , cos(x) = x2n , (4.12)
(2n + 1)! (2n)!
n=0 n=0
x∈D =⇒ −x ∈ D.
A function f : D → R is called
21
• even if f (−x) = f (x) for all x ∈ D,
Geometrically, an even function is symmetric with respect to the y-axis, while an odd
function is symmetric with respect to the origin.
Since (−x)2n+1 = −x2n+1 and (−x)2n = x2n for all n ∈ N, it follows directly from (4.12)
that
Adding and subtracting these two identities gives the formulas for cos(x) and sin(x) in terms
of eix and e−ix .
To prove the addition formulas, we recall that
x2n+1 ∞
Proof. For x ∈ (0, 2], the sequence (2n+1)! is monotonically decreasing. Hence, by the
n=0
Leibniz criterion for alternating series (Proposition 4.22), the following estimates hold:
x3 x3 x5
x− ≤ sin(x) ≤ x − + ∀ x ∈ [0, 2]. (4.15)
3! 3! 5!
x2n ∞
Analogously, the sequence (2n)! is monotonically decreasing for x ∈ [0, 1], therefore
n=0
x2 x2 x4
1− ≤ cos(x) ≤ 1 − + ∀ x ∈ [0, 1]. (4.16)
2 2 24
1 1
sin(1) ≥ 1 − >√ .
6 2
Thus, because sin is continuous, the Intermediate Value Theorem (Theorem 3.24) implies the
existence of p ∈ (0, 1) such that sin(p) = √12 .
Because sin2 (p) + cos2 (p) = 1 and cos(x) ≥ 1 − 12 x2 > 0 for x ∈ [0, 1] (see (4.16)), this
implies that
1
q
cos(p) = 1 − sin2 (p) = √ .
2
In other words,
1+i
21 eip = cos(p) + i sin(p) = √ .
2
Now, if we define π = 4p ∈ (0, 4), we obtain
π (1 + i)2 π
ei 2 = ei2p = (eip )2 = = i, eiπ = (ei 2 )2 = i2 = −1, ei2π = (−1)2 = 1.
2
This proves that we have found a number π ∈ (0, 4) that satisfies all the desired properties.
It remains to prove uniqueness.
Assume there exists s ∈ (0, 4), with s ̸= π, satisfying sin(s) = 0. From the estimate
x3 x2
sin(x) ≥ x − =x 1− >0 for x ∈ (0, 2],
3! 6
we see that sin(x) has no zeros in (0, 2]. Hence, we deduce that π, s ∈ (2, 4).
Now, define r = |π − s|, so that r ∈ (0, 2). Then, by Exercise 4.60 and the addition
formula (4.13), we get
However, this is impossible since sin has no zeros in (0, 2). So, such a number s cannot exist,
and π ∈ (0, 4) is uniquely determined by the condition sin(π) = 0.
Using these values together with the addition formulas (4.13), the identities follow directly.
Alternatively, one can observe that
π π
ei(x+ 2 ) = ei 2 eix = ieix =⇒ cos(x + π2 ) + i sin(x + π2 ) = i cos(x) − sin(x),
which implies that sin(x + π2 ) = cos(x) and cos(x + π2 ) = − sin(x). The other identities can
be proved analogously.
From Corollary 4.63 it follows that both sin and cos are periodic functions with period 2π.
21 To determine sin(x) or cos(x) for any real x, it suffices to know their values on the interval
[0, π2 ].
Exercise 4.64. — Show that the zeros of sin : R → R are precisely the points in πZ ⊂ R,
and the zeros of cos : R → R are exactly the points in πZ + π2 . Also, show that cos(x) = 1 if
and only if x = 2nπ with n ∈ Z.
for all x, y ∈ R. Use this to show that sin : [− π2 , π2 ] → [−1, 1] is strictly increasing and hence
bijective.
where r = |z| is the distance of z from the origin, and θ is the angle between the positive real
axis R≥0 and the segment from 0 to z. In other words, if z = x + iy, then
p
x = r cos(θ), y = r sin(θ), r= x2 + y 2 .
21
Existence when Im(w) ≥ 0. Since Re(w)2 + Im(w)2 = 1, we have Re(w) ∈ [−1, 1]. Hence,
since cos(0) = 1 and cos(π) = −1, the Intermediate Value Theorem 3.24 ensures the existence
of θ ∈ [0, π] such that Re(w) = cos(θ). Noticing that, for such θ, both Im(w) and sin(θ) are
nonnegative, we get
p p
sin(θ) = 1 − cos2 (θ) = 1 − Re(w)2 = Im(w),
therefore w = eiθ .
Existence when Im(w) < 0. Since −w satisfies Im(−w) > 0, by the previous case there exists
ϑ ∈ (0, π) such that −w = eiϑ . Since eiπ = −1, we obtain
sin(θ − θ′ ) = 0, cos(θ − θ′ ) = 1.
Since θ − θ′ ∈ (−2π, 2π), Theorem 4.62 and Corollary 4.63 imply θ − θ′ = 0. Hence θ = θ′ ,
proving uniqueness.
Thus, when multiplying two complex numbers, their magnitudes multiply and their arguments
add.
zw
21 w
ψ+φ
φ ψ
r s rs
Exercise 4.67. — Let w = reiθ ̸= 0. Show that the n-th roots of w (i.e. the solutions
z ∈ C of z n = w) are given by
n√ θ+2πk
o
n
r e i( n ) k = 0, 1, . . . , n − 1 .
n−1
X
ei2πk/n = 0.
k=0
sin(x) cos(x)
tan(x) = , cot(x) = ,
cos(x) sin(x)
Exercise 4.69. — Show that, for x, y ∈ R where both sides are defined,
tan(x) + tan(y)
tan(x + y) = .
1 − tan(x) tan(y)
21
Find and prove an analogous addition formula for the cotangent function.
The hyperbolic sine and hyperbolic cosine are defined by the power series
∞ ∞
X x2k+1 X x2k
sinh(x) = , cosh(x) = .
(2k + 1)! (2k)!
k=0 k=0
Equivalently,
ex − e−x ex + e−x
sinh(x) = , cosh(x) = ,
2 2
and hence ex = cosh(x) + sinh(x) for all x ∈ R.
The hyperbolic tangent and hyperbolic cotangent are defined by
where coth(x) is defined for all x ∈ R \ {0} (since sinh(x) ̸= 0 for x ̸= 0).
The functions sinh and tanh are odd, while cosh is even. Also, they satisfy the addition
formulas
21
Exercise 4.70. — Starting from the definitions of sinh and cosh, prove the above identities.
Differential Calculus
In this chapter we deal with differential calculus in one variable. This is of fundamental
importance for understanding functions on R.
f (x) − f (x0 )
f ′ (x0 ) = lim
x→x0 x − x0
153
Chapter 5.1 The Derivative
can be rewritten as
f (x) − f (x0 ) − f ′ (x0 )(x − x0 )
lim = 0,
x→x0 x − x0
or equivalently, using the little-o notation from Definition 3.69,
hence f is continuous at x0 .
df
An alternative notation for the derivative of f is dx . If x0 ∈ D is a right accumulation
22 point of D, then f is differentiable from the right at x0 if the right derivative
exists. Differentiability from the left and the left derivative f−′ (x0 ) are defined analo-
gously using the limit x → x−
0.
Affine Functions
An affine function is a function of the form x 7→ sx + r, for real numbers s and r.
The graph of an affine function is a nonvertical line in R2 . The parameter s in the
equation y = sx + r is called the slope of the line.
h
x
x0 x0 +h
Figure 5.1: The figure shows the graph of f (blue) and its tangent at x0 (gray dashed), which
corresponds to the graph of the affine approximation L(x) = f (x0 ) + f ′ (x0 )(x − x0 ). Note
that, when we move a distance h from x0 to x0 + h, the vertical error between f (x0 + h) and
L(x0 + h) is o(h).
22
Example 5.3. — • Constant functions are differentiable everywhere and have the zero
function as their derivative.
• The identity function f (x) = x is differentiable, and its derivative is the constant func-
tion 1. Indeed,
x − x0
f ′ (x0 ) = lim =1 ∀ x0 ∈ R.
x→x0 x − x0
Example 5.4. — The exponential function exp : R → R>0 is differentiable and its deriva-
tive is again the exponential function. Indeed, for x ∈ R, using that ex+h = ex eh we get
P∞ hk P∞ hk ∞ ∞
ex+h − ex eh − 1 k=0 k! −1 k=1 k!
X hk−1 X hn
= ex = ex x
=e = ex = ex .
h h h h k! (n + 1)!
k=1 n=0
xn
We now observe that the power series x 7→ ∞ n=0 (n+1)! has infinite radius of convergence
P
xn
(see, e.g., Exercise 4.45); in particular, the function g(x) = ∞ n=0 (n+1)! is continuous on R
P
ex+h − ex
(ex )′ = lim = ex lim g(h) = ex g(0) = ex .
h→0 h h→0
More generally, let α ∈ C and define f : R → C by f (x) = eαx . Then, arguing as before, we
get
∞
eαx+αh − eαx eαh − 1 X αk hk−1
(eαx )′ = lim = eαx lim = eαx lim
h→0 h h→0 h h→0 k!
k=1
∞ ∞
X (αh)k−1 X (αh)n
= αeαx lim = αeαx lim = αeαx .
h→0 k! h→0 (n + 1)!
k=1 n=0
1 1
x+h − x x − (x + h) 1 1
f ′ (x) = lim = lim = − lim = − 2.
h→0 h h→0 (x + h) x h h→0 (x + h) x x
for all n ∈ N. If f (n) exists, we say that f is n-times differentiable. If the nth
22 derivative f (n) is also continuous, f is called n-times continuously differentiable.
We denote the set of n-times continuously differentiable functions on D by C n (D).
Equivalently, C 0 (D) is the set of real-valued continuous functions on D, and C 1 (D) is the
set of all differentiable functions whose derivative is continuous (these are called continuously
differentiable or of class C 1 ). Recursively, for n ≥ 1,
For x = 0, we have
so f ′ (0) = 0. Altogether,
2x,
x > 0,
′
f (x) = 0, x = 0, that is, f ′ (x) = 2|x|.
−2x, x < 0,
Hence f is continuously differentiable, i.e. f ∈ C 1 (R). However, since f ′ (x) = 2|x| is not
differentiable at x = 0, the function f is not of class C 2 .
and
where we used that g is continuous at x0 (see Remark 5.2) to conclude limx→x0 g(x) = g(x0 ).
Proof. For n = 1 this is Proposition 5.10. The general case follows by induction on n ≥ 1.
Proof. We argue by induction. The cases n = 0 and n = 1 were covered in Example 5.3. For
n > 1, assume (xn )′ = nxn−1 . Then, by (5.4), since xn+1 = x · xn ,
This proves the inductive step and establishes the result. Finally, the linearity of the derivative
(see (5.3)) yields the differentiability of any polynomial.
By Theorem 4.61,
and analogously cos′ (x) = − sin(x). Similarly, sinh′ (x) = cosh(x) and cosh′ (x) = sinh(x).
Remark 5.15. — Heuristically, we would like to compute the derivative of the composition
by writing
g(f (x)) − g(f (x0 )) g(f (x)) − g(f (x0 )) f (x) − f (x0 )
= · ,
22 x − x0 f (x) − f (x0 ) x − x0
and then take the limit as x → x0 to get
This argument proves the result if f (x) ̸= f (x0 ) for x near x0 , but it is not a proof as stated:
if f (x) = f (x0 ) for infinitely many x close to x0 , the fraction g(ff(x))−g(f (x0 ))
(x)−f (x0 ) is undefined, and
one faces a 0/0 indeterminacy. In the proof below, we will provide a rigorous argument, but
it is helpful to keep the above heuristic in mind as the underlying intuition for the chain rule.
g(f (x)) = g(f (x0 )) + g ′ (f (x0 )) [f (x) − f (x0 )] + ω(f (x)) [f (x) − f (x0 )],
therefore
g(f (x)) − g(f (x0 )) f (x) − f (x0 ) f (x) − f (x0 )
lim = lim g ′ (f (x0 )) + ω(f (x))
x→x0 x − x0 x→x0 x − x0 x − x0
where we used the continuity of ω at y0 = f (x0 ) to deduce that ω(f (x)) → ω(f (x0 )) = 0 as
x → x0 .
Proof. Consider the function ψ : R\{0} → R given by ψ(y) = y1 . This function is differentiable
by Example 5.5, with ψ ′ (y) = − y12 . Then, by the chain rule (Theorem 5.14), g1 = ψ ◦ g is
differentiable at x0 , with
23
′
1 g ′ (x0 )
(x0 ) = ψ ′ (g(x0 ))g ′ (x0 ) = − .
g g(x0 )2
f
Applying now the product rule (Proposition 5.10), g =f· 1
g is differentiable at x0 , and
′
1 ′ g ′ (x0 ) f ′ (x0 )g(x0 ) − f (x0 )g ′ (x0 )
f 1
(x0 ) = f · (x0 ) = f ′ (x0 ) − f (x0 ) = .
g g g(x0 ) g(x0 )2 g(x0 )2
f (x) = exp sin sin(x2 ) . For this, let g(x) = sin sin(x2 ) , h(x) = sin(x2 ), and k(x) = x2 .
Then, since
applying the chain rule repeatedly and using that exp′ = exp and sin′ = cos, we get
f ′ (x) = exp(g(x))g ′ (x), g ′ (x) = cos(h(x)) h′ (x), h′ (x) = cos(k(x)) k ′ (x), k ′ (x) = 2x,
therefore
f ′ (x) = exp sin sin(x2 ) cos sin(x2 ) cos(x2 ) 2x
∀ x ∈ R.
Exercise 5.19. — Determine the derivative of the function x 7→ cos sin3 (exp(x)) .
1 1
(f −1 )′ (ȳ) = = .
f ′ (x̄) f ′ (f −1 (ȳ))
−1
f −1 (yn ) − f −1 (ȳ)
xn − x̄ f (xn ) − f (x̄)
= = .
yn − ȳ f (xn ) − f (x̄) xn − x̄
proving that
f −1 (yn ) − f −1 (ȳ) 1
lim = ′ .
n→∞ yn − ȳ f (x̄)
f −1 (y) − f −1 (ȳ) 1
lim = ′ ,
y→ȳ y − ȳ f (x̄)
as desired.
f ′ (x0 ) x=y
Slope
1
f ′ (x0 )
Slope
(x0 , y0 )
f −1
(y0 , x0 )
23 Figure 5.2: An intuitive representation of Theorem 5.20. Let y0 = f (x0 ). Reflecting the graph
of f and the tangent line at (x0 , y0 ) across the line x = y in R2 yields the graph of f −1 and,
as asserted, the tangent line at (y0 , x0 ). A short calculation shows that the reflection of a line
with slope m across x = y has slope 1/m.
Example 5.21. — The function g : R \ {0} → R defined by g(y) = log |y| is differentiable,
with g ′ (y) = y1 for all y ∈ R \ {0}. Indeed, let f = exp : R → R>0 , so that log = f −1 . By
Theorem 5.20,
1
log′ (y) = ′ .
f (log(y))
Since exp′ = exp, for y > 0 we have
1 1
log′ (y) = = .
exp(log(y)) y
For y < 0, since g(y) = log(−y), by chain rule (Theorem 5.14) and applying the case above
to −y > 0, we get
1 1
g ′ (y) = − log′ (−y) = − = .
−y y
Example 5.22. — Given x > 0 and α ∈ R, we can compute the derivative of xα via
α
xα = exp α log x =⇒ (xα )′ = exp′ α log x α log′ (x) = exp α log x = αxα−1 .
x
Example 5.23. — The logarithm f = log : R>0 → R is smooth. Indeed, by the example
above, f ′ (x) = x1 . By induction (using the Leibniz rule) one gets
1 2 (n − 1)!
f ′′ (x) = − , f (3) (x) = , and in general f (n) (x) = (−1) n−1 ∀ n ≥ 1.
x2 x3 xn
23
where fn is a polynomial. Then, using that exp(−1/x) tends to 0 faster than any power of x
as x → 0+ (equivalently, exp(y) dominates every polynomial as y → +∞, by Corollary 3.47),
prove that
1
(n+1) ψ (n) (x) − ψ (n) (0) ψ(x)fn x 1
1
ψ (0) = lim = lim = lim ψ(x) fn x =0 ∀ n ∈ N.
x→0 x x→0+ x x→0+ x
If the inequality is strict (i.e. f (x) < f (x0 ) for all x ∈ D ∩ (x0 − δ, x0 + δ) \ {x0 }), then
f has a strict local maximum at x0 .
A (strict) local minimum is defined analogously.
We call x0 a local extremum of f if f has either a local minimum or a local maximum
at x0 .
Proof. Without loss of generality, assume f has a local maximum at x0 (otherwise replace f
by −f ). We first note that, for x close to x0 and to the right of it, we have f (x) − f (x0 ) ≤ 0
and x − x0 > 0. Hence,
f (x) − f (x0 )
f+′ (x0 ) = lim ≤ 0.
x→x+0
x − x0
Similarly, for x close to x0 and to the left of it, we have f (x) − f (x0 ) ≤ 0 and x − x0 < 0, so
f (x) − f (x0 )
f−′ (x0 ) = lim ≥ 0,
x→x−
0
x − x0
1. x0 is an endpoint of I;
2. f is not differentiable at x0 ;
In particular, all local extrema of a differentiable function on an open interval are zeros
of the derivative.
Proof. By Theorem 3.34, f attains its minimum and maximum on [a, b] at some points x0 , x1 ∈
[a, b]. By Proposition 5.26, any interior extremum has zero derivative. Thus, we consider two
cases:
(i) If either x0 or x1 lies in (a, b), we are done.
(ii) If both x0 and x1 are endpoints, since f (a) = f (b) then min f = max f = f (a) = f (b),
therefore f is constant. In particular, f ′ (x) = 0 for all x ∈ (a, b) and the result follows also in
this case.
Proof. If f (a) = f (b), then Rolle’s Theorem would imply the existence of ξ ∈ (a, b) with
f ′ (ξ) = 0, contradicting the assumption that f ′ never vanishes.
f (b) − f (a)
g(x) = f (x) − (x − a).
b−a
23 f (b) − f (a)
0 = g ′ (ξ) = f ′ (ξ) − ,
b−a
In words, Rolle’s Theorem states that if a differentiable function on an interval takes the
same value at both endpoints, then its slope must be zero somewhere in between (left image).
The Mean Value Theorem, on the other hand, asserts that for any differentiable function
on an interval, there exists a point where the slope equals the average slope (right image).
Moreover, the Mean Value Theorem can be reduced to Rolle’s Theorem by subtracting from
f a suitable linear function so that the endpoint values coincide.
f f (b)
f
f (a) = f (b)
f (a)
a b a b
Using the Mean Value Theorem, we can show that for differentiable functions on an interval,
24 the notion of Lipschitz continuity introduced in Exercise 3.41 is equivalent to having a bounded
derivative.
Proof. Suppose first that f is Lipschitz on [a, b] with constant L. This implies that, given
x, x0 ∈ (a, b) with x ̸= x0 ,
f (x) − f (x0 )
≤ L.
x − x0
Taking the limit as x → x0 gives |f ′ (x0 )| ≤ L, so f ′ is bounded on (a, b).
Conversely, suppose f ′ is bounded on (a, b), say |f ′ | ≤ M for all z ∈ (a, b). Then, given
x, y ∈ [a, b] with x < y, the Mean Value Theorem (Theorem 5.31) applied on the interval
[x, y] yields ξ ∈ (x, y) ⊂ (a, b) with
therefore
|f (y) − f (x)| = |f ′ (ξ)| |y − x| ≤ M |y − x|.
Since x, y ∈ [a, b] are arbitrary, this shows that f is Lipschitz on [a, b] with Lipschitz constant
M.
24
Example 5.34. — Let f : [0, 2π] → C be given by f (x) = eix = cos x + i sin x. Then
f (0) = f (2π) = 1, but
f ′ (x) = ieix ̸= 0 ∀ x ∈ [0, 2π].
Thus Rolle’s theorem and the Mean Value Theorem fail for complex-valued functions.
If, in addition, g ′ (x) ̸= 0 for all x ∈ (a, b), then g(a) ̸= g(b) and
Then
F (a) = g(a) f (b) − f (a) − f (a) g(b) − g(a) = g(a)f (b) − f (a)g(b),
F (b) = g(b) f (b) − f (a) − f (b) g(b) − g(a) = g(a)f (b) − f (a)g(b).
which is (5.6).
If g ′ (x) ̸= 0 for all x, then Corollary 5.30 yields g(a) ̸= g(b). Dividing (5.6) by g ′ (ξ) g(b) −
g(a) yields the second formula.
As with the Mean Value Theorem 5.31, Cauchy’s theorem has a geometric interpretation:
under the stated assumptions, the curve t 7→ f (t), g(t) has a tangent parallel to the line
g(x)
24
g(b)
g(a)
f (x)
f (a) f (b)
The goal of the next exercises is to show that derivatives satisfy the intermediate value
property: although f ′ need not be continuous, it cannot have jump discontinuities. This result
is known as Darboux’s Theorem.
Exercise 5.36. — Follow the steps below to prove the following statement:
Let f : (a, b) → R be differentiable, and let x0 < x1 be points in (a, b) with f ′ (x0 ) ̸= f ′ (x1 ).
Show that, for every α between f ′ (x0 ) and f ′ (x1 ), there exists c ∈ (x0 , x1 ) such that f ′ (c) = α.
1. Without loss of generality, assume f ′ (x0 ) < f ′ (x1 ) and fix α ∈ (f ′ (x0 ), f ′ (x1 )).
2. Consider the auxiliary function g(x) = f (x) − αx and show that g attains a minimum
at some c ∈ [x0 , x1 ].
(i) Since
g(x0 + h) − g(x0 )
−−−−→ g ′ (x0 ) = f ′ (x0 ) − α,
h h→0+
g(x1 ) − g(x1 − h)
−−−−→ g ′ (x1 ) = f ′ (x1 ) − α,
h h→0+
4. Deduce that c ∈ (x0 , x1 ), and use Proposition 5.26 to show that g ′ (c) = 0, hence
f ′ (c) = α.
f ′ (x)
3. the limit L = lim exists.
x→a+ g ′ (x)
f (x)
Then lim exists and equals L.
x→a+ g(x)
Proof. By (2), we can extend f and g continuously to [a, b) by setting f (a) = g(a) = 0. Fix
ε > 0. By (3), there exists δ > 0 such that
f ′ (ξ)
∈ (L − ε, L + ε) ∀ ξ ∈ (a, a + δ).
g ′ (ξ)
Now, for any x ∈ (a, a + δ), we can apply Cauchy’s Mean Value Theorem (Theorem 5.35) to
f and g on [a, x] to obtain some ξx ∈ (a, x) with
f (x) f ′ (ξx )
= ′ ∈ (L − ε, L + ε) for all x ∈ (a, a + δ).
g(x) g (ξx )
f (x)
24 Because ε > 0 is arbitrary, this proves that lim = L.
x→a+ g(x)
Theorem 5.37 is one of several versions of L’Hôpital’s rule. For instance, one can allow
both limits in (2) to be improper, i.e., limx→a+ g(x) = ±∞ and limx→a+ f (x) = ±∞ (with
arbitrary signs). More precisely:
f ′ (x)
3. the limit L = lim exists.
x→a+ g ′ (x)
f (x)
Then lim exists and equals L.
x→a+ g(x)
f ′ (ξ)
∈ (L − ε, L + ε) ∀ ξ ∈ (a, a + δ).
g ′ (ξ)
For x ∈ (a, a + δ), apply Cauchy’s Mean Value Theorem (Theorem 5.35) on [x, a + δ] to obtain
ξx ∈ (x, a + δ) with
f (x) − f (a + δ) f ′ (ξx )
= ′ ∈ (L − ε, L + ε).
g(x) − g(a + δ) g (ξx )
Hence
f (x) − f (a + δ)
∈ (L − ε, L + ε) ∀ x ∈ (a, a + δ). (5.7)
g(x) − g(a + δ)
We now observe that
g(a+δ)
f (x) f (x) − f (a + δ) 1 − g(x)
= · f (a+δ)
. (5.8)
g(x) g(x) − g(a + δ) 1 −
f (x)
Since |f (x)|, |g(x)| → ∞ as x → a+ , the second factor in (5.8) tends to 1. Thus, combining
(5.7) and (5.8), there exists η ∈ (0, δ) such that
f (x)
∈ (L − 2ε, L + 2ε) ∀ x ∈ (a, a + η).
g(x)
f (x)
Since ε > 0 is arbitrary, lim = L.
x→a+ g(x)
Example 5.39. — We illustrate the use of l’Hôpital’s rule (applied repeatedly) by com-
puting
sin x − x
lim .
x→0 x3
First, note that
lim (sin x − x) = 0, lim x3 = 0,
x→0 x→0
Since
lim (− sin x) = 0, lim 6x = 0,
x→0 x→0
we still have a 0
0 form, and we apply l’Hôpital’s rule a third time:
− sin x − cos x 1
lim = lim =− .
x→0 6x x→0 6 6
Thus
sin x − x 1
lim 3
=− .
x→0 x 6
This example shows how l’Hôpital’s rule can be iterated, provided that at each step the new
quotient is still of indeterminate form 00 (or ∞
∞ ) and the hypotheses of the theorem remain
satisfied.
Instead of the one-sided limits x → a+ or x → b− , one can also consider x → −∞ or
x → ∞:
f ′ (x)
3. the limit L = lim exists.
x→∞ g ′ (x)
f (x)
Then lim exists and equals L.
x→∞ g(x)
Proof. If lim f (x) = lim g(x) = 0, apply Theorem 5.37 on 0, R1 to the functions x 7→ f x1
x→∞ x→∞
and x 7→ g x1 . If lim |f (x)| = lim |g(x)| = ∞, apply instead Theorem 5.38 on 0, R1 to the
24 x→∞ x→∞
functions x 7→ f x1 and x 7→ g x1 .
Remark 5.41. — As discussed in the following exercise, the proofs of Theorems 5.37, 5.38,
′ (x)
and 5.40 also apply (with small modifications) when fg′ (x) diverges to +∞ or −∞. In this
f (x) f ′ (x)
case, one concludes that g(x) diverges to the same infinite limit as g ′ (x) .
f ′ (x)
Exercise 5.42. — Prove Theorem 5.37 in the case where limx→a+ g ′ (x) = +∞.
f ′ (ξ)
Hint: Repeat the argument in the proof of Theorem 5.37, replacing the condition g ′ (ξ) ∈
f ′ (ξ)
(L − ε, L + ε) with inequalities of the form g ′ (ξ) > M for arbitrary M > 0.
sin x − x ex − x − 1 x4 − 4x
(a) lim , (b) lim , (c) lim , (d) lim x3 ex .
x→0+ x2 sin x x→0 cos x − 1 x→2 sin(πx) x→−∞
Exercise 5.44. — Let a < b and let f : [a, b] → R be continuous. Suppose x0 ∈ [a, b], that
f is differentiable on [a, b] \ {x0 }, and that limx→x0 f ′ (x) exists. Show that f is differentiable
at x0 and that f ′ is continuous at x0 .
f (x + h) − 2f (x) + f (x − h)
f ′′ (x) = lim ∀ x ∈ I.
h→0 h2
f ′ ≥ 0 ⇐⇒ f is increasing.
f (x + h) − f (x)
f ′ (x) = lim ≥ 0.
h→0 h
24 Conversely, suppose f is not increasing. Then there exist x1 < x2 with f (x2 ) < f (x1 ). By
the Mean Value Theorem 5.31, there exists ξ ∈ (x1 , x2 ) such that
f (x2 ) − f (x1 )
f ′ (ξ) = < 0,
x2 − x1
so f ′ ̸≥ 0 on I.
Remark 5.47. — If f ′ > 0, the same argument shows that f is strictly increasing. However
the converse fails: the function f (x) = x3 is strictly increasing, but f ′ (0) = 0.
Geometrically, (5.9) says that on every interval [a, b] the graph of f lies below the secant
through (a, f (a)) and (b, f (b)).
An equivalent definition of a convex function is the following:
f : I → R is convex if for all a, b ∈ I with a < b and all x ∈ (a, b),
a xt = (1 − t)a + tb b
Figure 5.3: In blue, a convex function. In red, the secant through (a, f (a)) and (b, f (b)),
which lies above the function f . In green, the secants between (a, f (a)), (xt , f (xt )) and
(xt , f (xt )), (b, f (b)), the latter being steeper than the former.
Exercise 5.51. — Show that (5.9) for all t ∈ (0, 1) is equivalent to (5.10) for all x ∈ (a, b).
Proof. Assume f ′ is increasing. Then, for a < b and x ∈ (a, b), the Mean Value Theorem 5.31
applied on the intervals [a, x] and [x, b] yields ξ ∈ (a, x) and ζ ∈ (x, b) such that
Since f ′ is increasing we have f ′ (ξ) ≤ f ′ (ζ), so (5.10) follows. Since a < b ∈ I and x ∈ (a, b)
are arbitrary, f is convex.
Conversely, assume f is convex. Given a < b, consider h > 0 small enough so that
a + h < b − h and apply (5.10) twice: first, applying it on the interval (a, b − h) with x = a + h
we get
f (a + h) − f (a) f (b − h) − f (a + h)
≤ ;
h (b − h) − (a + h)
then, applying it on the interval (a + h, b) with x = b − h we obtain
f (b − h) − f (a + h) f (b) − f (b − h)
≤ .
25 (b − h) − (a + h) h
Combining these two inequalities we deduce that, for all sufficiently small h > 0,
f (a + h) − f (a) f (b) − f (b − h)
≤ . (5.11)
h h
Exercise 5.53. — Under the assumptions of Proposition 5.52, prove that f is strictly
convex if and only if f ′ is strictly increasing.
Exercise 5.55. — Under the assumptions of Corollary 5.54, show that if f ′′ (x) > 0 for all
x ∈ I, then f is strictly convex. Is the converse true?
25
Exercise 5.58. — Show that for all real numbers x ≥ −1 and p ≥ 1, the continuous
Bernoulli inequality holds:
(1 + x)p ≥ 1 + px.
Hint: Define f : [−1, ∞) → R as f (x) = (1 + x)p − 1 + px. Prove that f is convex and satisfies
f (0) = f ′ (0) = 0. Use these facts to deduce that f ≥ 0 on [−1, ∞).
Exercise 5.59. — Given α ∈ (0, 1], show that the function x 7→ xα is concave on (0, ∞),
and use this fact to provide an alternative proof of (3.15).
By Theorem 4.62 and Exercise 4.64, the zeros of cos : R → R are the points { π2 + kπ | k ∈ Z},
and cos(0) = 1. By the Intermediate Value Theorem (Theorem 3.24), it follows that sin′ (x) =
cos(x) > 0 for all x ∈ (− π2 , π2 ). Hence, by Remark 5.47, the function
is strictly increasing and bijective (recall that sin(− π2 ) = −1 and sin( π2 ) = 1). Consequently,
the restriction of the sine function to [− π2 , π2 ] has an inverse, denoted
arcsin : [−1, 1] → [− π2 , π2 ],
− π2 π
2 −1 1
−1
− π2
Remark 5.60. — Since sin′′ = − sin, it follows that sin is convex on − π2 , 0 and concave
on 0, π2 .
By Theorem 5.20, the arcsine is differentiable at s whenever the derivative of the sine at
x = arcsin(s) is nonzero. Since sin′ = cos vanishes only at the endpoints of − π2 , π2 , for
1 1 1
arcsin′ (s) = =p 2
=√ ,
cos(x) 1 − sin (x) 1 − s2
is bijective.
π
1
π
π 2
0 2 π
−1 cos(x)
arccos(x)
−1 0 1
Applying the differentiation rule for the inverse function, for x ∈ (0, π) and s = cos(x) we
obtain
1 1 1
arccos′ (s) = = −p = −√ .
− sin(x) 1 − cos2 (x) 1 − s2
Remark 5.61. — Since cos′′ = − cos, it follows that cos is concave on 0, π2 and convex
on π2 , π .
sin(x) sin(x)
lim tan(x) = lim = +∞, lim tan(x) = lim = −∞.
π − π − cos(x) π + π + cos(x)
x→( 2 ) x→( 2 ) x→(− 2 ) x→(− 2 )
tan : (− π2 , π2 ) → R.
tan(x)
π
2
arctan(x)
− π2 0 π
2 0
− π2
25
Its inverse
arctan : R → − π2 , π2
1
arctan′ (s) = 1 = cos2 (x).
cos2 (x)
Since
sin2 (x) 1 − cos2 (x) 1
s2 = tan2 (x) = 2
= 2
= − 1,
cos (x) cos (x) cos2 (x)
it follows that 1 + s2 = 1
cos2 (x)
, therefore
1
arctan′ (s) = ∀ s ∈ R.
1 + s2
The cotangent behaves similarly. The restriction cot |(0,π) : (0, π) → R is strictly decreasing
and bijective. Its inverse
arccot : R → (0, π)
1
arccot′ (s) = − ∀ s ∈ R.
1 + s2
We have sinh′ (x) = cosh(x) > 0 for all x ∈ R, so by Proposition 5.46 the hyperbolic sine
is strictly increasing. Since limx→∞ sinh(x) = +∞ and limx→−∞ sinh(x) = −∞, the function
sinh : R → R
is called the inverse hyperbolic sine. By Theorem 5.20, for x ∈ R and s = sinh(x) we
obtain
1 1 1
arsinh′ (s) = =q =√ .
cosh(x) 1 + s2
1 + sinh2 (x)
Moreover, the inverse hyperbolic sine has a closed formula. Indeed, starting from sinh(x) = s,
we get
ex − e−x
25 =s =⇒ e2x − 2sex − 1 = 0.
2
Setting y = ex , this becomes y 2 − 2sy − 1 = 0, yielding
p
y =s± 1 + s2 .
√
Since y = ex > 0, the admissible root is y = s + 1 + s2 , hence
p p
ex = y = s +
1 + s2 =⇒ x = log s + 1 + s2 .
In other words, p
arsinh(s) = log s + 1 + s2 , s ∈ R.
The hyperbolic cosine satisfies cosh′ (x) = sinh(x) and cosh′′ (x) = cosh(x) > 0 for all
x ∈ R. Thus, cosh is strictly convex (Corollary 5.54) and has a global minimum at x = 0,
since cosh′ (0) = sinh(0) = 0. For x > 0, cosh′ (x) > 0, so cosh is strictly increasing on [0, ∞).
As cosh(0) = 1 and limx→∞ cosh(x) = +∞, we deduce
is called the inverse hyperbolic cosine. It is differentiable on [1, ∞) and satisfies, for
s = cosh(x) with x > 0 (thus s > 1),
1 1 1
arcosh′ (s) = =p =√ .
sinh(x) cosh(x)2 − 1 s2 − 1
is the inverse function of the strictly increasing bijection tanh : R → (−1, 1), and it satisfies
1
artanh′ (s) = ∀ s ∈ (−1, 1).
1 − s2
Exercise 5.62. — Verify all assertions made in Paragraphs 5.3.4, 5.3.4, and 5.3.4.
In this chapter, we take the idea from Section 1.1 and extend it to the notion of the Riemann
integral, using the concepts of supremum and infimum.
Partitions
Two sets A, B are called disjoint if A ∩ B = ∅. For a collection A of sets, we say that
the sets in A are pairwise disjoint if for all A1 , A2 ∈ A with A1 ̸= A2 it holds that
A1 ∩ A2 = ∅.
Let X be a set. A partition of X is a family P of non-empty pairwise disjoint subsets
of X such that
[
X= P.
P ∈P
In other words, each P ∈ P is non-empty, and every element of X belongs to exactly one
26
P ∈ P.
P2 P3
P1
P4
For the following discussion, we fix two real numbers a < b and work with the compact
interval [a, b] ⊂ R.
182
Chapter 6.1 Step Functions and their Integral
with n ∈ N. The points x0 , . . . , xn are called the division points of the decomposition.
if
{x0 , x1 , . . . , xn } ⊆ {y0 , y1 , . . . , ym }.
26
The notion of refinement defines a partial order on the set of all decompositions of [a, b]. Note
that any two decompositions of [a, b] admit a common refinement given by the union of all
division points.
such that, for each k = 1, . . . , n, the restriction of f to the open interval (xk−1 , xk ) is
constant. In this case, we say that f is a step function with respect to the decomposition
a = x0 < x1 < . . . < xn = b.
x0 = a x1 x2 x3 x4 x5 x6 = b
Figure 6.2: The graph of a step function on the interval [a, b]. Note that the values of f at
the division points of the decomposition are irrelevant for the definition of a step function.
Proof. Let f be a step function with respect to the decomposition a = x0 < x1 < . . . < xn = b,
and let g be a step function with respect to the decomposition a = y0 < y1 < . . . < ym = b.
The union of all division points {x0 , . . . , xn } ∪ {y0 , . . . , ym } defines a new decomposition
that is a common refinement of the two. Since both f and g are constant on each open interval
(zk−1 , zk ), so is the function αf + βg. Thus αf + βg is a step function with respect to this
decomposition.
Remark 6.5. — As in the proof of Proposition 6.3, one can show that the product of two
step functions is again a step function. Moreover, step functions are bounded, since they take
only finitely many values.
26
Remark 6.7. — For non-negative step functions f ≥ 0, the value of the integral (6.1) can
be interpreted geometrically as the total area of the rectangles of height ck and base length
xk − xk−1 . In general, the integral represents the signed net area enclosed between the graph
of f and the x-axis.
At this stage, in (6.1), the symbols and dx should be regarded as purely formal. Histor-
R
ically, the symbol is an elongated S for “sum,” and dx indicates an “infinitesimal length,”
R
i.e. xk − xk−1 in the limit of an infinitely fine decomposition. This notation was introduced
by Leibniz (1646–1716).
+ +
+
x0 = a x1 x2 x3 x4 = b
–
Figure 6.3: For a non-negative step function f ≥ 0, the integral in (6.1) represents the area
of the set {(x, y) ∈ R2 | a ≤ x ≤ b, 0 ≤ y ≤ f (x)}, and in general the signed area.
Remark 6.8. — Definition 6.6 raises a potential issue: a priori, the right-hand side of (6.1)
might depend on the chosen decomposition. To show that this is not the case, let
26 a = y0 < · · · < ym = b
be another decomposition of [a, b] with respect to which f is a step function. We must prove
that
Xn Xm
ck (xk − xk−1 ) = dk (yk − yk−1 ), (6.2)
k=1 k=1
2. By induction on the number of additional division points, (6.2) holds for any refinement.
3. As shown in the proof of Proposition 6.3, any two decompositions admit a common re-
finement. Comparing both sums with the sum corresponding to this common refinement
proves (6.2) in full generality.
Therefore, the value of the integral of a step function is independent of the chosen decom-
position.
Proof. As in the proof of Proposition 6.3, we can find a decomposition a = x0 < . . . < xn = b
such that both f and g (and hence αf + βg) are constant on each interval (xk−1 , xk ). If f
takes the value ck and g the value dk on (xk−1 , xk ), then αf + βg takes the value αck + βdk .
Thus
Z b n
X
(αf + βg)(x) dx = (αck + βdk )(xk − xk−1 )
a k=1
Xn n
X
=α ck (xk − xk−1 ) + β dk (xk − xk−1 )
k=1 k=1
Z b Z b
=α f (x) dx + β g(x) dx,
a a
as claimed.
Proof. As in the proofs of Proposition 6.3, we can find a decomposition a = x0 < . . . < xn = b
such that both f and g are constant on each interval (xk−1 , xk ). Writing ck and dk for their
respective values, the assumption f ≤ g implies ck ≤ dk for all k = 1, . . . , n. Hence
Z b n
X n
X Z b
f (x) dx = ck (xk − xk−1 ) ≤ dk (xk − xk−1 ) = g(x) dx.
a k=1 k=1 a
Exercise 6.12. — Let [a, b] and [b, c] be two compact intervals, and let f1 : [a, b] → R and
f2 : [b, c] → R be step functions. Define
f1 (x), x ∈ [a, b),
f : [a, c] → R, f (x) =
f2 (x), x ∈ [b, c].
26
1. Show that f is a step function on [a, c].
2. Prove that Z c Z b Z c
f (x) dx = f1 (x) dx + f2 (x) dx.
a a b
3. Show that every step function on [a, c] is of the form described above.
Moreover,
sup A = inf B ⇐⇒ for every ε > 0 there exist s ∈ A and t ∈ B s.t. t − s < ε. (6.4)
If f is bounded, then these sets are non-empty. Indeed, if |f | ≤ M , then the constant step
functions
ℓ(x) = −M ∀ x ∈ [a, b], u(x) = M ∀ x ∈ [a, b],
This implies that s ≤ t for all s ∈ L(f ) and t ∈ U(f ), so (6.3) yields
We call a the lower (integration) limit and b the upper (integration) limit, and the
Rb
function f the integrand of the integral a f dx. If f ≥ 0 is Riemann integrable, we interpret
Rb
the number a f dx as the area of the set
{(x, y) ∈ R2 | a ≤ x ≤ b, 0 ≤ y ≤ f (x)}.
Remark 6.15. — For now we only discuss Riemann integrability and the Riemann inte-
gral, so we will simply say “integrable” and “integral”. Note, however, that there is another
fundamental theory, the Lebesgue integral, which we will not cover in this course.
In this case,
Z b Z b Z b Z b
f dx − ℓ dx < ε, u dx − f dx < ε.
a a a a
It is useful to note that the Riemann integral extends the integral of step functions; in
particular, we can speak of the Riemann integral of a step function, see Exercise 6.17.
Exercise 6.17. — Let f : [a, b] → R be a step function. Show that f is Riemann integrable
and that its Riemann integral equals its step-function integral.
Exercise 6.18. — Repeat the proof of Proposition 1.1 and show, in the language of this
R1
section, that f : [0, 1] → R, x 7→ x2 , is Riemann integrable with 0 x2 dx = 31 . Also,
L(f ) = − ∞, 31 and 1
26 U(f ) = 3, ∞ .
Example 6.19. — Not all functions are Riemann integrable. Indeed, consider the function
f : [0, 1] → R defined by
1, x ∈ Q,
f (x) =
0, x ∈
/ Q.
Thus inf U(f ) ≥ 1, and taking u ≡ 1 gives inf U (f ) = 1. A similar argument with lower sums
shows that sup L(f ) = 0. Hence f is not Riemann integrable.
and Z b Z b Z b Z b
f dx − ℓ1 dx < ε, g dx − ℓ2 dx < ε.
a a a a
and
Z b
Z b Z b
(αu1 + βu2 ) − (αℓ1 + βℓ2 ) dx = α (u1 − ℓ1 ) dx + β (u2 − ℓ2 ) dx < (α + β)ε.
a a a
Since ε > 0 is arbitrary, this proves that αf + βg is integrable. Moreover, by the triangle
inequality and Proposition 6.9,
Z b Z b Z b Z b Z b
(αf + βg) dx − α f dx − β g dx ≤ (αf + βg) dx − (αℓ1 + βℓ2 ) dx
a a a a a
Z b Z b Z b
+ (αℓ1 + βℓ2 ) dx − α ℓ1 dx − β ℓ2 dx
27 |a {z a a
}
=0
Z b Z b Z b Z b
+α ℓ1 dx − f dx + β ℓ2 dx − g dx
a a a a
≤ (α + β)ε + αε + βε = 2(α + β)ε.
and
Z b
Z b Z b
(αu1 + βℓ2 ) − (αℓ1 + βu2 ) dx = α (u1 − ℓ1 ) dx + |β| (u2 − ℓ2 ) dx < (α + |β|)ε.
a a a
This implies again that αf + βg is integrable, and the linearity identity holds similarly.
Proof. Since f ≤ g, for any step function ℓ with ℓ ≤ f we have ℓ ≤ g. This implies that
L(f ) ⊆ L(g), therefore
Z b Z b
f dx = sup L(f ) ≤ sup L(g) = g dx.
a a
These satisfy
|f | + f |f | − f
f = f + − f −, |f | = f + + f − , f+ = , f− = .
27 2 2
f ≤ g =⇒ f + ≤ g + , f ≤ g =⇒ f − ≥ g − .
|f |
f
a b a b
f+
f−
a b a b
Figure 6.4: Top left: graph of f . Top right: graph of |f |. Bottom left: graph of f + .
Rb
Bottom right: graph of f − . The integral a f dx is the signed area (positive minus negative),
Rb Rb Rb Rb Rb
whereas a |f | dx is the total area. Moreover, a f dx = a f + dx − a f − dx and a |f | dx =
Rb + Rb −
a f dx + a f dx.
Hence (z1 − z2 )+ + z2+ is greater than or equal to both z1 and 0, and therefore
Rb
Proof. Fix ε > 0. Since f is integrable, there exist step functions ℓ ≤ f ≤ u with a (u−ℓ) dx <
27 ε. Then ℓ+ and u+ are step functions with ℓ+ ≤ f + ≤ u+ .
Since u − ℓ ≥ 0, we have (u − ℓ) = (u − ℓ)+ . Moreover, applying (6.5) with z1 = u(x) and
z2 = ℓ(x), we obtain
Hence Z b Z b Z b
+ + +
(u − ℓ ) dx ≤ (u − ℓ) dx = (u − ℓ) dx < ε,
a a a
Exercise 6.25. — Let a < b < c. Show that f : [a, c] → R is integrable if and only if f |[a,b]
and f |[b,c] are integrable, and in that case
Z c Z b Z c
f dx = f |[a,b] dx + f |[b,c] dx.
a a b
Exercise 6.26. — Let f : [a, b] → R be integrable and λ > 0. Define g : [λa, λb] → R by
g(x) = f (λ−1 x). Show that g is integrable and
Z b Z λb
λ f dx = g dx.
a λa
Exercise 6.27. — Let f : [a, b] → R be integrable. Show that the function F : [a, b] → R
given by Z x
27 F (x) = f (t) dt
a
is continuous.
Exercise 6.28. — Let f : [0, 1] → R be integrable and ε > 0. Show that there exists a
continuous function g : [0, 1] → R such that
Z 1
|f (x) − g(x)| dx < ε.
0
Proof. Without loss of generality, f is increasing (otherwise replace f by −f and use Propo-
sition 6.20). We want to apply Proposition 6.16: given ε > 0, we need to construct step
Rb
functions ℓ, u ∈ SF such that ℓ ≤ f ≤ u and a (u − ℓ) dx < ε.
Fix n ∈ N (to be chosen later) and the uniform partition
k
a = x0 < x1 < . . . < xn = b, xk = a + (b − a).
n
b n n
b−aX
Z X
(u − ℓ) dx = f (xk ) − f (xk−1 ) (xk − xk−1 ) = f (xk ) − f (xk−1 )
a n
k=1 k=1
b−a b−a
= f (xn ) − f (x0 ) = f (b) − f (a) .
n n
integrable.
Figure 6.5: A monotone function, with upper and lower sums arbitrarily close.
Using the additivity property in Exercise 6.25, Theorem 6.29 extends to functions that are
only piecewise monotone.
Proof. Let f : [a, b] → R be continuous and fix ε > 0. By uniform continuity (Theorem 3.39),
there exists δ > 0 such that
Choose a partition a = x0 < . . . < xn = b with xk − xk−1 < δ. For each k set
which exist by Theorem 3.34, and let yk , zk ∈ [xk−1 , xk ] satisfy f (yk ) = ck and f (zk ) = dk .
Then, since |yk − zk | ≤ xk − xk−1 < δ, (6.6) yields dk − ck < ε.
Define now the step functions ℓ, u : [a, b] → R as
such that f |(xk−1 ,xk ) is continuous for all k and both one-sided limits limx→x+ f (x)
k−1
and limx→x− f (x) exist. Equivalently, each f |(xk−1 ,xk ) extends to a continuous function
k
on [xk−1 , xk ].
Proof. Apply Theorem 6.32 to the continuous extensions on each subinterval, and use Exer-
27
cises 6.21 and 6.25.
Most “common” functions are piecewise continuous or piecewise monotone, hence integrable
by Theorems 6.29 and 6.32. Note also that there are continuous functions that are not
monotone on any open subinterval.
Exercise 6.36. — Let C be the space of continuous functions on [a, b] and define I : C → R
by
Z b
I(f ) = f dx.
a
Show that I is continuous with respect to the uniform norm; that is, for every ε > 0 there
27
exists δ > 0 such that
hold?
In general, the pointwise limit of integrable functions need not be integrable. Also, as the
following example shows, even when the pointwise limit f is integrable, one may have that
limn fn ̸= f .
R R
n
2
fn
1 1
n
On the other hand, as the next result shows, uniform convergence is sufficient for both
integrability of the limit and interchange of limit and integral.
ℓ̂ = ℓ − ε ≤ fN − ε ≤ f ≤ fN + ε ≤ u + ε = û
proving (6.7).
In this chapter we study the interplay between the Riemann integral (Chapter 6) and differ-
entiation (Chapter 5). These connections are fundamental for the developments that follow.
28 Remark 7.2. — As the following exercise shows, a primitive may not always exist.
The next result is known as the Fundamental Theorem of (Integral and Differential)
Calculus, going back to Leibniz, Newton, and Barrow
200
Chapter 7.1 The Fundamental Theorem of Calculus
is a primitive of f .
(ii) Every primitive F : [a, b] → R of f has the form (7.1) for some constant C.
Now, given x ∈ (x0 , x0 + δ) ∩ [a, b], it follows from Exercise 6.25 that
Z x Z x0
F (x) − F (x0 ) 1
− f (x0 ) = f (t) dt − f (t) dt − f (x0 )
x − x0 x − x0 a a
Z x
1
= f (t) dt − f (x0 ) .
x − x 0 x0
28
Also, Z x Z x
1 1
f (x0 ) = f (x0 ) dt = f (x0 ) dt.
x − x0 x0 x − x0 x0
Note now that, in the last integral, t ∈ [x0 , x] ⊂ [x0 , x0 + δ) ∩ [a, b]. Hence, it follows from
(7.2) that |f (t) − f (x0 )| < ε, therefore
x
F (x) − F (x0 )
Z
1
− f (x0 ) < ε dt = ε.
x − x0 x − x0 x0
F (x) − F (x0 )
x ∈ [a, b], |x − x0 | < δ =⇒ − f (x0 ) < ε,
x − x0
therefore
F (x) − F (x0 )
F ′ (x0 ) = lim = f (x0 ),
x→x0 x − x0
as desired.
Rx ′
We now prove (ii). Let F be a primitive of f . Then, since a f (t) dt = f (x) (by (i)),
Z x ′
F (x) − f (t) dt = F ′ (x) − f (x) = f (x) − f (x) = 0 ∀ x ∈ (a, b).
a
Rx
By Corollary 5.48, this implies that F (x)− a f (t) dt is constant on [a, b], concluding the proof
of (ii).
f (x0 )
<ε
f (x)
f
28 x0 x
Figure 7.1: This figure illustrates the key estimate in the proof: F (x) − F (x0 ) equals the
rectangle f (x0 )(x − x0 ) plus a red area with absolute value < ε|x − x0 |, hence F (x)−F
x−x0
(x0 )
→
f (x0 ) as x → x0 .
Rx
Proof. Since F is a primitive of F ′ , Theorem 7.4 yields F (x) = a F ′ (t) dt + C. Evaluating
at x = a gives C = F (a).
Exercise 7.8. — Let f : [a, b] → R be discontinuous at at most finitely many points. Show
Rx
that F (x) = a f (t) dt is continuous on [a, b], differentiable at every continuity point of f , and
satisfies F ′ (x) = f (x) at those points.
28
Exercise 7.9. — Let f : [a, b] → R be continuous. Show that there exists ξ ∈ (a, b) with
Z b
f (x) dx = f (ξ) (b − a).
a
Ry
Proof. Fix y0 ∈ J and set G(y) = y0 g(t) dt. Since G′ = g, by the chain rule (see Theo-
rem 5.14) we get (G◦f )′ = G′ (f )f ′ = g(f )f ′ . Integrating this identity and using Corollary 7.6
yields
Z b Z b
′
g(f (x)) f (x) dx = (G ◦ f )′ (x) dx = G(f (b)) − G(f (a))
a a
Z f (b) Z f (a) Z f (b)
= g(t) dt − g(t) dt = g(t) dt.
y0 y0 f (a)
28
Before stating the next result, we note the following: If h : [a, b] → R is continuously
differentiable with h′ ̸= 0, then h′ has constant sign on [a, b], so h is strictly monotone and in-
vertible; h−1 is continuous by Theorem 3.28 and differentiable on (h(a), h(b)) by Theorem 5.20.
Furthermore, since (h−1 )′ = h′ ◦h1
−1 , also (h
−1 )′ is continuous.
Z b Z f (b)
g(y)
g(f (x)) dx = dy.
a f (a) f ′ (f −1 (y))
28 Since 1
f ′ ◦f −1
= (f −1 )′ (recall Theorem 5.20), the result follows.
whenever both limits exist and the sum is well-defined (we do not allow the indetermi-
nate form ∞−∞). Here the first limit is taken over a ∈ I with c < a < x0 (interpreting
a → −∞ if c = −∞) and the second over b ∈ I with x0 < b < d (interpreting b → +∞
if d = ∞). If the value is finite we say the integral converges; if it is ±∞ we say it di-
verges to ±∞; otherwise, it does not converge. When defined, the value is independent
of the choice of x0 .
29
Example 7.14. — Consider the integral of f (x) = x1 over the interval I = (0, 1). The
function f is continuous, and hence locally integrable, on I. However, f is unbounded near 0,
so it is not integrable on [0, 1] in the usual Riemann sense, and the integral over (0, 1) must
be understood as an improper integral.
Since the only problem is at 0 and the integrand is bounded and continuous up to 1, we
can write Z 1 Z 1
1 1
dx = lim dx.
0 x a x
a→0+
therefore Z 1
1
dx = lim (− log a) = +∞.
0 x a→0+
R∞
Example 7.16. — For α ∈ R, we want to compute 1 x−α dx. Note that
b b b
x1−α b1−α − 1
Z Z
−α dx
x dx = = for α ̸= 1, = log b for α = 1,
1 1−α 1 1−α 1 x
so letting b → ∞ we obtain
∞
1
Z
−α
, α > 1,
x dx = α − 1
1
∞, α ≤ 1.
As we now show, when f ≥ 0 the improper integral over an interval always exists in the
extended sense: it either converges to a finite value or diverges to +∞.
In particular, the improper integral over I always exists in the extended sense and equals
+∞ whenever the supremum is +∞.
Rx Rb
Proof. Since f ≥ 0, the maps a 7→ a 0 f (for a < x0 ) and b 7→ x0 f (for b > x0 ) are monotone,
hence the limits L− , L+ exist in [0, ∞]. Also, for any c < a < x0 b < d,
Z b Z x0 Z b
af = f+ f.
a a x0
Rd
which equals the definition of c f above.
2
Since x2 ≥ x for x ≥ 1, we have e−x ≤ e−x on [1, ∞), hence
Z ∞ Z ∞ b
2
e−x dx ≤ e−x dx = lim − e−x = e−1 < ∞.
b→∞ 1
1 1
R −1 2 R∞ 2 R1 2 R1
By symmetry, −∞ e−x dx = 1 e−x dx < ∞. Finally, −1 e−x dx ≤ −1 1 dx = 2. Thus the
improper integral converges.
N +1 Z N +1 N
29
X X
f (n) ≤ f (x) dx ≤ f (n).
n=1 0 n=0
In particular,
∞
X Z ∞
f (n) converges ⇐⇒ f (x) dx converges.
n=1 0
where ⌊x⌋ is the rounding function (i.e. the largest integer ≤ x), while ⌈x⌉ denotes the smallest
integer ≥ x. Then ℓ ≤ f ≤ u, and for N ≥ 1,
N
X +1 Z N +1 Z N +1 Z N +1 N
X
f (n) = ℓ(x) dx ≤ f (x) dx ≤ u(x) dx = f (n).
n=1 0 0 0 n=0
f (2)
f (3)
f
0 1 2 3 4 5 6 7 8 9 10
Example 7.20. — The harmonic series can be written as {f (n)}∞ n=0 with f (x) = 1+x ,
1
N -th partial sum. Applying the integral test with f (x) = 1+x
1
, we obtain
N +1 Z N +1 N
1 dx 1
29
X X
≤ ≤ .
1+n 0 1+x 1+n
n=1 n=0
the integral is Z N +1
dx N +1
= log(1 + x) 0 = log(N + 2),
0 1+x
and the right-hand side is
N N +1
X 1 X 1
= = HN +1 .
1+n n
n=0 n=1
Z ∞
dx
< ∞.
0 (1 + x)2
1 − ε ≤ bn , γn ≤ 1 + ε for all n ≥ N.
Then take the lim sup in these inequalities and finally let ε → 0.
∞
X an
F (x) = xn+1
n+1
n=0
an−1
Proof. Set ρ = lim supn→∞ n |an |, so that R = ρ−1 . Define c0 = 0 and cn = for n ≥ 1,
p
n
so F (x) = ∞ n=0 cn x . Noticing that
n
P
r n−1
n 1 n
p
n
p
n−1
|cn | = |an−1 | ,
n
q
it follows from (7.4) and Remark 7.21 (applied with bn = n n1 and γn = n )
n−1
that
p
n n−1
p
lim sup |cn | = lim sup |an−1 | = ρ,
n→∞ n→∞
This implies that G and f have the same radius of convergence (so R̄ = R) and that g = G′ =
(f − a0 )′ = f ′ .
Exercise 7.25. — Let f (x) = ∞ n=0 an x have radius of convergence R > 0. Show that f
n
P
and set R = min{Rf , Rg }. Prove that if f (x) = g(x) for all x ∈ (−R, R), then an = bn for all
n. In particular, Rf = Rg .
29
f (x)
f ′ (x) = α ∀ x ∈ (−1, 1). (7.6)
1+x
f ′
(c) Let g(x) = (1 + x)α and use (7.6) to prove g = 0 on (−1, 1). Conclude the validity of
(7.5) from the fact that f (0) = g(0) = 1.
Example 7.28. — We have already seen in Example 4.23 that, as a consequence of the
Leibniz criterion (Proposition 4.22), the alternating harmonic series converges. However, we
were unable to determine the value of the series. We now show that
∞
X (−1)n+1
= log(2).
n
n=1
Using the geometric series and the fundamental theorem of calculus, for x ∈ (−1, 1) we
have
∞
1 1 X
(log(1 + x))′ = = = (−1)n xn ,
1+x 1 − (−x)
n=0
xk
For x ∈ [0, 1], the terms ak = k are nonnegative, decreasing, and converge to 0, so by
Proposition 4.22,
2n 2n+1
X (−1)k+1 k
X (−1)k+1 k
x ≤ log(1 + x) ≤ x ∀ n ∈ N.
k k
k=1 k=1
2n 2n+1
29 X (−1)k+1 X (−1)k+1
≤ log(2) ≤ .
k k
k=1 k=1
Now, using again Proposition 4.22, we can let n → ∞ to get the desired result.
Example 7.29. — Similarly to what we did in the previous exercise, we note that
∞
′ 1 X
arctan (x) = = (−1)k x2k ∀ x ∈ (−1, 1),
1 + x2
k=0
hence Z x ∞
X (−1)k
1
arctan x = dt = x2k+1 .
0 1 + t2 2k + 1
k=0
2n+1 2n
X (−1)k 2k+1 X (−1)k
x ≤ arctan(x) ≤ x2k+1 ∀ n ∈ N.
2k + 1 2k + 1
k=0 k=0
2n+1 2n
X (−1)k π X (−1)k
≤ arctan(1) = ≤ ∀ n ∈ N,
2k + 1 4 2k + 1
k=0 k=0
Example 7.30 (Integral Sine). — The integral sine is the primitive function Si : R → R
of the continuous function
29 (
sin(x)
x if x ̸= 0
x ∈ R 7→
1 if x = 0
Rx sin(t)
with the normalisation Si(0) = 0, that is Si(x) = 0 t dt. Thanks to Theorem 7.23, the
function Si can be expressed as a power series:
x ∞
xX ∞
(−1)n 2n (−1)n
Z Z
sin(t) X
Si(x) = dt = t dt = x2n+1
0 t 0 n=0 (2n + 1)! (2n + 1)!(2n + 1)
n=0
for all x ∈ R.
In Leibniz notation, f = dF
dx and g = dx . This leads to the notation f dx = dF and g dx = dG,
dG
Z Z
g(f (x)) f ′ (x) dx = g(u) du + C (7.8)
where we used the change of variables u = f (x). The substitution rule is also called change
of variable, as one has replaced the variable u in g(u) du by u = f (x). In Leibniz notation
R
this is very natural: if u = f (x) then du = f ′ (x) dx, and (7.8) follows.
We also recall the second form of the substitution rule: if f ′ ̸= 0 we can set x = f −1 (u) so
that du
dx
= (f −1 )′ (u), and obtain
Z Z
dx
g(f (x)) dx = g(u) du + C, (7.9)
du
30
Since ex dx = ex + C, we conclude that
R
Z
xex dx = xex − ex + C.
We note that it is sufficient to use only one integration constant C in such calculations, since
several such constants can be combined into one.
Suggestion: To ensure that the final result is correct, differentiate the result and check if you
get the original function. For instance, in this case, one can easily check that
Exercise 7.33. — Give a recursive formula for calculating the indefinite integrals
Z Z Z
n x n
x e dx , x sin(x) dx , xn cos(x) dx
for n ∈ N.
for all s, a, b ∈ R. Note that the case s = −1 needs to be treated separately, in analogy with
Example 7.7(6)-(7).
Z Z
2
cos (θ) dθ = cos(θ) sin′ (θ) dθ
Z
= cos(θ) sin(θ) − cos′ (θ) sin(θ) dθ + C
Z
= cos(θ) sin(θ) + sin2 (θ) dθ + C.
therefore
Z Z
1
2 cos2 (θ) dθ = cos(θ) sin(θ) + θ + C cos2 (θ) dθ =
=⇒ cos(θ) sin(θ) + θ + C.
2
(Note that, since C ∈ R is arbitrary, in the last formula we still write C in place of 2 .)
C
This
proves that
r2
Z p Z
2
cos2 (θ) dθ =
2 2
r − x dx = r sin(θ) cos(θ) + θ + C.
2
r2
Z p
1 p x
r2 − x2 dx = x r2 − x2 + arcsin r + C.
2 2
Substitutions like in Example 7.39 are called trigonometric substitutions. We will not
always argue carefully in these calculations and will rather trust the Leibniz notation, but
recall that, to apply (7.9), there must be invertibility of the function when we express the old
variable by the new variable.
For the following list of trigonometric substitutions, let n ∈ Z.
n
30 • In expressions of the form (a2 − x2 ) 2 for a > 0, as already seen in the example above,
one considers the substitution x = a sin(θ) with θ ∈ (− π2 , π2 ), giving dx = a cos(θ) dθ
1
and (a2 − x2 ) 2 = a cos(θ).
n
• In expressions of the form (a2 + x2 ) 2 for a > 0, the substitution
n x = a tan(θ) with θ ∈
n
(− 2 , 2 ) yields dx = cos2 (θ) dθ and (a + x ) 2 = cos(θ) .
π π a 2 2 a
• Although this is not a trigonometric substitution, we still note the following: For the
n n
expression x(a2 − x2 ) 2 or the expression x(a2 + x2 ) 2 , the substitutions u = a2 − x2 and
u = a2 + x2 , respectively, allow us to compute the indefinite integrals.
Example 7.37. — (i) Given a > 0, using the substitution x = a tan(θ), recalling that
1
a
(a2 + x2 ) 2 = cos(θ) and dx = cosa2 (θ) dθ (recall that tan′ (θ) = cos12 (θ) ), we get
cos3 (θ) a
Z Z Z
1 1 1
3 dx = dθ = 2 cos(θ) dθ = sin(θ) + C
(a2 + x2 ) 2 a3 cos2 (θ) a a2
1 x
= 2
tan(θ) cos(θ) + C = √ + C.
a a2 a2 + x2
Certain indefinite integrals can be computed with hyperbolic substitutions. For instance,
n
for expressions of the form (x2 − a2 ) 2 with a ∈ R, the substitution x = a cosh(u) yields
1
dx = a sinh(u) du and (x2 − a2 ) 2 = a sinh(u).
Example 7.38. — Using the substitution x = cosh(u) (so dx = sinh(u) du), we compute
Z p Z q Z
x2 − 1 dx = cosh2 (u) − 1 sinh(u) du = sinh2 (u) du.
In analogy to the argument used in Example 7.36, we compute sinh2 (u) du as follows:
R
Z Z
2
sinh (u) du = cosh(u) sinh(u) − cosh2 (u) du + C
Z
1 + sinh2 (u) du + C
= cosh(u) sinh(u) −
Z
= cosh(u) sinh(u) − u − sinh2 (u) du + C,
This yields
cosh(u) sinh(u) − u
Z Z
2
2 sinh (u) du = cosh(u) sinh(u)−u+C =⇒ sinh2 (u) du = +C,
2
hence √
cosh(u) sinh(u) − u x x2 − 1 − arcosh(x)
Z p
30 2
x − 1 dx = +C = + C.
2 2
Another method that we would like to mention briefly here is the so-called half-angle
method (or Weierstrass substitution). This is useful for the integral of expressions like
cos2 (x)+cos(x)+sin(x)
sin(x) or , see also Remark 7.42 below. We show this method in detail in
1
1+sin(x)
the next example.
Example 7.39. — We want to compute sin(x) dx, and we consider the change of variable
R 1
u = tan 2 . We can note that, by the doubling angle formulas for sine and cosine (see (4.14)),
x
it follows that
sin( x )
x x 2 cos 2x 2 tan x2
(2) 2u
sin(x) = 2 sin cos = = 2 x
=
2 2 sin2 ( x2 ) 1 + tan 1 + u2
1 + cos2 x 2
(2)
2
and analogously cos(x) = 1−u1+u2
.
Furthermore, the relation u = tan x
implies that x = 2 arctan(u), therefore dx = 2
2 1+u2
du
(recall that arctan′ (s) = 1+s
1
2 ).
1 + u2 2
Z Z Z
1 1 x
dx = du = du = log |u| + C = log tan 2 + C.
sin(x) 2u 1 + u2 u
The integrals (7.10) and (7.11) are calculated with substitution u = x−a, for (7.12) substitute
30 u = xa , for (7.13) and (7.14) substitute u = a2 + x2 .
To integrate a general rational function, we use what is called the partial fraction decom-
position of rational functions. Let p, q be polynomials without nontrivial common divisors
such that q ̸= 0 and deg p < deg q.
First, factorize the polynomial q into linear and quadratic factors
x4 + 1
Z
Example 7.40. — We want to calculate the indefinite integral dx. We first
x2 (x + 1)
rewrite the denominator:
x4 + 1 x4 + 1
= .
x2 (x + 1) x3 + x 2
We now perform polynomial division with remainder. We want to write
where deg r < 3. The leading term of x4 + 1 is x4 , and the leading term of x3 + x2 is x3 , so
4
the first term of the quotient must be xx3 = x:
x · (x3 + x2 ) = x4 + x3 .
−x3
Now the leading term of the remainder is −x3 , so the next term in the quotient is x3
= −1:
−1 · (x3 + x2 ) = −x3 − x2 .
(−x3 + 1) − (−x3 − x2 ) = x2 + 1.
The remainder is now x2 + 1, which has degree 2 < 3, so the division stops. Thus
and therefore
x4 + 1 x2 + 1 x2 + 1
30 = x − 1 + = x − 1 + .
x3 + x 2 x3 + x 2 x2 (x + 1)
We now look for a partial fraction decomposition of
x2 + 1
.
x2 (x + 1)
For a factor x2 , the general rule is that the numerator should be a polynomial of degree at
most 1 (one less than the power of the factor), so we take a numerator of the form ax + b.
For a simple linear factor x + 1, the numerator is a polynomial of degree at most 0, that is, a
constant c. Thus the most general form of the decomposition is
x2 + 1 ax + b c
2
= 2
+
x (x + 1) x x+1
Comparing the coefficients of x2 , x, and the constant term, we obtain the linear system
a + c = 1, a + b = 0, b = 1,
x4 + 1 x2 + 1 1 1 2
2
= x − 1 + 2
=x−1− + 2 + ,
x (x + 1) x (x + 1) x x x+1
and therefore
x4 + 1
Z Z Z Z Z Z
1 1 1
dx = x dx − 1 dx − dx + dx + 2 dx
x2 (x + 1) x x2 x+1
x2 1
= − x − log |x| − + 2 log |x + 1| + C.
2 x
polynomial x + 2x + 2 has no real zeros. For the partial fraction decomposition, we look for
2
a, b, c ∈ R such that
1 a bx + c
2
= + 2 .
x(x + 2x + 2) x x + 2x + 2
To find a, b, c we multiply both sides by x(x2 + 2x + 2) and get
thus
a + b = 0, 2a + c = 0, 2a = 1,
In some cases, the above procedure may also lead to compute integrals of the form
1
dx for an a ∈ R and n ≥ 2, which (as explained previously) we can handle with the
R
(a2 +x2 )n
Remark 7.42. — Now that we know how to integrate rational functions, we can rediscuss
the half-angle method introduced before. This allows one to compute the integral of rational
expressions in sine and cosine. In fact, with the substitution u = tan x2 , using that
2u 1 − u2 2
sin(x) = , cos(x) = , dx = du,
1 + u2 1 + u2 1 + u2
(see Example 7.39), one ends up with the integral of a rational function in u.
30
cos(x)
Exercise 7.43. — Calculate the indefinite integral dx using the substitution
R
2+sin(x)
u = tan x2 .
Remark 7.44. — Sometimes, one substitution or the other is carried out because there
is a nested function in the function to be integrated, and there is simply no other method
√
available. For example, in the integral sin( x) dx, none of the mentioned methods are
R
√
available, but one is tempted to set u = x, and this indeed leads to an integral that one can
solve. Similarly, in an integral of the form 1+e x dx, one sets u = e .
R 1 x
Z 1
Example 7.45. — We compute the improper integral log(x) dx (this is improper since
0
x 7→ log(x) is unbounded as x → 0+ ). Recalling (7.32) and Example 3.64, we have
Z 1 Z 1 1
31
log(x) dx = lim log(x) dx = lim x log(x) − x a
0 a→0+ a a→0+
= lim log(1) − 1 − a log(a) + a = −1.
a→0+
Z π
2
Exercise 7.46. — Calculate tan(x) dx.
0
Z ∞
Exercise 7.47. — Decide for which p ∈ R≥0 the improper integral x sin(xp ) dx con-
0
verges.
To verify that this improper integral indeed converges, we examine the integration limits 0
and ∞ separately. For 0 < a < b we find, using integration by parts,
Z b Z b Z b
s−1 −x 1 s ′ −x 1 s −x b 1
x e dx = (x ) e dx = x e a
+ xs e−x dx. (7.16)
a s a s s a
We obtain
b
1 s −x b 1 b s −x
Z Z
s−1 −x
x e dx = lim x e a
+ x e dx
0 a→0 s s a
1 b s −x
Z
1
= bs exp(−b) + x e dx,
s s 0
where the integral on the right is an actual Riemann integral since the function xs e−x is
continuous on [0, b]. To investigate the upper limit of integration, we note that there exists
31 R > 0 such that ex > xs+2 holds for all x > R. Thus
Z ∞ Z R Z ∞
s −x s −x
x e dx ≤ x e dx + x−2 dx < ∞
0 0 R
for all s ∈ (0, ∞), from which one can deduce that the Gamma function extends the factorial
function from N to (0, ∞). In fact
Z ∞ Z ∞ ∞
0 −x
= e−x dx = e−x 0 = e0 = 1,
Γ(1) = x e dx =
0 0
approximates the function f within an error o(|x − x0 |) as x → x0 , see (5.2). The idea behind
Taylor’s theorem is that the “quality” of the approximation can be increased by considering
higher-order polynomials instead of affine approximations.
In this section, it will be convenient to use the following abuse of notation: given a, b ∈ R,
irrespective of the order between a and b, [a, b] denotes the interval between them. In other
words, for all a, b ∈ R, [a, b] and [b, a] denote the same interval.
We also recall that, if a < b, then
Z b Z b
f (x) dx ≤ |f (x)| dx,
a a
31
see Theorem 6.24. If instead b < a, then a minus sign appears (recall (7.3)) and we get
Z b Z a Z a Z b Z b
f (x) dx = f (x) dx ≤ |f (x)| dx = − |f (x)| dx = |f (x)| dx .
a b b a a
Note that, with this choice of the coefficients, P (k) (x0 ) = f (k) (x0 ) for k ∈ {0, . . . , n}.
We will state and prove different versions of Taylor’s Theorem. We begin with this first
version:
Remark 7.49. — In the above theorem, the assumption that f is an n-times contin-
uously differentiable function guarantees that the integral of the continuous function t 7→
n−1
f (n) (t) (x−t)
(n−1)! exists.
31 as desired.
To explain the idea behind the inductive step, assume first n = 2 (so f is twice continuously
differentiable). Then, in the integral above, we can apply integration by parts to the functions
f ′ (t) and g(t) = t − x. Indeed, since g ′ = 1 and g(x) = 0, we get
Z x
f (x) = f (x0 ) + f ′ (t)g ′ (t) dt
x0
x
Z x
= f (x0 ) + f ′ (t)g(t) x0 − f ′′ (t)g(t) dt
x0
Z x
′
= f (x0 ) + f (x0 )(x − x0 ) + f ′′ (t)(x − t) dt
x0
x
(x − t)1
Z
= P1 (x) + f (2) (t) dt.
x0 1!
n (x−t)n−1
for all x ∈ [a, b]. If we set g(t) = − (x−t)
n! , then g (t) =
′
(n−1)! and it follows from integration
by parts that
n−1 Z x
X f (k) (x0 ) k
h
(n)
ix
f (x) = (x − x0 ) + f (t)g(t) − f (n+1) (t)g(t) dt
k! x0 x 0
k=0
n−1
X f (k) (x0 ) Z x
(x − x0 )n (x − t)n
= (x − x0 )k + f (n) (x0 ) + f (n+1) (t) dt
k! n! x 0
n!
k=0
n Z x
X f (k) (x0 ) k (x − t)n
= (x − x0 ) + f (n+1) (t) dt.
k! x0 n!
k=0
Next, we prove the following alternative version of Taylor’s Theorem. Here, we do not
require f (n) to be continuous, but only to exist. Note that in the case n = 1, this result
corresponds to the Mean Value Theorem 5.31.
f (n) (ξL )
f (x) = Pn−1 (x) + (x − x0 )n . (7.20)
31 n!
Remark 7.51. — If x = x0 , the formula holds trivially: one may take ξL = x0 , since
f (n) (ξL )
f (x0 ) = Pn−1 (x0 ) and (x0 − x0 )n = 0.
n!
Proof. Fix x ∈ (a, b). Without loss of generality, assume x > x0 (the case x < x0 is analogous)
and consider the function g : (a, b) → R defined as
n−1
f (n−1) (t) X f (k) (t)
g(t) = f (t) + f (1) (t)(x − t) + . . . + (x − t)n−1 = (x − t)k . (7.21)
(n − 1)! k!
k=0
Then g(x) = f (x) and g(x0 ) = Pn−1 (x). Also, its derivative is given by
n−1 n−1
′
X f (k+1) (t) X f (k) (t)
g (t) = (x − t)k − k(x − t)k−1
k! k!
k=0 k=0
n−1 n−1
X f (k+1) (t) X f (k) (t)
= (x − t)k − (x − t)k−1
k! (k − 1)!
k=0 k=1
n−1 n−2
X f (k+1) (t) X f (k+1) (t) f (n) (t)
= (x − t)k − (x − t)k = (x − t)n−1 .
k! k! (n − 1)!
k=0 k=0
Hence, applying the Cauchy Mean Value Theorem 5.35 in the interval [x0 , x] to the functions
g(t) and h(t) = −(x − t)n , we deduce the existence of a point ξL ∈ (x0 , x) such that
31 f (n) (ξL )
f (x) − Pn−1 (x) g(x) − g(x0 ) g ′ (ξL ) (n−1)! (x − ξL )n−1 f (n) (ξL )
= = = = .
(x − x0 )n h(x) − h(x0 ) h′ (ξL ) n(x − ξL )n−1 n!
We can now state our two versions of Taylor’s approximation, using the little-o and the big-O
notation.
therefore
x
(x − t)n−1 (x − x0 )n
Z
f (n) (x0 ) dt = f (n) (x0 ) .
x0 (n − 1)! n!
Hence, we can write
Z x
(x − x0 )n
(n)
(x − t)n−1
f (x) = Pn−1 (x) + f (x0 ) + f (n) (t) − f (n) (x0 ) dt
n! x0 (n − 1)!
Z x (7.24)
(x − t)n−1
= Pn (x) + f (n) (t) − f (n) (x0 ) dt.
x0 (n − 1)!
Now, given ε > 0, it follows from the continuity of f (n) at x0 that there exists δ > 0 such that
|f (n) (x)−f (n) (x0 )| < ε for all x ∈ (x0 −δ, x0 +δ)∩[a, b]. Therefore, if x ∈ (x0 −δ, x0 +δ)∩[a, b],
we can bound the integrand in the last integral by
(x − t)n−1 |x − t|n−1
f (n) (t) − f (n) (x0 ) ≤ |f (n) (t) − f (n) (x0 )|
(n − 1)! (n − 1)!
|x − t|n−1
<ε ∀ t ∈ [x0 , x].
(n − 1)!
Proof. Given x ∈ [a, b], we apply (7.20) to find a point ξL ∈ [x0 , x] such that
f (n) (ξL )
f (x) − Pn−1 (x) = (x − x0 )n .
n!
32 Since |f (n) (ξL )| ≤ M , this implies
M
|f (x) − Pn−1 (x)| ≤ |x − x0 |n ,
n!
Taylor’s Theorem allows us to obtain more accurate approximations when f has higher regu-
larity.
1
f (x) = f (x0 ) + f ′ (x0 )(x − x0 ) + f ′′ (x0 )(x − x0 )2 + o(|x − x0 |2 ) as x → x0 .
2
Hence, in the case when f is smooth, the bound on f − Pn provided by Corollary 7.53
is often more convenient.
Example 7.55. — We illustrate how Taylor expansions can be used to compute limits and
to obtain expansions of more complicated functions.
sin(x) − x
1. Compute the limit lim .
x→0 x3
We consider the Taylor polynomial of sin at 0 of degree 3. Since
0 2 −1 3 x3
32 P3 (x) = 0 + 1 · x + ·x + ·x =x− .
2 6 6
x3
sin(x) = P3 (x) + O(x4 ) = x − + O(x4 ) as x → 0.
6
We stop the expansion at order 3 because the limit involves x3 in the denominator; any
term of order ≥ 4 will disappear in the limit.
Then x3 x3
sin(x) − x = x − + O(x4 ) − x = − + O(x4 ),
6 6
and thus 3
sin(x) − x − x6 + O(x4 ) 1
= = − + O(x) as x → 0.
x3 x3 6
Hence
sin(x) − x 1
lim =− .
x→0 x3 6
x3
sin(x) = x − + O(x4 ) as x → 0,
6
All these terms are of order at least x5 , so they may be merged into a single remainder
6
term O(x5 ). The term x36 can also be absorbed into the remainder for the same reason.
This proves that
x4
sin2 (x) = x2 − + O(x5 ),
3
and the Taylor polynomial of sin2 at 0 of degree 4 is
x4
P4 (x) = x2 − .
3
This illustrates a general strategy: once we know the expansion of a function (here
sin), we can obtain expansions of combinations of that function (here sin2 ) by algebraic
operations on the corresponding Taylor polynomials.
32
x3
sin(x) = x − + O(x4 ) as x → 0.
6
These coefficients agree with those appearing in the power series expansion of sin. In Sec-
tion 7.4.2 below, we will see that sin is an analytic function, meaning that its Taylor series
around 0 actually converges to sin(x). For such functions, the Taylor polynomial of degree n
is simply the truncation of an infinite series that represents the function itself.
Example 7.57. — We can use the Taylor approximation to refine the discussion in Section
5.2.1. Let f : (a, b) → R be an n-times continuously differentiable function. Suppose x0 ∈
(a, b) satisfies
f ′ (x0 ) = . . . = f (n−1) (x0 ) = 0.
• If f (n) (x0 ) < 0 and n is even, then f has an isolated local maximum in x0 .
• If f (n) (x0 ) > 0 and n is even, then f has an isolated local minimum in x0 .
All three statements follow from (7.20), which, in this case, takes the form
f (n) (ξL )
f (x) = f (x0 ) + (x − x0 )n , ξL ∈ (x0 , x).
n!
Indeed, if f (n) (x0 ) > 0, by continuity there exists δ > 0 such that f (n) (ξL ) > 0 for ξL ∈
(x0 , x) ⊂ (x0 − δ, x0 + δ). If n is even, then (x − x0 )n > 0 for x ̸= x0 and we deduce that
f (x) > f (x0 ) for x ∈ (x0 − δ, x0 + δ) with x ̸= x0 . If n is odd, then (x − x0 )n changes sign
when considering x > x0 and x < x0 , so x0 is not a local extremum of f .
On the other hand, if f (n) (x0 ) < 0 and n is even, the same argument as above shows that
f (x) < f (x0 ) for x ∈ (x0 − δ, x0 + δ) with x ̸= x0 , while in the case n odd x0 is not a local
extremum of f .
then this infinite series should converge to f (x). Unfortunately, this is not true in general:
32
only rather special smooth functions enjoy this property.
Note that the Taylor series is centered at x0 instead of 0 (i.e., xn is replaced with (x−x0 )n ).
Hence, all theorems about power series from Section 4.4 still hold, but taking into account
that now x0 plays the role of the center. In particular, if the series has radius of convergence
R > 0, then it converges for all x ∈ (x0 − R, x0 + R), while it diverges for |x − x0 | > R.
In other words, analytic functions f : I → R are characterized by the fact that, for every
point x0 ∈ I, there exists a power series that converges to f in a neighborhood of x0 .
As the next example shows, there are smooth functions f whose Taylor series converges to
a function different from f .
As shown in Exercise 5.24, ψ is smooth on R and satisfies ψ (n) (0) = 0 for all n ∈ N. Hence,
the Taylor series of the function ψ at the point x0 = 0 is the zero series:
∞ ∞
X ψ (n) (0) X 0 n
xn = x = 0.
n! n!
n=0 n=0
This series has an infinite radius of convergence and converges to the function 0. Since
ψ(x) > 0 holds for all x > 0, the Taylor series does not converge to ψ, and so ψ is not analytic
at the point x0 = 0.
The next result provides a criterion that guarantees that the Taylor series of f converges
to f in a neighborhood of x0 .
Then f is analytic at x0 .
Proof. We first estimate the radius of convergence R of the Taylor series. If we define an =
f (n) (x0 )
, then the Taylor series is equal to ∞
n=0 an (x − x0 ) . Thus, thanks to our assumption
n
P
n!
on the size of |f (n) |, it follows that
C0 An n!
|an | ≤ = C0 An .
n!
|f (n) (ξL )|
|f (x) − Pn−1 (x)| ≤ |x − x0 |n ≤ C0 An |x − x0 |n ≤ C0 (Aδ)n .
n!
∞
X f (n) (x0 )
f (x) = lim Pn−1 (x) = (x − x0 )n ∀ x ∈ (x0 − δ, x0 + δ) ∩ I,
n→∞ n!
n=0
as desired.
Exercise 7.62. — 1. Show that the functions exp, sin, sinh satisfy the property (7.26)
on any interval [a, b] ⊂ R.
2. Show that the function log satisfies (7.26) on any interval [a, b] ⊂ (0, ∞).
3. Let f, g : [a, b] → R be functions satisfying (7.26). Show that f + g and f · g also satisfy
this property (possibly with different constants C0 and A).
Setting up and solving differential equations is one of the main practical uses of calculus. Such
equations are used in physics, chemistry, biology, and many other sciences. They are also
central in areas like structural engineering, modern economics, and information technology.
Although derivatives are usually denoted using ′ (so u′ , u′′ , etc.), it is common to use a
dot to denote derivatives with respect to time (so u̇, ü, etc.).
234
Chapter 8.1
In many examples the independent variable is time t and the equation describes the evo-
lution of a system, but we keep the generic notation x unless we want to stress the time
interpretation.
ODEs can be classified according to several criteria:
1. Order: An ODE is of order n if u(n) is the highest derivative appearing in the equation.
For instance:
3. Homogeneity (for linear ODEs): For a linear ODE, we say it is homogeneous if all terms
involve the function or its derivatives. Equivalently, if u is a solution then Au is a
solution for all A ∈ R. If there is an additional term that does not depend on u (a
“forcing term”), the equation is non-homogeneous.
Example 8.2. — We now present some classic examples of ODEs and their applications.
In each case we indicate what plays the role of the unknown u.
“The rate of heat loss of a body is proportional to the difference between its
temperature and the temperature of the surrounding environment.”
If T (t) denotes the temperature of the object at time t, the law gives
Ṫ (t) = −k T (t) − Tenv ,
where:
Here the unknown function is u(t) = T (t), and the given data are k and Tenv . This is a
linear, non-homogeneous, first-order ODE.
2. Harmonic Oscillator: Consider a mass attached to a spring. Let x(t) denote its dis-
placement from equilibrium. The restoring force is proportional to x:
Fspring = −kx,
mẍ(t) = −kx(t),
or equivalently
ẍ(t) + ω 2 x(t) = 0,
q
where ω = m k
> 0 is the angular frequency. Here u(t) = x(t) is the unknown, and ω
33 is a given parameter. This is linear, homogeneous, and second order.
If we also take into account friction proportional to the velocity ẋ, we obtain the damped
harmonic oscillator:
ẍ(t) + 2ζω ẋ(t) + ω 2 x(t) = 0,
where ζ ≥ 0 is the damping ratio. This equation models many vibrating systems in
physics and engineering.
where:
Here the role of u is played by P , while r and K are given parameters. This is a nonlinear
first-order ODE.
This is linear, homogeneous, and second order. The unknown is u(x), and α is a given
parameter. Its solutions are the Bessel functions, which appear, for instance, in problems
of heat conduction and wave propagation in cylindrical geometries, and in quantum
mechanics.
where α > 0 is a given constant. The corresponding solutions are called Airy functions.
They arise, for example, in quantum mechanics when studying a particle in a linear or
triangular potential.
So far, we have only considered single equations, but one can also study systems of ODEs
with several unknown functions u1 , . . . , un . We will not go into this now, but many ideas are
similar.
33
In addition, solutions are often required to satisfy extra conditions such as u(0) = 0
(prescribed position at time 0) and/or u′ (0) = 1 (prescribed velocity at time 0). When these
conditions are imposed at a single time (typically t = 0), they are called initial conditions.
More general conditions (for instance at two different points, such as u(0) = 0 and u(1) = 1)
are called boundary conditions.
Later we shall see that, under suitable assumptions on the data (for example on a function
f appearing in the equation), prescribing initial conditions often leads to a unique solution.
This is the content of the Cauchy–Lipschitz (or Picard–Lindelöf) theorem.
In other words, the set of solutions of (8.2) forms a one-dimensional linear subspace of
C 1 (I).
Remark 8.4. — In the previous result, solutions are written using a primitive F of f .
Since primitives are defined up to an additive constant, we can replace F by F + C for any
C ∈ R. This amounts to replacing Ae−F (x) by Ae−C e−F (x) , and since A ∈ R is arbitrary, this
does not change the set of solutions.
This is of the form u′ (x) + f (x)u(x) = 0 with f (x) = 3, and a primitive of f is F (x) = 3x.
By Theorem 8.3, all solutions are of the form
2
u′ (x) − u(x) = 0, x ∈ (0, ∞).
x
2)
u(x) = Aelog(x = Ax2 , A ∈ R.
Proof. If H is a primitive of geF , then H + A is also a primitive for any constant A. Hence,
by the same computation as the one performed above, it follows that
Conversely, let u be any solution of (8.3), and set v(x) = u(x) − H(x)e−F (x) . Then
Thus v solves the homogeneous equation (8.2). By Proposition 8.3, we have v(x) = Ae−F (x)
for some constant A. Therefore,
2
u′ (x) − 2xu(x) = ex , u(0) = 1, (8.4)
2
on R. Here u is the unknown, and f (x) = −2x, g(x) = ex are given. According to Theo-
rem 8.6, we first find a primitive of f :
F (x) = −x2 .
Then we consider
2 2
g(x)eF (x) = ex e−x = 1,
2
u(x) = (x + A)ex .
2
u(x) = (x + 1)ex . (8.5)
Remark 8.8. — If one forgets the formula from Theorem 8.6, it is enough to remember
the following procedure for solving (8.3). We start from
We look for w such that the left-hand side is the derivative of u(x)ew(x) , that is
′
u(x)ew(x) = u′ (x)ew(x) + w′ (x)u(x)ew(x) .
So we require
w′ (x) = f (x).
If we choose w = F to be any primitive of f (the additive constant does not matter), then
′
33 u(x)eF (x) = g(x)eF (x) ,
and therefore Z
F (x)
u(x)e = geF + A,
2
u′ (x) − 2xu(x) = ex , u(0) = 1,
reproduces the left-hand side of the equation. Thus we require w′ (x) = f (x) = −2x, and
2
therefore we may take w(x) = −x2 . Multiplying the ODE by e−x gives
2 ′ 2 2 2
u(x)e−x = e−x u′ (x) − 2xu(x) = e−x ex = 1.
Integrating, we get
2 2
u(x)e−x = x + A =⇒ u(x) = (x + A)ex .
2
33 u(x) = (x + 1)ex .
u′ (x) − 4
+ 1 u(x) = x4 ,
x u(1) = 1,
where f : R → R is a given continuous function, and u is the unknown. The function f tells
us how u should change depending on its current value.
A standard way to solve such equations is the method of separation of variables. If
u(x) = C ∈ R for some C such that f (C) = 0, then the constant function u = C is a solution
of the ODE. Otherwise, if f (u(x)) ̸= 0, we can divide both sides by f (u(x)):
34 u′ (x)
= 1.
f (u(x))
since u < 0 has no meaning as a population, and K represents an upper bound (the maximal
sustainable population).
Mathematically, the right-hand side vanishes at u = 0 and u = K, so the constant functions
u(x) = 0 and u(x) = K are solutions. To solve the ODE by separation of variables we assume
0 < u(x) < K on the interval under consideration (so that we may safely divide by u and
K − u).
We rearrange and integrate:
K u′ (x)
Z Z
K
=r =⇒ du = r dx = rx + A.
u(x) K − u(x) u(K − u)
K 1 1
= + ,
u(K − u) u K −u
so that
Z Z Z
K 1 1 u
du = du + du = log u − log(K − u) = log .
u(K − u) u K −u K −u
Thus
u(x) u(x)
log = rx + A =⇒ = erx+A
K − u(x) K − u(x)
=⇒ u(x) = Kerx+A − u(x)erx+A
1 + erx+A u(x) = Kerx+A
=⇒
erx+A
=⇒ u(x) = K .
1 + erx+A
eA u0
u0 = K =⇒ eA = .
1 + eA K − u0
Ku0
u(x) = .
u0 + K − u0 e−rx
• If u(0) = K, then u(x) = K is a (constant) solution. In this case the population stays
exactly at the carrying capacity.
• If 0 < u(0) < K, the above formula applies and one checks that 0 < u(x) < K for all x,
with u(x) → K as x → ∞. The population grows and approaches the carrying capacity
from below.
• If u(0) > K, then u′ (0) < 0, so u decreases. One can check that the same explicit
formula holds also in this case (with u0 > K). In particular, u(x) > K for all x, and
u(x) → K as x → ∞: the population decreases towards the carrying capacity from
34
above.
u′ (x)
= g(x).
f (u(x))
Integrating, Z Z
1
du = g(x) dx + A.
f (u)
If H is a primitive of 1/f and G a primitive of g, then
u(x) = H −1 G(x) + A .
H u(x) = G(x) + A =⇒
is of the form
u(x) = H −1 G(x) + A ,
A ∈ R.
Proof. Since f never vanishes, H ′ = 1/f has constant sign. Hence H is strictly monotone and
therefore invertible.
If u(x) = H −1 (G(x) + A), then by the chain rule (Theorem 5.14) and the formula for the
derivative of the inverse function (Theorem 5.20), we get
1 1
u′ (x) = (H −1 )′ (G(x)+A) G′ (x) = g(x) = g(x) = f (u(x)) g(x),
H′◦ H −1 (G(x) + A) H ′ (u(x))
so u solves (8.9)
Conversely, suppose u solves (8.9). Then
′ 1
H ◦ u(x) = H ′ (u(x)) u′ (x) = f (u(x))g(x) = g(x) = G′ (x).
34 f (u(x))
Applying H −1 gives
u(x) = H −1 G(x) + A ,
u′ (x) = x u(x)2
on an interval where u does not vanish. We rewrite the equation by separating variables:
u′
= x.
u2
x2
Z Z
du 1
= x dx, =⇒ − = + A, A ∈ R.
u2 u 2
1
u(x) = − x2 , A ∈ R.
2 +A
1
u(x) = − x20
.
x2 1
2 − u0 − 2
where a0 , a1 ∈ R are given constants and u is the unknown. Such equations already cover
34
many important applications (for instance, oscillations and damped vibrations).
Example 8.14. — • For u′′ = 0, affine functions are solutions: u(x) = Ax + B, with
A, B ∈ R.
is a solution.
is a solution. Since sine and cosine can be written in terms of e±ix , one can also rewrite
the solutions above as
and then re-express them in terms of real-valued sine and cosine (recall that we are
interested in real-valued functions).
The last two examples suggest looking for solutions of (8.10) of the form
u(x) = eαx , α ∈ C.
is called the characteristic polynomial. Its roots determine the shape of the solutions. We
distinguish three cases according to the discriminant ∆ = a21 − 4a0 .
• Case 1: ∆ > 0. The polynomial p(t) has two distinct real roots
√ √
−a1 + ∆ −a1 − ∆
α= , β= . (8.11)
2 2
Then x 7→ eαx and x 7→ eβx are two linearly independent solutions, and therefore
34
u(x) = Aeαx + Beβx , A, B ∈ R,
is a solution of (8.10).
• Case 2: ∆ < 0. Then p(t) has two complex-conjugate roots
√ √
a1 −∆ a1 −∆
α + iβ = − + i , α − iβ = − − i , (8.12)
2 2 2 2
with β > 0. The complex-valued functions x 7→ e(α±iβ)x solve (8.10), and hence their real and
imaginary parts are real solutions. This gives
a1
α=− , (8.13)
2
so x 7→ eαx is a solution of (8.10). To find another independent solution, recall the special
case u′′ = 0, where two linearly independent solutions are 1 and x, which can be written as
eγx and xeγx with γ = 0.
where the first term vanishes because α is a root of p, and the second vanishes by (8.13).
34 Hence
u(x) = Aeαx + Bxeαx , A, B ∈ R,
solves (8.10).
For second-order ODEs it is customary to prescribe both the value of u and the value of
its derivative at some point (for instance, u(0) = 1 and u′ (0) = 0). The two constants A, B
in the formulas above are precisely what we need in order to satisfy two such conditions.
We now want to prove that the families of solutions described in Paragraph 8.1.3 indeed give
all solutions of (8.10).
Given a0 , a1 ∈ R, let ∆ = a21 − 4a0 and consider the following solutions of (8.10):
u = Au1 + Bu2 .
35 In other words, the set of solutions of (8.10) forms a two-dimensional linear subspace
of C 2 (I).
Proof. We treat the case ∆ > 0 (the other cases are similar). Assume for simplicity that 0 ∈ I
(otherwise, fix x0 ∈ I and repeat the argument with x0 in place of 0).
Observing that
u1 (0) = u2 (0) = 1, u′1 (0) = α > β = u′2 (0),
by defining
αu2 (x) − βu1 (x) u1 (x) − u2 (x)
v1 (x) = , v2 (x) = ,
α−β α−β
it follows that v1 and v2 are solutions of (8.10) that satisfy
Then, w is a solution satisfying w(0) = 0. Our goal is to show that w is a multiple of u2 . For
this, consider the function
W ′ (x) = w′ (x)v2′ (x) + w(x)v2′′ (x) − w′′ (x)v2 (x) − w′ (x)v2′ (x) = w(x)v2′′ (x) − w′′ (x)v2 (x).
By Theorem 8.3 W (x) = Ae−a1 x , and the condition W (0) = 0 implies that W = 0 on I. In
other words,
w(x)v2′ (x) − w′ (x)v2 (x) = 0 ∀ x ∈ I.
Now, on any interval J where v2 does not vanish, we can rewrite this as
v2′ (x)
w′ (x) = w(x) ∀ x ∈ I ∩ J.
v2 (x)
v′
Thus, since v22 = (log |v2 |)′ , we can apply Theorem 8.3 to deduce the existence of a constant
A ∈ R such that
w(x) = A elog |v2 (x)| = A |v2 (x)| ∀ x ∈ I ∩ J.
Since |v2 | is either equal to v2 or to −v2 on J (because v2 does not vanish), we proved that
on each interval J where v2 does not vanish, there exists a constant AJ ∈ R such that
w(x) = AJ v2 (x).
In our situation, one can check that v2 vanishes only at 0, so there exist A− , A+ ∈ R such
that
w = A− v2 on (−∞, 0) ∩ I, w = A+ v2 on (0, ∞) ∩ I.
therefore,
w = A − v2 on (−∞, 0] ∩ I, w = A+ v2 on [0, ∞) ∩ I.
and analogously w+
′ (0) = A v ′ (0) = A . Since w ∈ C 2 (I) we have that w ′ (0) = w ′ (0), so
+ 2 + − +
A− = A+ , and therefore w(x) = A+ v2 (x) on all of I.
In conclusion
Remark 8.17 (Zero initial data). — From the explicit formulas in Theorem 8.16 one can
easily check that the only solution u ∈ C 2 (I) of the homogeneous equation u′′ +a1 u′ +a0 u = 0
satisfying u(x0 ) = u′ (x0 ) = 0 for some x0 ∈ I is the zero solution.
For instance, in the case ∆ > 0 we have
so
Aeαx0 + Beβx0 = 0,
u(x0 ) = 0, u′ (x0 ) = 0 =⇒
Aαeαx0 + Bβeβx0 = 0.
Multiplying the first equation by α and subtracting from the second gives (β − α) B eβx0 = 0,
therefore B = 0. Going back to the first equation, we also get A = 0.
The cases ∆ = 0 and ∆ < 0 are handled similarly. In conclusion, no nontrivial solution
can vanish together with its derivative at a point.
be their Wronskian. If W (x0 ) = 0 for some x0 ∈ I, then v1 and v2 are linearly dependent
on I.
The condition W (x0 ) = 0 means precisely that det M (x0 ) = 0, so there exists a nonzero
vector (A, B) ∈ R2 such that
35 Define
w(x) = A v1 (x) + B v2 (x).
w(x0 ) = 0, w′ (x0 ) = 0.
By Remark 8.17, the only solution with these initial data is the trivial one, so w = 0 on I.
This proves that A v1 + B v2 = 0, thus v1 and v2 are linearly dependent on I.
Example 8.19. — We consider a vertical spring whose upper end is attached to a fixed
ceiling, a weight of mass m attached to its lower end, and the mass can move only in the
vertical direction. There is a unique position where the spring force balances gravity; we call
this the equilibrium position and denote it by u = 0. If x denotes time, we write u(x) for
the vertical displacement of the mass from this equilibrium position at time x (with upward
displacements taken as positive).
By Newton’s law, the mass m multiplied by the acceleration u′′ (x) equals the total force
acting on the mass.
u(x) x
A first contribution to the total force comes from the spring: according to Hooke’s law, the
restoring force is −ku, where k > 0 is the spring constant. In addition, friction acts against
the motion; we assume this friction force is proportional to the velocity and given by −du′ ,
where d ≥ 0 is the damping constant.
The equation of motion is therefore
or equivalently
d ′ k
u′′ + u + u = 0.
m m
This is a homogeneous linear ODE of second order with constant coefficients, with unknown
35
u and given constants m, d, k. Setting
r
k d
ω= , ζ= ,
m 2mω
we can rewrite it as
u′′ + 2ζωu′ + ω 2 u = 0
p(t) = t2 + 2ζωt + ω 2
The constants A, B are determined by the initial position u(0) and the initial velocity u′ (0).
In the special case ζ = 0 there is no damping, and u is periodic.
If friction is large compared to the spring strength (ζ ≥ 1, so ∆ ≥ 0), the oscillations
disappear, and the weight returns monotonically to equilibrium:
• If ζ > 1, then
p
u(x) = Ae−λ1 x + Be−λ2 x , λ1,2 = ζ ± ζ 2 − 1 ω.
• If ζ = 1, then
u(x) = Ae−ωx + Bxe−ωx .
One can check that ζ − ζ 2 − 1 < 1 for all ζ > 1, so the fastest exponential convergence
p
where a0 , a1 ∈ R are constants and g ∈ C 0 (I) is a given function. The unknown is again u.
With the notation of Paragraph 8.1.3, let u1 , u2 be two linearly independent solutions of
the homogeneous equation (8.10):
35
∆>0: u1 (x) = eαx , u2 (x) = eβx , α, β as in (8.11),
∆<0: u1 (x) = eαx sin(βx), u2 (x) = eαx cos(βx), α, β as in (8.12),
∆=0: u1 (x) = eαx , u2 (x) = xeαx , α as in (8.13).
where H1 , H2 are unknown functions. This is the method of variation of constants in the
second-order setting: we know the solutions of the homogeneous equation, and we allow the
coefficients in the linear combination to depend on x.
We compute
u′ = (H1′ u1 + H2′ u2 ) + (H1 u′1 + H2 u′2 ),
and
u′′ = (H1′ u1 + H2′ u2 )′ + (H1′ u′1 + H2′ u′2 ) + (H1 u′′1 + H2 u′′2 ).
Hence
u′′ + a1 u′ + a0 u = (H1′ u1 + H2′ u2 )′ + (H1′ u′1 + H2′ u′2 ) + (H1 u′′1 + H2 u′′2 )
+ a1 (H1′ u1 + H2′ u2 ) + a1 (H1 u′1 + H2 u′2 ) + a0 (H1 u1 + H2 u2 ).
therefore
For u to solve the non-homogeneous ODE (8.14), we can choose H1′ and H2′ so that
H1′ (x)u1 (x) + H2′ (x)u2 (x) = 0, H1′ (x)u′1 (x) + H2′ (x)u′2 (x) = g(x). (8.15)
u1 ′
H2′ = − H . (8.16)
u2 1
u1 ′ ′ u2 g
H1′ u′1 − u H =g =⇒ H1′ = .
u2 2 1 u′1 u2 − u′2 u1
u1 u2 g u1 g
35 H2′ = − = ′ .
u2 u′1 u2 − u′2 u1 u2 u1 − u′1 u2
is (up to sign) the Wronskian of u1 and u2 . Since u1 and u2 are linearly independent solutions
of the homogeneous equation, Corollary 8.18 implies that this Wronskian never vanishes on
I. In particular, the above formulas for H1′ and H2′ are well-defined on all of I. Therefore,
Z Z
u2 g u1 g
H1 = dx, H2 = dx.
u1 u2 − u′2 u1
′ u′2 u1 − u′1 u2
This shows that if H1 and H2 are primitives of the functions above, then
u = H1 u1 + H2 u2
is a particular solution of (8.14). Finally, the general solution is obtained by adding any
solution of the homogeneous equation:
u = Au1 + Bu2 + H1 u1 + H2 u2 , A, B ∈ R.
Given a0 , a1 ∈ R, let ∆ = a21 − 4a0 and consider the following solutions of (8.10):
u2 g u1 g
Let H1 and H2 be primitives of and ′ , respectively. If u ∈
u′1 u2 ′
− u2 u1 u2 u1 − u′1 u2
C 2 (I) solves (8.14), then there exist A, B ∈ R such that
u = Au1 + Bu2 + H1 u1 + H2 u2 .
In other words, the set of solutions of (8.14) forms a two-dimensional affine subspace
of C 2 (I).
Proof. First we show existence. By the computation above, if H1 and H2 are primitives of
u2 g u1 g
and ,
u′1 u2 − u′2 u1 u′2 u1 − u′1 u2
satisfies
u′′p + a1 u′p + a0 up = g,
so up is a particular solution of (8.14). Since the equation is linear, for any A, B ∈ R the
function
u = Au1 + Bu2 + up
also solves (8.14). This proves existence of solutions of the stated form.
For uniqueness, let u ∈ C 2 (I) be any solution of (8.14), and define
v = u − up = u − (H1 u1 + H2 u2 ).
Then v solves the homogeneous equation (8.10) and therefore, by Theorem 8.16, there exist
A, B ∈ R such that
v = Au1 + Bu2 .
Although this method is very general, in practice the integrals defining H1 and H2 can be
quite complicated. In some (very special) situations it is easier to guess a particular solution
The homogeneous equation u′′ + u = 0 has solutions A cos(x) + B sin(x), so we look for a
solution of the form
u(x) = H1 (x) cos(x) + H2 (x) sin(x),
where H1 , H2 are unknown. This is exactly the method of variation of constants specialized
to this case.
The computation leads to the system
H1′ (x) cos(x) + H2′ (x) sin(x) = 0, −H1′ (x) sin(x) + H2′ (x) cos(x) = 1.
Hence we may take H1 = cos(x) and H2 = sin(x), which gives a particular solution
(In this case, one could also have tried to guess this particular solution!) The general solution
is therefore
u(x) = 1 + A cos(x) + B sin(x).
Imposing u(0) = 0 and u′ (0) = 1 (two initial conditions for the unknown u) yields
Again, the homogeneous solutions are A cos(x) + B sin(x). The method of variation of con-
stants gives Z Z
sin(x) sin(x)
H1 = − dx = − sin2 (x) dx,
sin2 (x) + cos2 (x)
Z Z
cos(x) sin(x)
H2 = dx = cos(x) sin(x) dx.
cos2 (x) + sin2 (x)
One possible choice is
1 1
H2 = − cos2 (x).
H1 = cos(x) sin(x) − x ,
2 2
1
u(x) = H1 (x) cos(x) + H2 (x) sin(x) = − x cos(x).
2
x cos(x)
u(x) = − + A cos(x) + B sin(x).
2
1 3
u(x) = − x cos(x) + sin(x).
35 2 2
Remark 8.23. — In Example 8.22, notice the appearance of the factor x in front of cos(x) in
the particular solution. This occurs because sin(x) and cos(x) already solve the homogeneous
equation, so a particular solution cannot be obtained by taking a simple linear combination
of them.
The situation from Example 8.22 illustrates a general principle behind the method of un-
determined coefficients, which provides a systematic way to guess a particular solution of a
linear ODE with constant coefficients. The procedure can be summarised as follows:
• Begin by making a guess that has the same functional form as the forcing term g(x).
• Check whether this first guess lies in the space of solutions of the homogeneous equation.
If it does, then substituting it into the differential equation produces zero on the left-
hand side, so it cannot match the non-zero forcing term g(x).
• If the guess lies in the homogeneous solution space, multiply it by x. For a second-order
equation, if this new guess still belongs to the homogeneous space, multiply by x2 . At
this point the guess will not solve the homogeneous equation, so no further powers are
needed.
This explains why Example 8.22 requires a particular solution of the form x cos(x): the
functions sin(x) and cos(x) solve the homogeneous equation, so we should look for a particular
solution of the form Ax cos(x) + Bx sin(x). A similar phenomenon occurs when g(x) = eαx
and α is a root of the characteristic equation. In that case one should try Axeαx . However,
when ∆ = 0, then both eαx and xeαx solve the homogeneous equation, so the correct guess
for a particular solution is Ax2 eαx .
35
Exercise 8.24. — Solve the following ODEs (the unknown function is always u):
G x, u(x), u′ (x) = 0.
In this section we restrict to equations for which one can “isolate” u′ , so that one can write
the ODE in normal form:
u′ (x) = f (x, u(x)).
1. f is continuous in R × R;
2. f is Lipschitz with respect to the second variable; that is, there exists a constant
L > 0 such that
Then, for any point (x0 , y0 ) ∈ R × R there exists a unique C 1 function u : R → R such
that (
u′ (x) = f (x, u(x)) for all x ∈ R,
(8.17)
u(x0 ) = y0 .
As we shall see in Section 8.2.2 below, the proof is based on the method of successive
approximations, also known as Picard iterations. It involves constructing a sequence of con-
tinuous functions that converge to the solution of the differential equation. Before diving into
the proof of this important theorem, we first discuss some examples and generalizations.
Theorem 8.26 guarantees that solutions to the first order ODE (8.17) are unique when f
is Lipschitz in the second variable. This assumption is crucial, as the next example shows.
36
Hence, Theorem 8.26 guarantees that the solution is unique. Since the constant function
u = 0 is a solution, this is the unique solution.
• For α < 1 the function f (y) = |y|α is not Lipschitz. Indeed, if this function were Lipschitz,
then there would exist a constant L > 0 such that
but this is false since limy→0 |y|1−α = 0 (recall that α < 1).
Note that, also in this case, the constant function u = 0 is a solution. We now try to use
the method of separation of variables (recall Section 8.1.2) to find a second solution that is
not zero, say with u(x) > 0 somewhere:
u′ (x)
u′ (x) = u(x)α =⇒ = 1,
u(x)α
u(x)1−α
Z Z
du
= dx = x + A =⇒ = x + A.
uα 1−α
is a second solution of (8.18). Actually, given any value x0 ≥ 0, all the functions
36
0 for x ≤ x0 ,
ux0 (x) = 1
(1 − α)(x − x ) 1−α
0 for x > x0 ,
Motivated by the previous example, one may wonder if the solution of (8.18) is unique for
α > 1. We begin with the following observation, stated as an exercise.
Exercise 8.28. — Let α > 1. Prove that the function f : R → R given by f (y) = |y|α is
locally Lipschitz (i.e., it is Lipschitz in every compact interval [a, b]), but it is not Lipschitz
on the whole R.
Hint: Use Corollary 5.32.
By the previous exercise, we see that Theorem 8.26 does not apply to (8.18) when α > 1.
Still, since this function is locally Lipschitz, one may hope that some existence and uniqueness
theorem still holds. This is indeed the case, as implied by the local version of the Cauchy–
Lipschitz Theorem stated below. As we shall discuss later, since now the function f is only
assumed to be locally Lipschitz, in general we cannot find a solution u defined on the whole
R.
1. f is continuous in I × R;
2. f is locally Lipschitz with respect to the second variable; that is, for every pair of
compact intervals [a, b] ⊂ I and [c, d] ⊂ R there exists a constant L > 0 such that
Then, for any point (x0 , y0 ) ∈ I × R there exist an interval I ′ ⊂ I containing x0 and a
unique C 1 function u : I ′ → R such that
(
u′ (x) = f (x, u(x)) for all x ∈ I ′ ,
(8.19)
u(x0 ) = y0 .
In other words, under a local Lipschitz assumption, one can only guarantee the existence
and uniqueness of a solution on some interval around x0 . Moreover, as long as the solution u(x)
remains bounded within I ′ , one can continue applying Theorem 8.29 to extend the interval I ′
as much as possible.
36 To better understand why solutions are defined only on some interval I ′ ⊂ I, we consider
the following example.
u′ (x)
u′ (x) = u(x)2 =⇒ = 1,
u(x)2
1
u(x) = .
1−x
Note that this function solves the ODE on (−∞, 1), but limx→1− u(x) = ∞, so we cannot
extend this solution beyond x = 1.
Although Theorem 8.29 guarantees that most nonlinear ODEs have a unique solution (at
least locally in x), nonlinear ODEs are very difficult to solve and there are no general tech-
niques to tackle such problems, neither in practice nor in theory. Therefore, in applications,
one often resorts to numerical methods.
Proof of Theorem 8.26. Let L > 0 be a Lipschitz constant for f with respect to the second
variable, as in Theorem 8.26. We first prove local existence on a short interval around x0 ,
then uniqueness on that interval, and finally extend the solution to the whole R.
• Step 1: An equivalent integral equation. We first show that u : R → R is a C 1 solution
to (8.17) if and only if u is a continuous function satisfying
Z x
u(x) = y0 + f (s, u(s)) ds ∀ x ∈ R. (8.20)
x0
Indeed, if u solves the ODE, then by integration (see Corollary 7.5) we deduce the validity of
(8.20).
Conversely, if u is a continuous function satisfying (8.20), then Theorem 7.4 and Re-
mark 8.32 imply that Z x
x 7→ f (s, u(s)) ds
x0
is a primitive of the continuous function f (x, u(x)). Hence u′ (x) = f (x, u(x)) for all x, so u is
C 1 . Finally, choosing x = x0 in (8.20) we deduce that u(x0 ) = y0 .
Therefore, to prove existence, it suffices to construct a solution to (8.20). This will be
accomplished by constructing what are known as Picard approximations, that is, a sequence
of functions that converge to a solution of (8.20).
Then we define u1 : R → R as
Z x
u1 (x) = y0 + f (s, u0 (s)) ds.
x0
The integral is well-defined since u0 is continuous and therefore s 7→ f (s, u0 (s)) is continuous
(see Remark 8.32). We also observe that u1 is the primitive of a continuous function, so it is
C 1 (and, in particular, continuous).
More generally, given n ∈ N, once the continuous function un : R → R is constructed, we
define Z x
un+1 (x) = y0 + f (s, un (s)) ds.
x0
Again, since un is continuous, also s 7→ f (s, un (s)) is continuous, and therefore un+1 is C 1
(and in particular continuous).
• Step 3: Convergence of Picard approximations on a short interval. Set
1
τ= (so that Lτ = 21 ).
2L
We now prove the uniform convergence of the sequence of Picard approximations un on the
interval [x0 − τ, x0 + τ ] by showing that this sequence corresponds to the partial sums of a
uniformly convergent series of functions.
Define vk = uk − uk−1 for k ≥ 1, so that
n
X
un (x) = y0 + vk (x).
k=1
converges absolutely for every x ∈ [x0 −τ, x0 +τ ], so that the function u∞ : [x0 −τ, x0 +τ ] → R
is well-defined, and that the sequence of functions {un }∞ n=0 converges uniformly to u∞ on
[x0 − τ, x0 + τ ].
To this end, we observe that
Z x
vn+1 (x) = un+1 (x) − un (x) = f (s, un (s)) − f (s, un−1 (s)) ds ∀ x ∈ R,
x0
an
|vn+1 (x)| ≤ Lan τ = .
2
an
an+1 ≤ Lan τ = ∀ n ≥ 1.
2
By induction we deduce
an+1 ≤ 2−n a1 ∀ n ≥ 1.
By the majorant criterion, the series ∞ k=1 vk (x) converges absolutely for every x ∈ [x0 −
P
τ, x0 + τ ].
Moreover, for x ∈ [x0 − τ, x0 + τ ] and n ≥ 0,
∞
X ∞
X ∞
X
|u∞ (x) − un (x)| = vk (x) ≤ |vk (x)| ≤ a1 2−(k−1)
k=n+1 k=n+1 k=n+1 (8.22)
−n
= a1 2 −−−→ 0,
n→∞
For the right-hand side, recalling (8.22) and that Lτ = 1/2, we estimate
Z x Z x
|u∞ (s) − un (s)| ds ≤ L|x − x0 |a1 2−n ≤ a1 2−(n+1) ,
f (s, u∞ (s)) − f (s, un (s)) ds ≤ L
x0 x0
So we conclude that u∞ solves (8.20) on [x0 −τ, x0 +τ ], which shows the existence of a solution
u∞ on [x0 − τ, x0 + τ ].
• Step 5: Local uniqueness on [x0 − τ, x0 + τ ]. Let u1 , u2 : [x0 − τ, x0 + τ ] → R be two
solutions of (8.17), and therefore of (8.20). Then, for each x ∈ [x0 − τ, x0 + τ ],
Z x
u1 (x) − u2 (x) = f (s, u1 (s)) − f (s, u2 (s)) ds,
x0
so Z x Z x
|u1 (x) − u2 (x)| ≤ f (s, u1 (s)) − f (s, u2 (s)) ds ≤ L |u1 (s) − u2 (s)| ds.
x0 x0
Define
a= max |u1 (x) − u2 (x)|.
x∈[x0 −τ,x0 +τ ]
a
|u1 (x) − u2 (x)| ≤ La|x − x0 | ≤ Lτ a = ,
2
a
a≤ .
2
• Step 6: Global existence and uniqueness. We now extend the solution uniquely to the
whole R by iterating the local existence and uniqueness argument.
Set x1 = x0 + τ and y1 = u∞ (x1 ). Applying the same Picard construction with initial data
(x1 , y1 ) gives a unique solution u(1) on [x1 − τ, x1 + τ ] = [x0 , x0 + 2τ ]. On the overlap [x0 , x1 ]
both u∞ and u(1) solve (8.17) with the same value at x1 , so by Step 5 they coincide there.
Hence we can glue them and obtain a single solution on [x0 − τ, x1 + τ ] = [x0 − τ, x0 + 2τ ].
Iterating this construction to the right, we obtain a unique solution on [x0 − τ, ∞). A
completely analogous construction to the left (starting from x0 − τ and moving to the left
by steps of length τ ) yields a unique solution on (−∞, x0 + τ ]. Gluing the left and right
pieces together (again using local uniqueness on overlaps) gives a unique solution u : R → R
satisfying (8.17). This completes the proof of Theorem 8.26.
Define
U1 (x) = u(x), U2 (x) = u′ (x).
Then
U1′ (x) = U2 (x), U2′ (x) = u′′ (x) = −a1 (x)U2 (x) − a0 (x)U1 (x),
The same idea extends to arbitrary higher-order ODEs. More precisely, suppose we are
given an n-th order ODE of the form
and assume that the highest derivative can be isolated and written as
U1 = u, U2 = u′ , U3 = u′′ , . . . , Un = u(n−1) .
By definition, we have
Un′ = u(n) = f x, U1 , U2 , . . . , Un .
Therefore, the n-th order equation (8.24) is equivalent to the first-order system
U1′ = U2 ,
U2′ = U3 ,
..
.
′
Un−1 = Un ,
U ′ = f x, U , U , . . . , U .
n 1 2 n
The Cauchy–Lipschitz Theorem (both its global and local versions) extends to systems
of first-order ODEs and ensures existence and uniqueness of solutions whenever the right-
hand side is continuous and (locally) Lipschitz with respect to the variables (U1 , . . . , Un ). In
particular, once the initial conditions
are prescribed at some x0 ∈ I, there exists a unique (local) solution to the system, and hence
36 a unique solution to the original n-th order ODE.
As an application, we obtain a classical structure result for linear second-order equations.
Proof. Fix x0 ∈ I and define U1 = u, U2 = u′ . As shown in Example 8.33, the equation can
be rewritten as the first-order system
(
U1′ = U2 ,
U2′ = −a1 (x)U2 − a0 (x)U1 .
The right-hand side is linear in (U1 , U2 ) and continuous and bounded in x, so it is Lipschitz
in both U1 and U2 . Thus, the Cauchy–Lipschitz Theorem for systems ensures the existence
and uniqueness of solutions once (U1 (x0 ), U2 (x0 )) is prescribed. Equivalently, the original
second-order equation has a unique solution once u(x0 ) and u′ (x0 ) are given.
Let u1 be the unique solution satisfying u1 (x0 ) = 1 and u′1 (x0 ) = 0, and let u2 be the
unique solution satisfying u2 (x0 ) = 0 and u′2 (x0 ) = 1. By linearity, Au1 + Bu2 is a solution
for every A, B ∈ R.
Conversely, if u is any solution and we set A = u(x0 ) and B = u′ (x0 ), then the function
36 v = u − Au1 − Bu2 solves the equation and satisfies v(x0 ) = v ′ (x0 ) = 0. By uniqueness, v
must be identically zero, and therefore u = Au1 + Bu2 .
The higher-dimensional version of the Cauchy–Lipschitz Theorem for systems will be stud-
ied in Analysis 2. Understanding the proof of the one-dimensional case presented in Sec-
tion 8.2.2 provides a solid foundation for that more general theory.
open, 34 zero, 76
open disk, 40
[ACa2003] N. A’Campo, A natural construction for the real numbers arXiv preprint 0301015,
(2003)
[Apo1983] T. Apostol, A proof that Euler missed: Evaluating ζ(2) the easy way The Mathe-
matical Intelligencer 5 no.3, p. 59–60 (1983)
[Aig2014] M. Aigner and G. M. Ziegler, Das BUCH der Beweise Springer, (2014)
[Bol1817] B. Bolzano, Rein analytischer Beweis des Lehrsatzes, daß zwischen je zwei Werthen,
die ein entgegengesetztes Resultat gewähren, wenigstens eine reelle Wurzel der Gleichung
liege, Haase Verl. Prag (1817)
[Cau1821] A.L. Cauchy, Cours d’analyse de l’école royale polytechnique L’Imprimerie Royale,
Debure frères, Libraires du Roi et de la Bibliothèque du Roi. Paris, (1821)
[Ded1872] R. Dedekind, Stetigkeit und irrationale Zahlen Friedrich Vieweg und Sohn, Braun-
schweig (1872)
[Hil1893] D. Hilbert, Über die Transzendenz der Zahlen e und π Mathematische Annalen 43,
216-219 (1893)
[Hos1715] G.F.A. Marquis de l’Hôpital, Analyse des Infiniment Petits pour l’Intelligence des
Lignes Courbes 2nde Edition, F. Montalant, Paris (1715)
272
Chapter 8.2 BIBLIOGRAPHY
[Zag1990] D. Zagier, A one-sentence proof that every prime p ≡ 1 mod 4 is a sum of two
squares. Amer. Math. Monthly 97, no.2, p. 144 (1990)