Real Analysis I Lecture Notes 2023
Real Analysis I Lecture Notes 2023
NIKITA AGARWAL
Abstract. These are lecture notes for the course taught in Semester 1, 2023-24.
Contents
1. Week 1 1
2. Week 2 4
3. Week 3 11
4. Week 4 16
5. Week 5 24
6. Week 6 31
7. Week 7 34
8. Week 8 38
9. Week 9 44
10. Week 10 50
11. Week 11 56
12. Week 12 64
13. Week 13 70
14. Week 14 76
15. Some solved problems 82
1. Week 1
There were only two lectures this week (Tuesday and Thursday). Friday’s lecture was
canceled due to a schedule conflict.
What is this course about?
• Analyzing real numbers.
• Studying sequences and series of real numbers.
• Analyzing real-valued functions.
• A theoretical foundation for the concepts from calculus.
• You will see familiar objects, will see concepts which might seem intuitive. This
course will be about making concepts precise by proving them.
• Gradually introducing ‘short’ proofs in the beginning to ‘long’ proofs in the end.
What are real numbers?
• Natural numbers: 1, 2, 3, . . .
• Integers: 0, ±1, ±2, ±3 . . .
• Rational numbers: of the form p/q, where p, q are integers and q 6= 0.
Theorem 1.1. For any rational number r, there is a unique integer n such that
n ≤ r < n + 1.
Date: November 16, 2023.
1
2 NIKITA AGARWAL
(4) Existence of additive inverse: For every x ∈ R, there exists y ∈ R such that
x + y = 0. The inverse y is denoted by −x.
(5) Commutativity of multiplication: x.y = y.x, for all x, y ∈ R.
(6) Associativity of multiplication: x.(y.z) = (x.y).z, for all x, y, z ∈ R.
(7) Existence of the multiplicative identity: There exists 1 ∈ R such that x.1 = x, for
all x ∈ R.
(8) Existence of multiplicative inverse or reciprocal : For every x ∈ R, x 6= 0, there
exists y ∈ R such that x.y = 1. The inverse y is denoted by 1/x or x−1 .
(9) Distributivity of multiplication over addition: x.(y +z) = x.y +x.z, for all x, y, z ∈
R.
Order relation on R. There is an order relation on R, denoted as ‘<’. It satisfies the
following law:
2. Week 2
Comparing cardinality of sets. Cardinality of a set A is denoted as |A|. A finite set
with n elements is said to have cardinality n. We do not give the definition of cardinality
of infinite sets here. However, we compare cardinality of two sets as follows: Two sets A
and B are said to have the same cardinality if there is a bujection between the two sets.
If there is an injection from a set A to another set B, but no surjection, then we say that
the set B has more cardinality than the set A, in which case, we say that B is bigger
than A.
By the above discussion, if two sets have same cardinality and one of them is countable,
then the other is also countable. In view of this, once we prove that R is uncountable,
we can have that R has more cardinality than Q (since Q is countable).
The cardinality of Q (or N) is denoted as ℵ0 , and the cardinality of R is denoted as c.
Continuum hypothesis states that c = 2ℵ0 .
There is no biggest set! Let A be a non-empty set. Let P A denotes the power set of
A (set of all subsets of A). There is a one-to-one (injective) map from A to P A which
sends every element a ∈ A to the set {a} ∈ P A .
a 7→ {a}.
Hence the cardinality of P A is at least that of A, that is,
|A| ≤ P A .
Theorem 2.1. The cardinality of P A is strictly bigger than that of A. That is, there is
no bijection (one-one and onto) map from A to P A .
Proof. Consider a map f : A → P A .
Let
S = {a ∈ A : a ∈ / f (a)}.
Claim: there is no b ∈ A such that f (b) = S (this will contradict that f is an onto map.)
Suppose there exists b ∈ A such that f (b) = S. This element b is either in S or not in S.
If b ∈ S, then by the construction of S, b ∈
/ f (b) = S, which is absurd.
If b ∈
/ S and since f (b) = S, b ∈/ f (b). Hence b ∈ S, which is absurd as well (Russell’s
paradox.)
Hence we have produced a set S which is not in the image of f . Therefore f is not
onto.
Let A be a non-empty set. Then
A
|A| < |P A | < |P P | < . . . .
Note: By convention, if we start with an empty set A, then each set in the above sequence
will be an empty set.
Upper bounds and Lower bounds of a set. Let us begin with a finite subset A =
{a1 , . . . , an } of R. Then A has a maximum element max(A) = M and a minimum element
min(A) = m. That is, m ≤ ai ≤ M , for all i = 1, . . . , n. We will now generalize the
notions of maximum and minimum of a finite set. Let A be a non-empty subset of R.
Definition 2.2. (Upper Bound) We say that u ∈ R is an upper bound of A if x ≤ u, for
all x ∈ A.
Definition 2.3. (Lower Bound) We say that ` ∈ R is an lower bound of A if ` ≤ x, for
all x ∈ A.
LECTURE NOTES ON REAL ANALYSIS I 5
Note: A set need not have an upper and/or lower bound. For example, the set (0, ∞)
has no upper bound, and the set (−∞, 0) has no lower bound. More examples in the
figure below.
Definition 2.4. We say that A is bounded above if it has an upper bound. We say that
A is bounded below if it has a lower bound.
A set which is both bounded above and below is called a bounded set (or just bounded).
Upper bounds and Lower bounds - observations. Let A be a non-empty subset of
R.
• All points in A lie to the left of an upper bound and lie to the right of a lower
bound.
• Any lower bound is less than any upper bound of a non-empty set.
• Define the set −A = {−x : x ∈ A}. Then −A is a non-empty subset of R and
−(−A) = A. If u is an upper bound of A then −u is a lower bound of −A.
• Upper/Lower bound, if exists, is not unique.
• A real number c ∈ R is NOT an upper bound of A if there exists at least one
x ∈ A such that c < x.
• Similarly a real number d ∈ R is NOT a lower bound of A if there exists at least
one x ∈ A such that x < d.
Examples.
(1) Let A = (0, 1): Any number greater than or equal to 1 is an upper bound and
any number less than or equal to 0 is a lower bound for A. Note 0 ∈ / A is a
lower bound and 1 ∈/ A is an upper bound. Moreover no element of A is either an
upper or a lower bound. For if, 0 < x < 1 is an upper bound, then x < x+1 2
∈ A,
which contradicts the definition of upper bound. Similarly, if 0 < x < 1 is a lower
bound, then x > x2 ∈ A, which contradicts the definition of lower bound.
(2) Let A = {1/n :NewnSection
∈ 2N}:
Page 1 Any number greater than or equal to 1 is an upper
bound and any number less than or equal to 0 is a lower bound for A. Note 1 ∈ A
is an upper bound.
Finite set. Let A is a finite non-empty subset of R. Then
• A has a maximum element M = max(A) and a minimum element m = min(A).
• m is a lower bound of A and M is an upper bound of A. These are bounds that
lie in A.
• All other lower bounds are less than m and all other upper bounds are greater
than M .
6 NIKITA AGARWAL
• Thus m is the greatest lower bound (exists+unique) and M is the least upper
bound (exists+unique).
What happens for A = (0, 1).
This is the single most important property of R which is NOT satisfied by the set of
2
√ the set A = {x ∈ Q : x < 2} is bounded in Q but
rational numbers Q. For instance,
its least upper bound sup(A) = 2 ∈/ Q.
LUB property can be proved using Dedekind cuts, which we omit here.
An application of LUB property - Archimedian property.
Theorem 2.8. (Archimedian property) The set of natural numbers N is not bounded
above in R.
Proof. Proof by contradiction.
Suppose N is bounded above by u ∈ R.
By the lub property, there exists u ∈ R such that u = lub(N).
Since u − 1 < u, u − 1 is not an upper bound of N.
Hence there exists n ∈ N such that u − 1 < n which implies u < n + 1.
Since n + 1 ∈ N, u is not an upper bound of N, which is a contradiction.
Hence our assumption that N is bounded above is wrong.
LECTURE NOTES ON REAL ANALYSIS I 7
Proof. i) ⇒ ii): Suppose there exists no such n ∈ N. Thus nx ≤ y for all n ∈ N. Hence
n ≤ y/x. This implies that y/x is an upper bound of N which is a contradiction to
statement i). Hence our assumption was wrong and statement ii) holds true.
Density of Q in R.
Theorem 2.10. Given any real numbers a, b ∈ R with a < b, there exists r ∈ Q such
that r ∈ (a, b).
Proof. Since b − a > 0, by the equivalent statement of Archimedian property, there exists
n ∈ N such that n(b − a) > 1.
Hence there exists an integer m ∈ Z such that m ∈ (na, nb) which implies m/n ∈ (a, b).
Take r = m/n.
Density of R \ Q in R.
Theorem 2.11. Given any real numbers a, b ∈ R with a < b, there exists t ∈
/ Q such
that t ∈ (a, b).
√ √
√ (a − 2, b − 2).
Proof. Apply the previous theorem for√the interval
√ r ∈ Q such that r ∈ (a − 2, b − 2).
There exists
Hence r + 2 ∈ (a, b). √
Show that if r ∈ Q, then r + 2 ∈ / Q.
How many are there? One would like to know how many rational numbers and irra-
tional numbers are there in the interval (a, b)?
An example.
• Last time, we made a remark that Q does not enjoy lub property.
• We can define glb property as well: “A non-empty set of real numbers which is
bounded below has a glb/inf in R”.
An example of a countable bounded set A whose lub and glb both are not in A.
√ √
• Let A = {x ∈ Q : x2 < 2}. Claim: sup(A) = 2 and inf(A) = − 2.
• Note that A is a non-empty bounded subset of Q which does not enjoy lub and
glb. √ √
• First of all √ 2 is an upper bound and − 2 is a lower bound of A.
• Let u ∈√(0, 2) be any other upper bound of A. By density of Q in R, there exists
r ∈ (u, 2). Hence r2 < 2. Thus r ∈ √ A, which contradicts the assumption that u
is an upper bound. Hence sup(A) = 2. √
• Notice that A = −A. Hence inf(A) = −sup(−A) = −sup(A) = − 2.
Counter-examples. The nested interval theorem might fail to hold if the intervals are
not closed.
Example 2.13. • Let In = (0, 1/n), for all n ∈ N. Prove that ∩n≥1 In = ∅.
• Let In = (0, 1/n], for all n ∈ N. Prove that ∩n≥1 In = ∅.
• Let In = (n, ∞), for all n ∈ N. Prove that ∩n≥1 In = ∅.
• Let In = (−1/n, 1/n), for all n ∈ N. Prove that ∩n≥1 In = {0}.
All above can be proved using Archimedian property.
LECTURE NOTES ON REAL ANALYSIS I 9
Theorem 2.14. (Greatest Integer) For any real number x, there is a unique integer n
such that n ≤ x < n + 1.
Proof. We already proved this result when x ∈ Q.
Define the set
A = {m ∈ Z : m ≤ x}.
Then A 6= ∅, otherwise m > x, for all m ∈ Z.
Let n ∈ N and m = −n. Then −n > x, for all n ∈ N.
Hence n ≤ −x, for all n ∈ N. This contradicts the Archimedian property.
Thus A 6= ∅.
Also A is bounded above by x.
By the LUB property, A has a least upper bound, say u.
Since u − 1 is not an upper bound of A, there exists m ∈ A such that u − 1 < m ≤ u.
Also m ∈ A implies m ≤ x.
We prove that m + 1 > x.
For if, m+1 ≤ x, then m+1 ∈ A. Thus m+1 ≤ u which implies m ≤ u−1, contradiction.
Hence x < m + 1. Take n = m.
Uniqueness: Suppose n1 ≤ x < n1 + 1 and n2 ≤ x < n2 + 1. If n1 < n2 , then n1 + 1 ≤ n2 ,
hence n1 + 1 ≤ x, which is a contradiction.
Remark 2.15. The n obtained in the previous result is known as the greatest integer less
than or equal to x and is denoted as [x]. The number x − [x] is known as the fractional
part of x.
Intervals in R.
Definition 2.16. A subset I of R is known as an interval if it satisfies the following
property: If x, y ∈ I, and x < z < y, then z ∈ I.
For real numbers a ≤ b, there are following types of intervals:
• Closed: [a, b]
• Open: (a, b)
• Half-open: [a, b)
• Half-open: (a, b]
• Closed: [a, ∞)
• Open: (a, ∞)
• Open: (−∞, b)
• Closed: (−∞, b]
• (−∞, ∞) = R.
The first four are finite or bounded, the other five are infinite or unbounded.
Definition 2.17. A subset U of R is said to be open if for each x ∈ U , there exists an
open interval (a, b) such that x ∈ (a, b) ⊆ U .
Example 2.18. • ∅ is open since the definition is vacuously satisfied
• An open interval is an open set. In particular, R is open.
• An arbitrary union of open sets is open.
• A finite intersection of open sets is open. Fails to hold for infinite intersections
since ∩n≥1 (−1/n, 1/n) = {0}, which is not open.
• Half-open intervals are not open sets. For instance, there is no open interval
containing the point b which is contained in the half-open interval (a, b].
Definition 2.19. A subset C of R is said to be closed if its complement R \ C is open.
10 NIKITA AGARWAL
3. Week 3
Theorem 3.1. [a, b] is compact.
Proof. Suppose [a, b] is not compact.
Then there exists a collection (Ij )j∈J , of open intervals satisfying [a, b] ⊆ ∪j∈J Ij , but
having no finite subcollection whose union contains [a, b].
Divide [a, b] into two equal intervals [a, (a + b)/2] and [(a + b/2), b].
Then the union of all the intervals in the collection (Ij )j∈J contains [a, b].
For at least one of these subintervals [a, (a + b)/2], [(a + b/2), b], there is no finite sub-
collection of (Ij )j∈J whose union contains [a, b]. For if, there are finitely many intervals
Ii1 , . . . , Iik whose union contains the subinterval [a, (a + b)/2] and there are finitely many
intervals Ij1 , . . . , Ij` whose union contains the subinterval [(a + b)/2, b], then the union of
Ii1 , . . . , Iik , Ij1 , . . . , Ij` contains [a, b], which contradicts the original assumption (marked
in red).
Without loss of generality, suppose [a, (a + b/2)] is such that there is no finite subcollec-
tion of (Ij )j∈J whose union contains [a, (a + b)/2]. Set K1 = [a, (a + b)/2].
Now repeat the bisection process on K1 (subinterval with no finite subcollection of (Ij )j∈J
whose union contains it) to obtain K2 which also satisfies the same property: there is no
finite subcollection of (Ij )j∈J whose union contains K2 .
This way we get a decreasing sequence of closed intervals K1 ⊃ K2 ⊃ . . . Kn ⊃ Kn+1 ⊃
....
By the nested interval theorem, ∩n Kn is non-empty. Let c ∈ ∩n Kn .
Note that the length of the interval Kn is (b − a)/2n , for each n ≥ 1.
Since c ∈ [a, b] ⊆ ∪j∈J Ij , the point c ∈ Ij for some j ∈ J.
Let Ij = (p, q).
Choose N ∈ N such that (b − a)/2N < min{c − p, q − c} (there exists such N by the
Archimedian property).
Then c ∈ KN ⊆ Ij (in a single picture, draw the interval Ij = (p, q), the point c in it, and
the interval KN whose length is (b − a)/2N , which also contains c).
Since KN was chosen so that no finite subcollection of (Ij )j∈J whose union contains KN ,
and now we have produced a single set from this collection which contains KN . This is
a contradiction.
Hence [a, b] is compact.
Cantor Set. This set was introduced by Georg Cantor in 1883, now known as the Cantor
set. There are several generalizations of the Cantor set. The most standard Cantor set
is described below, known as the Cantor ternary set.
• Let I = [0, 1].
• Let
A1 = I \ (1/3, 2/3) = [0, 1/3] ∪ [2/3, 1]
(remove the middle-third open interval to get 2 disjoint closed intervals).
• Let
A2 = A1 \ {(1/9, 2/9) ∪ (7/9, 8/9)} = [0, 1/9] ∪ [2/9, 1/3] ∪ [2/3, 7/9] ∪ [8/9, 1]
(remove the middle-third open interval to get 22 = 4 disjoint closed intervals of
length 1/32 = 1/9).
• and so on to obtain An , n ≥ 3. At this stage, we have 2n disjoint closed intervals,
each of length 1/3n .
• We obtain a nested sequence A1 ⊃ A2 ⊃ . . . An ⊃ An+1 . . . .
12 NIKITA AGARWAL
• Let
C = ∩∞
n=1 An .
Sequences.
Convergence.
Definition 3.4. Let (xn )n≥1 be a sequence of real numbers. We say that (xn ) converges
to x ∈ R if for any given > 0, there exists N ∈ N such that |xn − x| < , for all n ≥ N .
Observe that |xn − x| < ⇐⇒ xn ∈ (x − , x + )
If (xn ) converges, we say that (xn ) is convergent. The number x is called the limit
of the sequence and we write x = limn→∞ xn = limn xn or xn → x.
The sequence (xn ) is said to be divergent if it is not convergent.
Remark 3.5. • N depends on .
• If N works, then any other number larger than N also works.
• If N works for , then it works for any real number larger than .
Question: What does it mean to say that (xn ) does not converge to x? (denoted as
limn xn 6= x or xn 9 x.)
Answer: There exists > 0 such that for all N ∈ N, |xn − x| ≥ for some n ≥ N .
Example 3.6. Consider the sequence xn = 1/2n , n ≥ 1. We prove that xn → 0.
• Let > 0 we given.
• To find N ∈ N such that |1/2n − 0| < , for all n ≥ N .
• First note that if 1/2N < , then 1/2n < , for all n ≥ N . (decreasing terms)
• Let us work backwards.
• 1/2N < if and only if N > log2 (1/). Archimedian property guarantees existence
of such an N ∈ N.
• An important point to note is that N depends on .
Example 3.7. Consider the sequence xn = (−1)n , n ≥ 1. We prove that xn is divergent.
• The sequence is (−1, 1, −1, 1, . . . ). Suppose the sequence converges to x ∈ R.
• Let 0 < < 1. Since the length of the interval (x − , x + ) is 2 < 2, the interval
can contain either 1 or -1.
• Since all the odd terms equal -1 and all the even terms equal 1, there is no cutoff
N ≥ 1 such that |xn − x| < , for all n ≥ N .
Theorem 3.8. (Uniqueness of limit) Let (xn ) be a sequence of real numbers. If xn → x
and xn → y, then x = y.
|x − y|
Proof. • Suppose x 96=Pagey.1 Let =
New Section > 0.
2
• Since xn → x, there exists N1 ∈ N such that |xn − x| < for all n ≥ N1 .
• Since xn → y, there exists N2 ∈ N such that |xn − y| < for all n ≥ N2 .
• Let N = max{N1 , N2 }. For n ≥ N , |xn − x| < and |xn − y| < .
• Let n ≥ N . Consider |x − y| ≤ |x − xn | + |xn − y| < 2 = |y − x|, which is absurd.
Remark: Any smaller than the one chosen here will work for this argument.
14 NIKITA AGARWAL
Example 3.9. Let an = (n + 1)/(2n + 3), for n ≥ 1. Does it converge? If yes, what is
the limit?
It does converge to 1/2.
• Let > 0 be given. We will find a suitable N ∈ N.
• Let us work backwords.
• |(n + 1)/(2n + 3) − 1/2| = 1/2(2n + 3) < 1/n, since n < 2(2n + 3).
• Choose any natural number N > 1/. Again Archimedian property guarantees
existence of such a N .
• Then for n ≥ N , |(n + 1)/(2n + 3) − 1/2| < 1/n ≤ 1/N < .
• Thus 1/2 is the limit (by uniqueness of limit).
Theorem 3.10. (Change the first few terms) Let (xn ) be a sequence of real numbers
converging to x ∈ R. Fix K ∈ N. Let (yn ) be another sequence of real numbers with
yn = xn , for all n ≥ K. Then yn → x.
Proof. Let > 0 be given.
Since xn → x, there exists N ≥ 1 such that |xn − x| < , for all n ≥ N .
Let N0 = max{N, K}.
Then for n ≥ N0 , |yn − x| = |xn − x| < .
Theorem 3.11. Let (xn ) be a sequence of real numbers. If xn → x, then |xn | → |x|.
However the converse is not true.
Proof. Let > 0 be given.
Since xn → x, there exists N ≥ 1 such that |xn − x| < , for all n ≥ N .
Consider ||xn | − |x|| ≤ |xn − x| < , for all n ≥ N .
Converse: xn = (−1)n diverges but |xn | = 1 converges being a constant sequence.
Definition 3.12. A New Section 10 Page 1
sequence (xn ) is real numbers is said to be bounded if there exists
M > 0 such that |xn | ≤ M , for all n.
Example 3.13. xn = (−1)n is bounded with M = 1, but is not convergent.
Theorem 3.14. Every convergence sequence of real numbers is bounded. (Converse is
not true!)
Proof. Proof 1: Let (xn ) be a sequence of real numbers converging to x ∈ R. Then
|xn | → |x|. Hence for = 1, there exists N ≥ 1 such that |xn | < |x| + 1, for all n ≥ N .
Let M = max{1 + |x|, |x1 |, |x2 |, . . . , |xN −1 |} ≥ 0.
Then |xn | ≤ M , for all n.
iii) We will use |xn yn − xy| ≤ |xn yn − xyn | + |xyn − xy| = |xn − x||yn | + |x||yn − y|.
Let > 0 be given. We need three estimates.
a) Since (yn ) is convergent, it is bounded, hence |yn | ≤ M , for all n ∈ N , for some M > 0.
b) Since xn → x, there exists N1 ∈ N such that |xn − x| < /2M , for all n ≥ N1 .
c) Since yn → y, there exists N2 ∈ N such that |yn − y| < /2(|x| + 1), for all n ≥ N2 .
For all n ≥ N = max{N1 , N2 }, combining a), b), and c), we get
|xn yn − xy| ≤ |xn − x||yn | + |x||yn − y| < /2 + |x|/2(|x| + 1) < .
4. Week 4
Vector space. Let C be the set of all convergent sequences of real numbers. It forms a
vector space under the operations:
(xn ) + (yn ) := (xn + yn )
a.(xn ) := (axn ).
The map T : C → R defined as
T ((xn )) := lim xn ,
n
Definition 4.7. Let (xn ) be a sequence of real numbers that is not bounded above, we
define lim supn→∞ xn = ∞.
Examples.
(1) (xn ) = (1, 2, 1, 2, 1, 2, . . . ). Here Mn = sup{xk : k ≥ n} = 2. Hence
lim sup xn = lim Mn = 2.
n→∞ n→∞
Limit inferior or liminf. Let (xn ) be a sequence of real numbers that is bounded below.
For each n ∈ N, let
mn = inf{xk : k ≥ n} = inf{xn , xn+1 , . . . }.
Each mn exists since the sequence (xn ) is bounded below. (glb property)
Note that mn+1 ≥ mn , for all n ∈ N.
Hence (mn ) is a non-decreasing sequence of real numbers.
Theorem 4.8. The sequence (mn ) either diverges to ∞ or converges to sup{mn : n ∈
N}.
Proof is left as an exercise (similar to the proof of Theorem 4.5).
Definition 4.9. Let (xn ) be a sequence of real numbers that is bounded below and let
mn = inf{xn , xn+1 , . . . }.
a) If (mn ) converges, we define
lim inf xn = lim mn = sup{mn : n ∈ N}.
n→∞ n→∞
Definition 4.10. Let (xn ) be a sequence of real numbers that is not bounded below, we
define lim inf n→∞ xn = −∞.
18 NIKITA AGARWAL
Examples.
(1) (xn ) = (1, 2, 1, 2, 1, 2, . . . ). Here mn = inf{xk : k ≥ n} = 1. Hence
lim inf xn = lim mn = 1.
n→∞ n→∞
n
(2) xn = (−1) . Here mn = inf{xk : k ≥ n} = −1. Hence
lim inf xn = lim mn = −1.
n→∞ n→∞
(3) (xn ) = (1, −1, 1, −2, 1, −3, . . . , 1, −n, . . . ). Since (xn ) is not bounded below,
lim inf xn = −∞.
n→∞
A few observations.
• If (xn ) is a non-increasing sequence of real numbers, then Mn = sup{xk : k ≥
n} = xn , for all n ∈ N. Hence
lim sup xn = lim Mn = lim xn .
n→∞ n→∞ n→∞
• Changing a few terms of the sequence (xn ) does not change liminf and limsup.
This is because the tail of the sequence (xn ) remains unaltered, hence the tail of
(mn ) and (Mn ) remains unaltered.
Lemma 4.11. Let xn → x and yn → y. Let xn ≤ yn for all n ∈ N. Then x ≤ y.
Proof. On the contrary, suppose x > y.
Let = (x − y)/2.
Since xn → x, there exists N1 ≥ 1 such that x − < xn < x + , for all n ≥ N1 .
Since yn → y, there exists N2 ≥ 1 such that y − < yn < y + , for all n ≥ N2 .
Note y + = x − = (x + y)/2.
Let N = max{N1 , N2 }. Then
yN < (x + y)/2 < xN ,
which is a contradiction. Hence x ≤ y.
Remark 4.12. If xn < yn , for all n ∈ N in the preceding theorem, then x = y is possible.
For instance, take xn = −1/n and yn = 1/n, for all n ∈ N.
Theorem 4.13. Let (xn ) be a convergent sequence in R. Then
lim sup xn = lim inf xn = lim xn .
n→∞ n→∞ n→∞
Proof. Let xn → x. Let > 0 be given. Then there exists N ∈ N such that |xn −x| < /2,
for all n ≥ N . That is, for all n ≥ N , x − /2 < xn < x + /2.
Thus x+/2 is an upper bound and x−/2 is not an upper bound for the set {xk : k ≥ n}.
Hence for all n ≥ N ,
x − < x − /2 ≤ mn ≤ Mn ≤ x + /2 < x + .
Hence Mn → x and mn → x.
LECTURE NOTES ON REAL ANALYSIS I 19
Then xn → x.
Proof. Let > 0 be given.
Since lim supn→∞ xn = x, there exists N1 ∈ N such that x − < Mn < x + , for all
n ≥ N1 .
Similarly since lim inf n→∞ xn = x, there exists N2 ∈ N such that x − < mn < x + , for
all n ≥ N2 .
Let N = max{N1 , N2 }.
Then for n ≥ N ,
x − < mN ≤ xn ≤ MN < x + .
Hence xn → x.
Theorem 4.15. (Relationship between limsup and liminf ) Let (xn ) be a sequence of real
numbers, then
lim inf xn ≤ lim sup xn .
n→∞ n→∞
Proof. a) If (xn ) is bounded: Note that for all n ∈ N, mn ≤ Mn . Taking limits on both
sides, we have the required result (use Lemma 4.11).
b) If (xn ) is bounded above but not below: The result follows immediately since liminf
equals −∞.
c) If (xn ) is bounded below but not above: The result follows immediately since limsup
equals ∞.
Results discussed without proof in the class.
Theorem 4.16. Let (xn ) be a sequence of real numbers which is bounded above. Then
lim sup xn = − lim inf (−xn ).
n→∞ n→∞
Theorem 4.19. If (xn ), (yn ) are bounded sequences of real numbers and xn ≤ yn , for all
n. Then
lim sup(xn + yn ) ≤ lim sup xn + lim sup yn , lim inf (xn + yn ) ≥ lim inf xn + lim inf yn .
n→∞ n→∞ n→∞ n→∞ n→∞ n→∞
Proof. 1) a) Let > 0 be given. Then there exists N ≥ 1 such that M − < Mn < M +,
for all n ≥ N . Hence xn ≤ MN < M + , for all n ≥ N .
1 b) Suppose there exists > 0 such that xn > M − for only finitely many values
of n.
Then there exists N ∈ N such that xn ≤ M − , for all n ≥ N .
Hence Mn ≤ M − , for all n ≥ N . Using Lemma 4.11, we have M ≤ M − , which is a
contradiction.
2) a) Let > 0 be given. Then there exists N ≥ 1 such that m − < mn < m + , for
all n ≥ N . Hence m − < mN ≤ xn , for all n ≥ N .
2 b) Suppose there exists > 0 such that xn < m + for only finitely many values
of n.
Then there exists N ∈ N such that xn ≥ m + , for all n ≥ N .
Hence mn ≥ m + , for all n ≥ N . Using Lemma 4.11, we have m ≥ m + , which is a
contradiction.
Definition 4.21. Let (xn ) be a sequence of real numbers. Let (nk )k≥1 be an increasing
sequence of natural numbers. That is, n1 < n2 < n3 < . . . . Then (xnk )k≥1 is called a
subsequence of the sequence (xn ).
Note that limk→∞ nk = ∞.
exam: Constant sequences (1) and (−1) are both subsequences of ((−1)n ).
Theorem 4.22. Any bounded sequence of real numbers has a convergent subsequence.
Proof. We will construct a subsequence of (xn ) which converges to lim sup xn . Using sim-
ilar arguments, one can construct a subsequence of (xn ) which converges to lim inf xn .
Let > 0 be given. There exists N ∈ N such that xn > m − , for all n ≥ N .
Choose K ∈ N such that 1/K < and nK > N .
Then m − < xnk < m + 1/k ≤ m + 1/K < m + , for all k ≥ K.
Hence m − < xnk < m + , for all k ≥ K.
The subsequence (xnk )k≥1 converges to m.
Definition 4.23. A sequence (xn ) in R is said to be a Cauchy sequence if given > 0,
there exists N ∈ N such that |xn − xm | < , for all n, m ≥ N .
Example 4.24. We will prove that xn = n/(n + 1) is a Cauchy sequence. Consider
n m n−m
|xn − xm | = − = .
n+1 m+1 (n + 1)(m + 1)
Without loss of generality, assume that m ≤ n, then
n−m n−m n 1 1
= ≤ ≤ < .
(n + 1)(m + 1) (n + 1)(m + 1) (n + 1)(m + 1) m+1 m
Let > 0 be given. Choose N ≥ 1 such that 1/N < . Then for all n ≥ m ≥ N ,
1 1
|xn − xm | < ≤ < .
m N
Theorem 4.25. A Cauchy sequence of real numbers is bounded.
Proof. For = 1, there exists N ∈ N such that |xn − xm | < 1, for all n, m ≥ N .
In particular, setting m = N , |xn − xN | < 1, for all n ≥ N .
Hence |xn | ≤ |xn − xN | + |xN | < 1 + |xN |, for all n ≥ N .
Let C = max{|x1 |, . . . , |xN −1 |} ≥ 0 and let M = max{C, 1 + |xN |} > 0.
Then |xn | ≤ M , for all n ∈ N.
Theorem 4.26. A convergent sequence of real numbers is Cauchy.
Proof. Let xn → x.
We will use |xn − xm | ≤ |xn − x| + |xm − x|, for all n, m ∈ N.
Given > 0, there exists N ∈ N such that |xn − x| < /2.
Hence for n, m ≥ N , |xn − xm | ≤ |xn − x| + |xm − x| < .
Lemma 4.27. If for any given > 0, x ≤ y + , then x ≤ y.
Proof. Suppose x > y. Choose = (x − y)/2 > 0. Then y + = x − < x, which is a
contradiction.
Theorem 4.28. A Cauchy sequence of real numbers is convergent. This property of real
numbers is called Cauchy completeness of R or just completeness.
Proof. Let > 0 be given. Since (xn ) is Cauchy, it is bounded. Hence it is enough to
prove that M = lim supn→∞ xn = lim inf n→∞ xn = m.
Since m ≤ M (Theorem 4.15), it is enough to show that m ≥ M .
Since (xn ) is Cauchy, there exists N ∈ N such that |xn − xm | < /2, for all n, m ≥ N .
Thus xN + /2 and xN − /2 are ub and lb, respectively, of {xk : k ≥ n}, for all n ≥ N .
Therefore xN − /2 ≤ mn ≤ Mn ≤ xN + /2, for all n ≥ N .
Hence Mn − mn ≤ ⇒ Mn ≤ mn + , for all n ≥ N .
Taking limits on both sides, we get M ≤ m + .
Since > 0 is arbitrary, we obtain M ≤ m. (Lemma 4.27)
Example 4.29. Let X = {1/n : n ≥ 1} and sequence (xn ) = (1/n). Since (xn ) is
convergent in R, it is Cauchy in R, and hence Cauchy in X. However it is not convergent
in X since 0 ∈
/ X.
22 NIKITA AGARWAL
Example 4.30. (Cauchy sequence of rational √ numbers) We know that there is a sequence
of rational numbers (xn ) that converges to 2.
Since (xn ) is convergent in R, it is Cauchy in R (also in Q.)
But (xn ) is not convergent in Q.
This gives a definition of the set of real numbers. We will get back to it later.
Theorem 4.31. (Well-ordering principle) Every nonempty subset of natural numbers
has a least element.
Proof. Suppose there is no least element.
Then 1 ∈/ S, otherwise 1 is the least element.
Therefore 2 ∈/ S, otherwise it is the least element.
In a similar fashion, if 1, . . . , n ∈
/ S and n + 1 ∈ S, then n + 1 is the least element.
Hence S is an empty set. Thus we have arrived at a contradiction.
Theorem 4.32. (Enumeration) An infinite subset S of natural numbers can be written
as {n1 < n2 < · · · < nk < nk+1 < . . . }.
Proof. Since S is a non-empty subset of natural numbers, it has a least element, n1 say
(by the well-ordering principle).
Consider the set S1 = S \ {n1 }, which is a non-empty subset of natural numbers, it has
a least element, n2 say. Note n1 < n2 .
In this fashion, suppose we have chosen n1 , . . . , nk ∈ S such that n1 < n2 < · · · < nk .
The set Sk = S \ {n1 , . . . , nk } is non-empty since S is an infinite set. Hence we can chose
nk+1 , the least element of Sk . Note nk < nk+1 .
Note that there is no element in S which lies between nk and nk+1 , otherwise that is the
least element of Sk .
Thus we have recursively defined an increasing sequence of natural numbers (nk )k such
that no element in S which lies between nk and nk+1 .
Claim 1: k ≤ nk .
1 ≤ n1 < n2 . Hence 2 ≤ n2 . Suppose k ≤ nk . Then since k ≤ nk < nk+1 , we get
k + 1 ≤ nk+1 .
Claim 2: This process exhausts all the elements in S.
Suppose not, and let m be the least element of S \ {nk : k ≥ 1}.
Since m ∈ S and m ≤ nm . Since m 6= nm , we have m < nm , hence m must equal some
nk for 1 ≤ k < m, which is a contradiction.
Theorem 4.33. Let xn → x, then any subsequence (xnk ) converges to x.
Proof. Let > 0 be given.
There exists N ∈ N such that |xn − x| < , for all n ≥ N .
Then for k ≥ N , since nk ≥ k, we have nk ≥ N .
Therefore for all k ≥ N , |xnk − x| < .
Theorem 4.34. Every sequence of real numbers has a monotone subsequence (non-
decreasing or non-increasing).
Proof. Let (xn ) be a sequence of real numbers.
Consider the set
S = {n ∈ N : xm < xn for all m > n}.
There are two cases: S is finite or infinite.
then n1 ∈/ S. Hence there exists n2 > n1 such that xn2 ≥ xn1 . Since n2 > n1 > N ,
there exists n3 > n2 such that xn3 ≥ xn2 . This way we have constructed a non-decreasing
subsequence (xnk ).
b) S infinite: S can be written as {n1 < n2 < · · · < nk < nk+1 < . . . }.
By the definition of S, xnk+1 < xnk , for all k ≥ 1.
Hence we have a decreasing subsequence (xnk ).
Theorem 4.35. A non-decreasing sequence is either convergent or diverges to +∞.
Proof. Let (xn ) be a non-decreasing sequence, that is, xn ≤ xn+1 , for all n ≥ 1.
The sequence is bounded below as well, by x1 .
For each n ≥ 1, mn = inf{xk : k ≥ n} = xn .
Since lim inf xn = lim mn = sup{mn : n ≥ 1} = sup{xn : n ≥ 1}, we have
lim xn = sup{xn : n ≥ 1}.
which is either finite (if (xn ) is bounded), or diverges to +∞.
Theorem 4.36. A non-increasing sequence is either convergent or diverges to −∞.
Theorem 4.37. (Bolzano-Weierstrass Theorem) A bounded sequence of real numbers has
a convergent subsequence.
We proved this earlier. Now we give another proof.
Proof. Let (xn ) be a bounded sequence.
It has a monotone subsequence (xnk )k≥1 .
Since (xn ) is bounded, (xnk ) is also bounded.
Hence (xnk ) is a bounded monotone sequence.
Therefore it converges.
24 NIKITA AGARWAL
5. Week 5
Definition 5.1. Let E be a subset of R. Let f : E → R be a function. Let a ∈ E and
` ∈ R. We say that f (x) → ` as x → a if given > 0, there exists δ > 0 such that
|f (x) − `| < , whenever |x − a| < δ, x ∈ E.
Definition 5.2. Let E be a subset of R. Let f : E → R be a function. We say that f is
continuous at a point a ∈ E if f (x) → f (a) as x → a. That is, given > 0, there exists
δ > 0 such that
|f (x) − f (a)| < , whenever |x − a| < δ, x ∈ E.
If f is continuous at each point of E, we say that f is continuous on E.
Definition 5.3. Let E be a subset of R. Let f : E → R be a function. We say that f is
uniformly continuous on E if for given > 0, there exists δ > 0 such that
|f (x) − f (y)| < , whenever |x − y| < δ, x ∈ E.
Uniformly continuous implies continuous.
Example 5.4. (1) Let f : [0, 1] → R be defined as f (x) = x2 , for all x ∈ [0, 1]. Then
|f (x) − f (y)| = |x2 − y 2 | = (x + y)|x − y| ≤ 2|x − y|.
For given > 0, choose δ = /2 > 0. Thus f is uniformly continuous.
In fact, any continuous function on a closed interval [a, b] is uniformly continuous.
(2) In the previous example, if the domain of f is R, instead of [0, 1], then f is
continuous on R but not uniformly continuous.
a) f continuous: Let a ∈ R. Suppose |x − a| < 1, then
|x + a| ≤ |x − a| + 2|a| < 1 + 2|a|.
Let > 0 be given. Choose δ < min{1, 1+2|a| }, then
|f (x) − f (a)| = |x2 − a2 | = (x + a)|x − a| ≤ (1 + 2|a|)|x − a| < ,
whenever |x − a| < δ.
b) f not uniformly continuous: For = 1, there exists δ > 0 such that
|f (x) − f (y)| < 1,
whenever |x − y| < δ. Choose m = 1/δ, x = m − δ/4, y = m + δ/4, then
1 > |x − y||x + y| = 1,
which is a contradiction.
(3) Let f : (0, 1] → R be defined as f (x) = 1/x, for all x ∈ (0, 1]. Let a ∈ (0, 1].
a) f is continuous: Suppose |x − a| < a/2, then x > a/2. For given > 0, choose
δ = min{a/2, a2 /2}. Then
|f (x) − f (a)| = |1/x − 1/a| = |x − a|/(xa) < 2|x − a|/a2 < ,
whenever |x − a| < δ, x ∈ (0, 1].
b) f is not uniformly continuous: For = 1, let δ > 0 be such that
|f (x) − f (y)| < 1,
whenever |x − y| < δ, x, y ∈ (0, 1].
Choose n ≥ 1 large enough so that x = 1/n, y = 1/n + δ/(2n) ∈ (0, 1], then
|x − y| = δ/(2n) < δ. Hence
2n nδ
1 > |f (x) − f (y)| = |n − |= .
2+δ 2+δ
LECTURE NOTES ON REAL ANALYSIS I 25
2+δ
Further choose n ≥ δ
to arrive at a contradiction.
Definition 5.5. Let E be an interval in R. Let f : E → R be a function. We say that
f is differentiable at a point a ∈ E if
f (x) − f (a)
lim
x→a,x∈E x−a
exists. If the limit exists, it is known as the derivative of the function f at a, denoted as
f 0 (a). If f is differentiable at each point of E, we say that f is differentiable on E. In
this case, the function f 0 : E → R is known as the derivative of the function f on E.
Definition 5.6. Let f : [a, b] → R be a function. Let P = {a = x0 < x1 < · · · < xn−1 <
xn = b} be a partition of [a, b]. We define the mesh size of P as
kP k = max (xk − xk−1 ).
k=1,2,...,n
We say that f is Riemann-integrable on [a, b] if for given > 0, there exists δ > 0 such
that for each partition P of [a, b] with kP k < δ, we have
|U (P, f ) − L(P, f )| < .
Remark 5.7. The above definition is equivalent to the following:
We say that f is Riemann-integrable on [a, b] if for given > 0, there exists a partition
P of [a, b] such that
|U (P, f ) − L(P, f )| < .
Sequence of functions. Let E be a non-empty subset of R. For each n ≥ 1, let
fn : E → R be a function. We will study the sequence (fn )∞
n=1 of functions.
Definition 5.8. (Pointwise convergence) We say that the sequence (fn ) converges to a
function f : E → R pointwise on E if for all x ∈ E,
lim fn (x) = f (x).
n→∞
pw
We will often denote it as fn −→ f .
Remark 5.9. 1) Let x ∈ E. Given > 0, there exists N ∈ N such that for all n ≥ N ,
|fn (x) − f (x)| < .
The natural number N above depends on both x and .
It is quite possible that there is no common N that works for all x ∈ E.
pw pw
2) fn −→ f iff fn − f −→ 0.
Example 5.10. Consider fn (x) = xn on [0, 1]. Note that
lim fn (1) = lim 1 = 1,
n→∞ n→∞
n
lim fn (x) = lim x = 0, for x ∈ [0, 1).
n→∞ n→∞
Define f (x) = 0, x ∈ [0, 1) and f (1) = 1.
pw
Then fn −→ f .
26 NIKITA AGARWAL
Let x ∈ (0, 1). By the Archimedian property, there exists N ∈ N such that 1/N < x.
Hence χ(0,1/n) (x) = 0, for all n ≥ N .
pw
Thus fn −→ 0 (the zero function).
Let x ∈ (0, ∞). By the Archimedian property, there exists N ∈ N such that N > x.
Hence χ(0,n) (x) = 1, for all n ≥ N .
pw
Thus fn −→ 1 (the constant function 1).
Definition 5.13. (Uniform convergence) We say that the sequence (fn ) converges to a
function f : E → R uniformly on E if for given > 0, there exists N ∈ N such that
Remark 5.14. 1) In the above definition, the natural number N depends only on and
NOT x (as in pointwise convergence).
u pw
2) If fn →
− f then fn −→ f .
u u
3) fn →− f iff fn − f →
− 0.
Not converging uniformly. Observe that fn does not uniformly converge to f if and
only if there exists > 0 such that for all N ∈ N,
|fn (x) − f (x)| ≥ ,
for some n ≥ N and for some x ∈ E.
Theorem 5.17. (An alternate definition of uniform convergence) The sequence (fn )
converges uniformly to a function f on E if and only if
lim sup |fn (x) − f (x)| = 0.
n→∞ x∈E
u
Proof. Let fn →
− f . Then for given > 0, there exist N ∈ N such that
|fn (x) − f (x)| < /2,
for all n ≥ N , for each x ∈ E.
Hence
sup |fn (x) − f (x)| ≤ /2 < , for all n ≥ N.
x∈E
Therefore
lim sup |fn (x) − f (x)| = 0.
n→∞ x∈E
Converse: Let limn→∞ supx∈E |fn (x) − f (x)| = 0. Let > 0 be given. Then there exists
N ≥ 1 such that for all n ≥ N ,
sup |fn (x) − f (x)| < .
x∈E
Hence
|fn (x) − f (x)| ≤ sup |fn (x) − f (x)| < ,
x∈E
u
for all x ∈ E, for all n ≥ N . Hence fn →
− f.
Definition 5.18. We say that (fn ) is uniformly Cauchy on E if and only if for given
> 0, there exists N ∈ N such that
|fn (x) − fm (x)| < ,
for all m, n ≥ N , for each x ∈ E.
Theorem 5.19. The sequence (fn ) converges uniformly to the function f on E if and
only if (fn ) is uniformly Cauchy on E.
u
Proof. (⇒) Let > 0 be given. Since fn →
− f , there exists N ∈ N such that
|fn (x) − f (x)| < /2,
for all n ≥ N and for each x ∈ E.
Thus for all n, m ≥ N and for each x ∈ E,
|fn (x) − fm (x)| ≤ |fn (x) − f (x)| + |fm (x) − f (x)| < /2 + /2 = .
(⇐) Let > 0 be given. There exists N ∈ N such that |fn (x) − fm (x)| < /2, for all
m, n ≥ N and for each x ∈ E.
Let x ∈ E.
By the Cauchy completeness of R, for each x ∈ E, since (fn (x))n is a Cauchy sequence,
it converges. Let us denote the limit as `x ∈ R.
Now define f (x) := `x , for all x ∈ E. This is nothing but the pointwise limit of (fn ).
u
We prove that fn → − f on E.
Since |fn (x) − fm (x)| < /2, for all m, n ≥ N and for each x ∈ E, fix x ∈ E, n ≥ N , and
28 NIKITA AGARWAL
let limm→∞ on both sides in |fn (x) − fm (x)| < /2, we obtain |fn (x) − f (x)| ≤ /2 < .
This is true for all n ≥ N and for each x ∈ E.
u
Hence fn →− f on E.
u
Theorem 5.20. Let fn →
− f on E. For all n ≥ 1, let fn be bounded on E. Then f is
bounded on E.
u
Proof. Since fn →
− f , there exists N ∈ N such that for all n ≥ N and for each x ∈ E,
|fn (x) − f (x)| < 1.
Further since fN is bounded on E, there exists M > 0 such that for all x ∈ E,
|fN (x)| < M.
Hence for each x ∈ E,
|f (x)| ≤ |f (x) − fN (x)| + |fN (x)| < 1 + M.
1
Example 5.21. Let fn (x) = χ[1/n,1] , x ∈ (0, 1]. Since |fn (x)| ≤ n, for each n ≥ 1,
x
x ∈ (0, 1], (fn ) is a sequence of bounded functions.
Let f (x) = 1/x, x ∈ (0, 1]. Note that f is not a bounded function.
Let x ∈ (0, 1], then there exists N ≥ 1 such that 1/N < x, hence 1/n ≤ 1/N < x, for all
n ≥ N.
Therefore fn (x) = 1/x, for all n ≥ N . Thus limn→∞ fn (x) = 1/x, for each x ∈ (0, 1].
pw
Hence fn −→ f on (0, 1].
However the limit f cannot be uniform by the preceding result. Let us also prove this
directly. Suppose it is uniform. Then for = 1, there exists N ≥ 1 such that |fn (x) −
1/x| < 1, for all n ≥ N , for each x ∈ E. In particular, for n = N and x = 1/(2N ),
1 > |fn (x) − 1/x| = 2N , which is a contradiction.
u
Theorem 5.22. Let fn → − f on E. For all n ≥ 1, let fn be continuous at a point a ∈ E.
Then f is continuous at a.
u
Proof. Let > 0 be given. Since fn →
− f , there exists N ∈ N such that for all n ≥ N and
for each x ∈ E,
|fn (x) − f (x)| < /3.
Further since fN is continuous at a, there exists δ > 0 such that for all x ∈ E with
|x − a| < δ,
|fN (x) − fN (a)| < /3.
Hence for each x ∈ E with |x − a| < δ,
|f (x) − f (a)| ≤ |f (x) − fN (x)| + |fN (x) − fN (a)| + |fN (a) − f (a)| < .
Example 5.23. Let fn (x) = xn , x ∈ [0, 1].
pw
Then fn −→ f , where f (x) = 0, x ∈ [0, 1), f (1) = 1. But f is not a uniform limit.
Each fn is continuous on [0, 1] but f is not continuous at 1.
u
Theorem 5.24. Let E = [a, b], fn : E → R be Riemann integrable on E. Let fn →
− f on
Rb Rb
E. Then f is Riemann integrable on E and a f (x) dx = limn→∞ a fn (x) dx.
LECTURE NOTES ON REAL ANALYSIS I 29
u
Proof. Let > 0 be given. Since fn →
− f , there exists N ∈ N such that for all n ≥ N ,
(Theorem 8, Lecture 11)
sup |fn (x) − f (x)| < ⇒ fN (x) − < f (x) < fN (x) + , ∀ x ∈ E.
x∈E 4(b − a) 4(b − a) 4(b − a)
Since fN is R.I., there exists a partition P = {a = x0 < x1 < · · · < xn = b} of E such
that
U (P, fN ) − L(P, fN ) < .
2
Let Mj (g) = supx∈[xj−1 ,xj ] g(x) for any function g and j = 1, . . . , n. Then for each j,
Mj (f ) ≤ Mj (fN ) + /4(b − a).
Multiplying both sides by (xj − xj−1 ) and sum over j, we get U (P, f ) ≤ U (P, fN ) + /4.
Similarly L(P, f ) ≥ L(P, fN ) − /4.
We have U (P, fN )−L(P, fN ) < , U (P, f ) ≤ U (P, fN )+/4 and L(P, f ) ≥ L(P, fN )−/4.
2
Combining these three inequalities we obtain U (P, f )−L(P, f ) < . Hence f is integrable
on E.
Note
Z b Z b Z b
fn (x) dx − f (x) dx ≤ |fn (x) − f (x)| dx ≤ sup |fn (x) − f (x)|(b − a) < ,
a a a x∈E
for all n ≥ N .
u
Corollary 5.24.1. Let E = [a, b], fn : E → R be continuous. Let fn →
− f on E. Then f
Rb Rb
is continuous hence Riemann integrable on E and a f (x) dx = limn→∞ a fn (x) dx.
Proof follows from Theorem 5.24.
Example 5.25. Let (rn ) be an enumeration of Q ∩ [0, 1].
Let fn (x) = χ{r1 ,...,rn } (x), x ∈ [0, 1].
fn is continuous at all points except r1 , . . . , rn , hence is Riemann integrable on [0, 1].
pw
fn −→ f on [0, 1] with f = χQ (Dirichlet’s function).
The limit function f is not Riemann integrable (it is nowhere continuous on [0, 1]).
Theorem 5.26. (Dini’s Theorem) Let E = [a, b], fn , f : E → R be continuous. Let
pw u
fn −→ f on E. Assume that fn (x) ≤ fn+1 (x), for all n ≥ 1 and x ∈ E. Then fn →
− f on
E.
Proof. Note that f (x) = supn≥1 fn (x), for all x ∈ E.
Define gn = f − fn , then for each x ∈ E,
g1 (x) ≥ g2 (x) ≥ · · · ≥ gn (x) ≥ gn+1 (x) ≥ · · · ≥ 0.
pw pw
Since each fn is continuous and fn −→ f , we have that each gn is continuous and gn −→ 0.
u u u
Since fn →
− f if and only if gn →
− 0, we will show that gn →− 0.
pw
Let > 0 be given. Since gn −→ 0, for each x ∈ E, there exists Nx ∈ N such that
gNx (x) < /2.
Since gNx is continuous at x, there exists δx > 0 s.t. for all y ∈ (x − δx , x + δx ) = Ix ,
gNx (y) < gNx (x) + /2 < .
From the previous steps, we have for all y ∈ (x − δx , x + δx ) = Ix ,
gNx (y) < .
30 NIKITA AGARWAL
The collection (Ix )x∈E is an open cover of E since E = ∪x∈E {x} ⊂ ∪x∈E Ix .
Since E = [a, b] has property (C), there exists finitely many points x1 , . . . , xk such that
E ⊂ ∪ki=1 Ixi .
Let N = max{Nx1 , . . . , Nxk }.
Let y ∈ E, then y ∈ Ixj for some j = 1, . . . , k. Hence
gNxj (y) < .
Since N ≥ Nxj , gN (y) ≤ gNxj (y) < .
Hence 0 ≤ gN (y) < , for each y ∈ E.
Since (gn ) is a decreasing sequence, we get 0 ≤ gn (y) < , for all n ≥ N and for each
y ∈ E.
u
Therefore gn → − 0.
Corollary 5.26.1. (Not discussed in the class) Let E = [a, b], fn , f : E → R be contin-
pw
uous. Let gn −→ g on E. Assume that gn (x) ≥ gn+1 (x), for all n ≥ 1 and x ∈ E. Then
u
gn →
− g on E.
pw
Proof. Let fn = −gn , for all n ≥ 1, and let f = −g. Then fn −→ f on E. Also
u
fn (x) ≤ fn+1 (x), for all n ≥ 1 and x ∈ E. Applying Dini’s theorem, we get fn →
− f on
u
E. Hence gn → − g on E.
Example 5.27. Dini’s theorem does not hold true if one of the hypotheses is dropped.
1) Let E = [0, 1], fn (x) = −xn , for all n ≥ 1 and x ∈ E. Then fn ≤ fn+1 , for all n ≥ 1.
The pointwise limit is not continuous. Also fn does not converge uniformly (we saw this
earlier).
2) Let E = (0, 1] (not closed), fn (x) = −1/(nx + 1), for all n ≥ 1 and x ∈ E. Then
pw
fn ≤ fn+1 , for all n ≥ 1. Here fn −→ 0 on E. Since
1
lim sup |fn (x)| = lim sup = lim 1 = 1.
n→∞ x∈E n→∞ x∈E nx + 1 n→∞
6. Week 6
We first completed the proof of Dini’s theorem from the last lecture of Week 5 and
discussed examples.
Theorem 6.1. Let E be a bounded interval of R. Let fn : E → R be a differentiable
function for all n ≥ 1. Let fn0 converges uniformly to a function g on E. Further assume
there exists a point c ∈ E such that the sequence (fn (c))n of real numbers converges. Then
fn uniformly converges to a continuous function f : E → R on E.
Proof. (Recall Mean value theorem) Let h be a differentiable function on (a, b), then for
any x, y in E,
h(x) − h(y) = h0 (t)(x − y),
for some t between x and y.
We first prove that (fn ) is uniformly Cauchy which implies that (fn ) is uniformly conver-
gent.
Let x ∈ E. Since both fn , fm are differentiable, fn − fm is differentiable.
Using the mean value theorem to the function fn − fm at the points x and c, we get
(fn (x) − fm (x)) − (fn (c) − fm (c)) = (fn0 (d) − fm
0
(d))(x − c),
for some d between x and c. Note that d ∈ E depends on x, c, m, n.
Let > 0 be given.
Since (fn (c))n converges, it is a Cauchy sequence. Hence there exists N1 ≥ 1 such that
for all n, m ≥ N1 ,
|fn (c) − fm (c)| < .
2
0 u 0
Since fn → − g, (fn ) is uniformly Cauchy. Hence there exists N2 ≥ 1 such that for all
n, m ≥ N2 and for each t ∈ E,
|fn0 (t) − fm0
(t)| < .
2(b − a)
Hence for all n ≥ N = max{N1 , N2 } and for each x ∈ E,
|fn (x) − fm (x)| ≤ |fn (c) − fm (c)| + |fn0 (d) − fm 0
(d)||x − c| < + (b − a) = .
2 2(b − a)
Hence (fn ) is uniformly Cauchy. Therefore it is uniformly convergent to a function
f : E → R, say.
u
Since each fn is differentiable on E, it is continuous on E. Further since fn → − f , f is
continuous on E.
Theorem 6.2. Let E be a bounded interval of R. Let fn : E → R be a differentiable
u
function for all n ≥ 1. Let there exist functions f, g : E → R such that fn →
− f and
u
fn0 →
− g on E. Then f is differentiable and f 0 = g on E.
Proof. Fix a ∈ E. For each n ≥ 1, define gn : E → R as
fn (x) − fn (a)
, x=6 a
gn (x) = x−c
f 0 (a), x = a.
n
We now prove that (gn ) is uniformly Cauchy, hence uniformly convergent to a continuous
function k : E → R.
By the mean value theorem, for n, m ≥ 1, x ∈ E, x 6= a, there exists t between x and a
such that
(fn (x) − fm (x)) − (fn (a) − fm (a))
gn (x) − gm (x) = = fn0 (t) − fm
0
(t).
x−a
Since (fn0 )n is uniformly convergent, it is uniformly Cauchy.
Thus (gn ) is uniformly Cauchy on E.
u
Hence there exists a function k : E → R such that gn → − k.
Since the uniform limit is same as the pointwise limit, k = h on E.
Further, since each gn is continuous, the limit function h is continuous.
Hence
f (x) − f (a)
g(a) = lim .
x→a x−a
Thus f is differentiable at a and f 0 (a) = g(a).
Corollary 6.2.1. Let E be a bounded interval of R. Let fn : E → R be a differentiable
function for all n ≥ 1. Let fn0 converges uniformly to a function g on E. Further assume
there exists a point c ∈ E such that the sequence (fn (c))n of real numbers converges. Then
fn uniformly converges to a differentiable function f : E → R on E. Further f 0 = g on
E.
Proof follows from Theorems 6.1 and 6.2.
e−nx
Example 6.3. Let E = [0, 1). For each n ≥ 1, let fn : E → R be defined as fn (x) = n
,
for all x ∈ E. Let > 0 be given. Then
e−nx 1
fn (x) = ≤ < ,
n n
u
for all x ∈ E, n ≥ 1 . Let f be the constant zero function. Hence fn → − f on E.
0 −nx 0
Here fn (x) = −e , for all x ∈ E. Therefore fn (x) converges pointwise to the function
g : E → R defined as g(x) = 0, for all x ∈ (0, 1), and g(0) = −1.
(fn0 ) does not converge uniformly to g on E since each fn0 is continuous on E but g is not.
Clearly f 0 6= g.
Series of functions. Let E be a non-empty subset of R. For each nP ≥ 1, let fn : E → R
be a function. We will study the function given by the infinite series ∞ Pfn . This series
n=1
is defined as the limit of the sequence (sn ) of partial sums, where sn = nk=1 fk .
Definition 6.4. We say that the series ∞
P
n=1 fn is pointwise convergent on E if the
sequence of partial sums (sn ) is pointwise convergent on E.
Proof. Let x ∈ E.
For all n > m ≥ 1, observe that
n
X m
X n
X n
X
|sn (x)−sm (x)| = | fk (x)− fk (x)| = | fk (x)| ≤ |fk (x)| = σn (x)−σm (x).
k=1 k=1 k=m+1 k=m+1
Let >
P0∞be given.
Since n=1 fn is absolutely convergent on E, the sequence (σn ) of functions is convergent
pointwise on E. Hence there exists N ≥ 1 such that
σn (x) − σm (x) < ,
for all n > m ≥ N .
Hence
|sn (x) − sm (x)| ≤ σn (x) − σm (x) < ,
for all n > m ≥ N . Thus (sn (x)) is Cauchy, hence it is convergent. Therefore ∞
P
n=1 fn is
convergent at x ∈ E. This proves the result.
Example 6.6. Let E = [0, 1] and fn (x) = xn , for all n ≥ 1, x ∈ E. Then the sequence
of partial sums is given by
n n
X X x(1 − xn )
sn (x) = fk (x) = xk = , x ∈ [0, 1),
k=1 k=1
1 − x
n
X
sn (1) = fk (1) = n.
k=1
Clearly (sn (x)) converges to f (x) = x/(1 − x), when x ∈ [0, 1), but (sn (1)) does not
converge.
Hence the series ∞
P
n=1 fn converges pointwise on [0, 1) but not at 1.
Is the convergence on [0, 1) uniform?
Consider
x x(1 − xn ) xn+1
|f (x) − sn (x)| = − = ≥ xn+1 ,
1−x 1−x 1−x
the last inequality is true since 1 − x ≤ 1. Hence
lim sup |f (x) − sn (x)| ≥ lim sup xn+1 = lim 1 = 1.
n→∞ x∈[0,1) n→∞ x∈[0,1) n→∞
P
Hence n fn does not uniformly converge to f by Theorem 5.17.
P
Theorem 6.7. (Cauchy criterion for uniform convergence of series) Let n fn be an
infinite series on a set E. It is uniformly convergent on E if and only if for given > 0,
there exists N ∈ N such that for all n, m ≥ N (m ≤ n), and for all x ∈ E,
n
X
fk (x) < .
k=m+1
34 NIKITA AGARWAL
7. Week 7
Theorem 7.1. (Weierstrass M-test) Let (fn ) be a sequence of real-valued functions on a
of real numbers such that |fn (x)| ≤ Mn ,
set E. Assume that there exists a sequence (Mn ) P
n ≥ 1, for each x ∈ E. Also assume that n Mn is a convergent series. Then the
for all P
series n fn is absolutely and uniformly convergent on E.
P
Proof. We prove that n |fn | satisfies the Cauchy criterion.
Let >P0 be given.
Since n Mn is a convergent series, there exists N ∈ N such that nk=m+1 Mk < , for
P
all n ≥ m ≥ N .
Hence for all n ≥ m ≥ N , and for each x ∈ E,
n
X n
X
|fk (x)| ≤ Mk < .
k=m+1 k=m+1
P
Hence n fn is absolutely and uniformly convergent on E by Theorem 6.7.
sin nx
Example 7.2. (An application of Weierstrass M-test) Let p > 1 and fn (x) = ,
np
x ∈ R.
For all n ≥ 1 and x ∈ R,
1
|fn (x)| ≤ p .
n
p
Take M Pn = 1/n in the Weierstrass
P M-test.
Since n Mn P is convergent, n fn is absolutely and uniformly convergent on R.
Further since nk=1 fk is a continuous function on R and the convergence is uniform, the
limit function
X X sin nx
fn (x) =
n n
np
is a continuous function on R.
cos nx
Similar is the case for fn (x) = , x ∈ R.
np
Theorem 7.3. (Dirichlet’s test) Let (fn ), (gn ) be sequences of real-valued functions on a
set E. Let Fn (x) = nk=1 fk (x), for all n ≥ 1. Assume that
P
i) There exists M > 0 such that |Fn (x)| ≤ M , for all n ≥ 1, and for each x ∈ E
(uniformly bounded),
ii) gn+1 (x) ≤ gn (x), for all n ≥ 1, and for each x ∈ E,
u
iii) gn →
− 0 on E. P
Then the series n fn gn is uniformly convergent on E.
Proof. Let sn (x) = nk=1 fk (x)gk (x). By induction on n, it can be shown that
P
n
X
sn (x) = Fk (x) (gk (x) − gk+1 (x)) + gn+1 (x)Fn (x).
k=1
Hence
n
X
|sn (x) − sm (x)| ≤ |Fk (x)| |gk (x) − gk+1 (x)| + |gn+1 (x)||Fn (x)| + |gm+1 (x)||Fm (x)|
k=m+1
Xn
≤ M (gk (x) − gk+1 (x)) + M gn+1 (x) + M gm+1 (x)
k=m+1
= 2M gm+1 (x).
u
Finally since gn →
− 0, for given > 0, there exists N ∈ N such that gn (x) < /(2M ), for
all n ≥ N , and for each x ∈ E.
Thus, for n > m > N , we have |sn (x) − smP (x)| < , for each x ∈ E.
Hence (sn ) is uniformly Cauchy, therefore n fn gn is uniformly convergent.
Example 7.4. (Application of Dirichlet’s test) Let (gn ) be a sequence of real-valued
functions on a set E. Assume that
i) gn+1 (x) ≤ gn (x), for all n ≥ 1, and for each x ∈ E, and
u
ii) gn →
− 0 on E.P
Then the series n (−1)n gn is uniformly convergent on E.
Quiz 2 will be based on the material from this point onward will the end of Week 12.
is continuous.
• A polynomial function p on [a, b] is given by
Theorem 7.6. Let f : [a, b] → R be a continuous function. Then f is bounded. That is,
there exists M > 0 such that |f (x)| ≤ M , for all x ∈ [a, b].
Example 7.7. Theorem fails to hold if the domain of f is not a closed interval. Let
f (x) = 1/x, x ∈ (0, 1].
kf k := sup |f (x)|,
x∈[a,b]
Hence kf + gk ≤ kf k + kgk.
LECTURE NOTES ON REAL ANALYSIS I 37
These notes are for lectures after the mid-semester examination week.
8. Week 8
Definition 8.1. Let (fn ) be a sequence in C[a, b]. We say that (fn ) is Cauchy if for given
> 0, there exists N ≥ 1 such that
ρ(fn , fm ) < ,
for all n, m ≥ N .
Theorem 8.2. Every Cauchy sequence in C[a, b] is convergent. This property is called
completeness of C[a, b] and we say that C[a, b] is complete.
Proof. Let (fn ) be a Cauchy sequence in C[a, b]. Let > 0 be given.
There exists N ∈ N such that for all n, m ≥ N , ρ(fn , fm ) < .
Hence for all x ∈ [a, b] and for all n, m ≥ N , |fn (x) − fm (x)| < .
Therefore (fn ) is uniformly Cauchy on [a, b].
By Cauchy criterion, it is uniformly convergent to some function f : [a, b] → R.
The limit function f ∈ C[a, b] since the uniform limit of continuous functions is continu-
ous.
Theorem 8.3. A continuous function f : [a, b] → R is uniformly continuous on [a, b].
(A function is uniformly continuous if for given > 0, there exists δ > 0 such that for
all x, y ∈ [a, b] with |x − y| < δ, we have |f (x) − f (y)| < .)
Proof. Suppose f is not uniformly continuous on [a, b], then there exists > 0 such that
for all δ > 0, there exists u, v ∈ [a, b] with |u − v| < δ, |f (u) − f (v)| ≥ .
Hence for each n ≥ 1, there exists xn , yn ∈ [a, b] with |xn − yn | < 1/n such that |f (xn ) −
f (yn )| ≥ .
Since (xn ) is a bounded sequence, it has a convergent subsequence, say (xnk )k .
Since (ynk )k is a bounded sequence, it has a convergent subsequence, say (ynk` )` .
Hence both (xnk` )` (every subsequence of a convergent sequence is convergent) and (ynk` )`
are convergent to x and y, say, respectively.
Since |xnk` − ynk` | < 1/nk` for all ` ≥ 1, x = y taking limit as ` → ∞.
Further since |f (xnk` ) − f (ynk` )| ≥ for all ` ≥ 1, |f (x) − f (y)| ≥ by taking limit as
` → ∞ and using sequential criteria of continuity of f at x and y.
This is a contradiction since f (x) = f (y).
Weierstrass approximation theorem.
Theorem 8.4. Let f ∈ C[0, 1]. Given > 0, there exists a polynomial function P such
that ρ(f, P ) < .
Corollary 8.4.1. Let f ∈ C[a, b]. Given > 0, there exists a polynomial function P
such that ρ(f, P ) < .
Proof. Let f ∈ C[a, b].
Define the function g : [0, 1] → R defined as g(x) = f (a + (b − a)x), x ∈ [0, 1].
Then g(0) = f (a), g(1) = f (b), g ∈ C[0, 1].
Given > 0, there exists a polynomial function P such that ρ(g, P ) < .
Define polynomial function Q : [a, b] → R as
x−a
Q(x) = P , x ∈ [a, b].
b−a
LECTURE NOTES ON REAL ANALYSIS I 39
Bernstein polynomials. For any f ∈ C[0, 1], define for x ∈ [0, 1] and n ≥ 1,
n
X n k n−k k
Bn (f )(x) = x (1 − x) f .
k=0
k n
For vii), use iv) to get Bn (f ) = Bn (f2 ) + x20 − 2x0 Bn (f1 ), and v) and vi).
For v) and vi), we will use the Binomial theorem. For p, q ∈ R, n ≥ 1,
n
X n k n−k
p q = (p + q)n .
k=0
k
Differentiating this w.r.t. p, we get
n n
X n k−1 n−k n−1
X n k k n−k
kp q = n(p + q) ⇒ p q = p(p + q)n−1 . (1)
k=0
k k=0
k n
Differentiating once more w.r.t. p, we get
n 2
X n k k−1 n−k
p q = (p + q)n−1 + (n − 1)p(p + q)n−2
k=0
k n
n 2
X n k p(p + q)n−1 n − 1 2
⇒ 2
pk q n−k = + p (p + q)n−2 . (2)
k=0
k n n n
Setting p = x and q = 1 − x gives v) and vi), respectively.
Proof. (Proof of Theorem 8.5 for [a, b] = [0, 1])
Let f ∈ C[0, 1]. We will prove that the sequence of polynomials (Bn (f ))n converges
uniformly to f on [0, 1].
First suppose f is not the zero function. Hence M = kf k > 0.
Since f is continuous on [0, 1], it is uniformly continuous by Theorem 8.3.
Given > 0, there exists δ > 0 such that for all x, y ∈ [0, 1] with |x−y| < δ, |f (x)−f (y)| <
/2.
Let x0 ∈ [0, 1].
For any x ∈ [0, 1], there are two cases:
a) if |x − x0 | < δ, |f (x) − f (x0 )| < , else
2
b) if |x − x0 | ≥ δ,
2
x − x0
|f (x) − f (x0 )| ≤ 2M ≤ 2M .
δ
Hence any x ∈ [0, 1], combining a) and b), we get
2
x − x0
|f (x) − f (x0 )| < 2M + .
δ 2
LECTURE NOTES ON REAL ANALYSIS I 41
Hence
|Bn (f )(x) − f (x0 )| =i) |Bn (f − f (x0 ))(x)|
≤ii) Bn (|f (x) − f (x0 )|)(x)
2 !
x − x0
≤ii) Bn 2M + (x)
δ 2
2M
=iv) 2
Bn ((x − x0 )2 )(x) +
δ 2
2M 2 2M 2
=vii) (x − x 0 ) + x − x + .
δ2 nδ 2 2
We have used Lemma 8.6 in the above set of inequalities, as indicated.
Set x = x0 , and use x0 − x20 ≤ 1, we get
2M
|Bn (f )(x0 ) − f (x0 )| ≤ + /2 < ,
nδ 2
4M
for all n ≥ N where N ∈ N is such that N > 2 . The above is true for all x0 ∈ [0, 1].
δ
Hence supx0 ∈[0,1] |Bn (f )(x0 ) − f (x0 )| ≤ , for all n ≥ N ⇒ kBn (f ) − f k ≤ , for all
n ≥ N.
Example 8.7. Let f : (a, b) → R be a continuous function which can be extended to
a continuous function g : [a, b] → R such that g(x) = f (x), for all x ∈ (a, b). Then
g(a) = limx→a+ f (x) and g(b) = limx→b− f (x). Since g is continuous on [a, b], we can
approximate g by a polynomial P in [a, b]. Hence we can approximate f by a polynomial
P in the open interval (a, b) as well.
Such an extension of f to g is not possible all the time. For example, f (x) = sin(1/x) is
continuous on (0, 1) but can not be extended to a continuous function on [0, 1].
Example 8.8. Let f (x) = 1/x, x ∈ (0, 1). We prove that there is no sequence of
u
polynomials (Pn ) such that Pn →
− f on (0, 1).
• Suppose there is such a sequence (Pn ).
• Then
sup |Pn (x) − 1/x| → 0.
x∈(0,1)
• That is,
1/2 > sup |PN (x) − 1/x| ≥ |xPN (x) − 1|, for all x ∈ (0, 1).
x∈(0,1)
9. Week 9
Note: A few TYPOS have been fixed and some clarifications have been added in Week
8 notes. Please see matter marked in red on Page 38 and 43.
(Recall) Let f : [a, b] → R be a function such that f (n−1) is continuous on [a, b] and
f (n) exists on (a, b). Then there exists c ∈ (a, b) such that
n−1
X (b − a)k (b − c)n−p (b − a)p (n)
f (b) = f (a) + f (k) (a) + Rn , where Rn = f (c).
k=1
k! p(n − 1)!
Lagrange’s form: p = n, Cauchy’s form: p = 1.
Using this, the Taylor’s form or formula for the function f about a point x0 ∈ (a, b)
is given by
n−1
X (x − x0 )k (x − c)n−p (x − x0 )p (n)
f (x) = f (x0 ) + f (k) (x0 ) + Rn , where Rn = f (c),
k=1
k! p(n − 1)!
for some c between x and x0 . This form is valid for all x in [a, b].
Power Series.
Definition 9.2. A power series is an expression of the form
X∞
an (x − a)n ,
n=0
where an , a, x ∈ R.
P∞
Note that this is a special case of infinite series n=0 fn (x) with fn (x) = an (x − a)n .
Convergence.
Theorem 9.3. Let ∞ n
P
n=0 an (x − a) be a power series. There is a unique R ∈ [0, ∞]
(extended real number) such that the following hold:
(1) For all x with |x − a| < R, the series converges absolutely and uniformly to a
function f on (a − r, a + r) for any 0 < r < R.
(2) If R ∈ (0, ∞], then f is continuous and differentiable on (a − R, a + R) with
∞
X
0
f (x) = nan (x − a)n−1 .
n=1
Note that this result says nothing about convergence on the circle |x − a| = R if
0 < R < ∞. That is when x = a − R and when x = a + R.
Proof. Without loss
P∞ of generality (WLOG), assume a = 0.
n
Let E = {|x| : n=0 a n x converges}.
Note that 0 ∈ E, hence E 6= ∅.
If E is bounded above, let R = sup E, otherwise let R = ∞.
Clearly by the definition of R, the power series diverges for |x| > R. Hence we have
proved 4).
Let R > 0 and let 0 < r < R. Since R is the least upper bound of R, there exists
46 NIKITA AGARWAL
Finally,
Pn let −R < x < y < R. Choose r > 0 such that −R < −r < x < y < r < R. Since
k
k=0 ak x converges uniformly to f on (−r, r), by Theorem 5.24,
Z yX n Z y
k
ak t dt → f (t) dt.
x k=0 x
Observe that
Z y n
X n Z
X y n
X Z y
k k
ak t dt = ak t dt = ak tk dt.
x k=0 k=0 x k=0 x
Similarly note
|an (x − a)n |1/n = |an |1/n |x − a|.
Hence by the root test, the series ∞ n
P
n=0 an (x − a) converges if `|x − a| < 1 and diverges
if `|x − a| > 1.
Example 9.7. Discuss convergence of the power series
∞
X
n n xn .
n=1
48 NIKITA AGARWAL
This power series is about the point 0. Here an = nn . Since |an |1/n = n → ∞, the radius
of convergence of the power series is given by R = 1/∞ = 0. Thus the power series
diverges at all points other than 0.
Example 9.8. Discuss convergence of the power series
∞
X xn
.
n=0
n!
Let f (x) be the function represented by the given power series on (−1, 1). Then
∞ n+1 0 ∞
0
X x X 1
(xf (x)) = = xn = .
n=0
n+1 n=0
1−x
By the fundamental theorem of calculus,
Z x
1
xf (x) = dt = − log(1 − x), x ∈ (−1, 1).
0 1−t
log(1 − x)
Hence f (x) = − , for x ∈ (−1, 1) \ {0}, and f (0) = 0 (set x = 0 in the power
x
series).
50 NIKITA AGARWAL
10. Week 10
Recall the space C[a, b] of continuous functions on the closed interval [a, b] and the
metric ρ on it.
Definition 10.1. Let F be a non-empty subset of C[a, b]. The diameter of F is defined
as diam F = sup{ρ(f, g) : f, g ∈ F}.
Example 10.2. Observe that finite subsets of C[a, b] are bounded (Check!).
Below we give an example of an unbounded subset of C[a, b].
For each n ≥ 1, let fn : [a, b] → R be the constant function with value n. Then fn ∈ C[a, b]
for each n ≥ 1. The collection F = {fn : n ≥ 1} is not bounded since ρ(fn , f1 ) = n − 1,
which diverges as n → ∞.
Definition 10.3. A non-empty subset F of C[a, b] is said to be bounded if diam F < ∞.
Definition 10.4. A subset F of C[a, b] is said to be totally bounded if given > 0, there
exists a finite number of subsets F1 , . . . , Fk of F such that diam Fi < , i = 1, . . . , k, and
F = ∪ki=1 Fi .
Theorem 10.5. A subset of a totally bounded set in C[a, b] is totally bounded.
Proof. Let F 0 be a subset of a totally bounded set F in C[a, b]. Let > 0 be given.
Then there exists a finite number of subsets F1 , . . . , Fk of F such that diam Fi < ,
i = 1, . . . , k, and F = ∪ki=1 Fi .
Let Fi0 = F 0 ∩ Fi , for each i = 1, . . . , k.
Then diam Fi0 ≤ diam Fi < , for i = 1, . . . , k, and F 0 = ∪ki=1 Fi0 .
Hence F 0 is totally bounded.
Theorem 10.6. A totally bounded subset F of C[a, b] is bounded.
Proof. Since F is totally bounded, there exists a finite number of subsets F1 , . . . , Fk of F
such that diam Fi < 1, i = 1, . . . , k, and F = ∪ki=1 Fi .
Let f1 , f2 , . . . , fk be some functions in F1 , . . . , Fk , respectively. Let
M = max{ρ(fi , fj ) : i, j ∈ {1, . . . , k}}.
Let f, g ∈ F. Then f ∈ Fi and g ∈ Fj . Hence
ρ(f, g) ≤ ρ(f, fi ) + ρ(fi , fj ) + ρ(fj , g) < 2 + ρ(fi , fj ) ≤ 2 + M.
Hence diam(F) ≤ 2 + M < ∞.
Remark 10.7. The converse is not true in general. We will need a result to establish
this.
Theorem 10.8. Let F be a totally bounded subset of C[a, b]. Then every sequence of
functions in F has a Cauchy subsequence.
Proof. Let (fn )n≥1 be a sequence in F.
If {fn : n ≥ 1} is a finite set, then the sequence (fn ) has a convergent subsequence,
hence Cauchy.
Assume that {fn : n ≥ 1} is an infinite set.
Since F is a finite union of its subsets each with diameter < 1 ( = 1 in definition of
totally bounded).
Observe that one of these subsets, say S1 contains infinitely many fn .
Let (f1,n )n be infinite subsequence of (fn )n which is contained in S1 .
Now the set S1 is totally bounded (since it is a subset of F). Hence it is a finite union of
its subsets each with diameter less than 1/2 ( = 1/2 in definition of totally bounded).
LECTURE NOTES ON REAL ANALYSIS I 51
Observe that one of these subsets, say S2 contains infinitely many f1,n (since (f1,n )n is
infinite.)
Let (f2,n )n be infinite subsequence of (f1,n )n which is contained in S2 .
Proceeding in this manner, we obtain a decreasing sequence of sets S1 ⊃ S2 ⊃ . . .
such that diam Si < 1/i. Moreover we obtain subsequences (fi,n )n of (fn )n such that
(fi+1,n )n ⊂ Si+1 is a subsequence of (fi,n )n ⊂ Si .
Consider the (diagonal) subsequence (fn,n )n of (fn )n . Note that fn,n ∈ Sn , for all n.
Finally for any given > 0, choose N ∈ N such that 1/N < .
Then for all n, m ≥ N , d(fn,n , fm,m ) ≤ 1/N < .
Hence we have obtained a Cauchy subsequence of (fn ).
Remark 10.9. 1) The converse is also true. It can be proved by contradiction. We skip
the proof.
2) If F is just bounded, then the result fails to hold true. For example, the sequence of
continuous functions
fn (x) = xn
in C[0, 1] converges pointwise to a discontinuous function f defined as
f (x) = 0, 0 ≤ x < 1, f (1) = 1.
Further note that F = {fn : n ≥ 1} is bounded since
ρ(fn , fm ) = sup |xn − xm | ≤ 2, n, m ≥ 1.
x∈[0,1]
Theorem 10.14. (Arzela-Ascoli’s Theorem) Let (fn ) be a sequence of functions in C[a, b].
Let {fn : n ≥ 1} be an equicontinuous and bounded subset of C[a, b]. Then (fn ) has a
subsequence which uniformly converges to some function in C[a, b].
Proof. Let F = {fn : n ∈ N}.
By Theorem 10.13, F is totally bounded.
Hence by Theorem 10.8, (fn ) has a Cauchy subsequence (fnk )k .
Since C[a, b] is complete, (fnk ) converges to a function f ∈ C[a, b]. That is ρ(fnk , f ) → 0
as k → ∞.
u
Hence fnk →− f.
Theorem 10.15. (Converse of Arzela-Ascoli’s Theorem) Let F be a subset of C[a, b].
If every sequence of functions in F has a uniformly convergent subsequence, then F is
equicontinuous and bounded.
We do not discuss proof of the converse.
An application of Arzela-Ascoli’s theorem - bounded derivatives. Let (fn ) be a
uniformly bounded sequence of functions on [0, 1] such that |fn0 (x)| ≤ M , for all x ∈ (0, 1),
n ≥ 1, for some M > 0. Prove that (fn ) has a uniformly convergent subsequence.
• First of all, (fn ) ⊂ C[0, 1] since each fn is differentiable.
• Let > 0 be given.
Let δ = /M . Then for all n ≥ 1, x, y ∈ [0, 1] with |x − y| < δ,
|fn (x) − fn (y)| = |fn0 (t)||x − y| < M.δ = .
Hence {fn } is an equicontinuous family.
• Now we can use Arzela-Ascoli’s theorem. Since {fn : n ≥ 1} is equicontinu-
ous and bounded subset of C[a, b], the sequence (fn ) has a uniformly convergent
subsequence.
An application of Arzela-Ascoli’s theorem - bounded norm. Let (fn ) be a se-
quence of functions on [a, b] such that kfn k ≤ M ,Rfor all n ≥ 1, for some M > 0. Then
x
the sequence of functions (Fn ) defined as Fn (x) = a fn (t) dt, x ∈ [a, b] lies in C[a, b] and
has a uniformly convergent subsequence.
• Let > 0 be given.
Let δ = /M (b − a). Then for all n ≥ 1, x, y ∈ [a, b] with |x − y| < δ,
Z x Z x
|Fn (x) − Fn (y)| = | fn (t)| dt ≤ | |fn (t)| dt| ≤ M |x − y| < M (b − a).δ = .
y y
Hence for given > 0, take δ = , then |fn (x) − fn (y)| < , for all |x − y| < δ,
x, y ∈ R, n ≥ 1. Therefore the sequence (fn ) is equicontinuous on R.
p.w.
• In fact, 0 ≤ fn (x) ≤ |x|/n, for all x ∈ R and for all n ≥ 1. Hence fn −−→ 0 on R.
p.w.
• Finally, let (fnk )k is any subsequence of (fn ). Then fnk −−→ 0. Since supx∈R |fnk (x)| =
1, for all k ≥ 1, we get limk→∞ supx∈R |fnk (x)| = 1 6= 0. Thus fnk does not con-
verge to 0 uniformly.
56 NIKITA AGARWAL
11. Week 11
The goal for the next set of lectures will be to cover the following topics:
• Monotonic functions, functions of bounded variation, rectifiable curves
• Riemann-Stieltjes integral, properties of Riemann-Stieltjes integral, differentiation
of the integral, fundamental theorem of calculus, integration by parts, Gamma
function
• The main text for these topics will be: Chapters 6 and 7, T. M. Apostol,
Mathematical Analysis (2nd Edn.), Narosa Publishing, 1985
Definition 11.1. Let E be a non-empty subset of R.
• A function f : E → R is said to be increasing (non-decreasing) on E if for any
pair of points x, y ∈ E,
x < y ⇒ f (x) ≤ f (y).
The function f is strictly increasing on E if x < y ⇒ f (x) < f (y).
• Let E be a non-empty subset of R. A function f : E → R is said to be decreasing
(non-increasing) on E if for any pair of points x, y ∈ E,
x < y ⇒ f (x) ≥ f (y).
The function f is strictly decreasing on E if x < y ⇒ f (x) > f (y).
• A function is called monotonic on E if it is increasing or decreasing on E.
Note that f is decreasing on E if and only if −f is increasing on E. Because of this,
in many situations relating to monotonic functions, it is enough to consider increasing
functions.
We will use this shorthand for left hand and right hand limits of a function f at a
point c throughout the remainder of the lectures:
f (c−) = lim− f (x), f (c+) = lim+ f (x).
x→c x→c
Theorem 11.2. Let f : [a, b] → R be an increasing function and c ∈ (a, b). Then f (c−)
and f (c+) exist and
f (c−) ≤ f (c) ≤ f (c+).
At the end points c = a or c = b,
f (a) ≤ f (a+), f (b−) ≤ f (b).
For a decreasing function f , all the inequalities will be reversed in the statement of the
theorem.
The proof is immediate by observing the graph of f .
Proof. • Let A = {f (x) : x ∈ (a, c)}. This set is non-empty and bounded above
by f (c) (since f is increasing.)
• Let α = sup A. Then α ≤ f (c).
• We will prove that f (c−) = α. That is, for given > 0, there exists δ > 0 such
that
c − δ < x < c ⇒ |f (x) − α| = α − f (x) < .
• Let > 0 be given. Since α = sup A, there exists x1 ∈ (a, c) such that α − <
f (x1 ) ≤ α.
• Since f is increasing, α − < f (x1 ) ≤ f (x) ≤ α, for all x ∈ (x1 , c).
• That is, α − f (x) < , for all x1 < x < c.
• Take δ = c − x1 > 0 to obtain the statement in red.
LECTURE NOTES ON REAL ANALYSIS I 57
3.5
3.0
2.5
2.0
1.5
1.0
0.5
58 NIKITA AGARWAL
Theorem 11.5. Let f : [a, b] → R be a monotonic function. Then the set of discontinu-
ities of f is countable.
Proof. • Assume that f is increasing.
• Let Em = {x ∈ (a, b) : f (x+) − f (x−) > 1/m}, for m ∈ N.
• If Em 6= ∅, let x1 , . . . , xn ∈ Em , then f (xk +) − f (xk −) > 1/m, hence
n−1
n−1 X
≤ (f (xk +) − f (xk −)) ≤ f (b) − f (a).
m k=1
for all partitions of [a, b], then f is said to be of bounded variation on [a, b].
We write BV [a, b] for the collection of all the functions of bounded variation on [a, b].
Theorem 11.8. If f is monotonic on [a, b], then it is of bounded variation on [a, b].
Proof. • Let f be an increasing function.
• For any partition of [a, b], ∆fk = f (xk ) − f (xk−1 ) ≥ 0.
• Hence
X n Xn
|∆fk | = ∆fk = f (b) − f (a).
k=1 k=1
Theorem 11.9. If f is continuous on [a, b], f 0 exists and is bounded: |f 0 (x)| ≤ A, for
all x ∈ (a, b), then f is of bounded variation on [a, b].
Proof. • By mean-value theorem, ∆fk = f (xk ) − f (xk−1 ) = f 0 (tk )(xk − xk−1 ), for
some tk ∈ (xk−1 , xk ).
• Hence |∆fk | = |f (xk ) − f (xk−1 )| = |f 0 (tk )|(xk − xk−1 ) ≤ A(xk − xk−1 ).
• Hence
Xn X n
|∆fk | ≤ A (xk − xk−1 ) = A(b − a).
k=1 k=1
Theorem 11.10. If f is of bounded variation on [a, b], then it is bounded.
• Since f is of bounded variation, nk=1 |∆fk | ≤ M , for all partitions.
P
Proof.
• Let x ∈ (a, b).
LECTURE NOTES ON REAL ANALYSIS I 59
0.2
-0.2
-0.4
Figure 2. The functions x cos π/(2x) (blue) and x2 cos π/(2x) (orange) on [0, 1].
• Thus S(P1 ), S(P2 ) are bounded above by Vf (a, b) for all partitions P1 of [a, c] and
all partitions P2 of [c, b].
• Therefore f is of bounded variation on both [a, c] and [c, a].
• Also Vf (a, c) + Vf (c, b) ≤ Vf (a, b), by taking sup over P1 and P2 .
Let us now prove the reverse inequality Vf (a, b) ≤ Vf (a, c) + Vf (c, b).
• Let P = {a = x0 < x1 < · · · < xn = b} be a partition of [a, b]. Let P 0 = P ∪ {c}.
That is P 0 is a new partition of [a, b] obtained from P by inserting point c.
• If c ∈ P , then S(P ) = S(P 0 ) clearly.
• Else if c ∈/ P , then c ∈ (xk−1 , xk ) for some k. Then P 0 = {a = x0 < x1 < · · · <
xk−1 < c < xk < xn = b} is a partition of [a, b].
• Then P1 = {a = x0 < x1 < · · · < xk−1 < c} and P2 = {c < xk < · · · < xn = b}
are partitions of [a, c] and [c, b], respectively.
• Moreover since P 0 = P1 ∪ P2 , we have S(P 0 ) = S(P1 ) + S(P2 ).
• Since
|f (xk ) − f (xk−1 )| ≤ |f (xk ) − f (c)| + |f (c) − f (xk−1 )|,
we get S(P ) ≤ S(P 0 ).
• Hence S(P ) ≤ S(P 0 ) = S(P1 ) + S(P2 ) ≤ Vf (a, c) + Vf (c, b).
• Taking sup over partitions P of [a, b] on the LHS, we obtain
Vf (a, b) ≤ Vf (a, c) + Vf (c, b).
The above result is quite useful for computing Vf . One can divide the
interval [a, b] into sub-intervals in which it is easier to compute the variation.
For example, sub-intervals of monotonicity.
Theorem 11.18. (Total variation as a function) Let f : [a, b] → R be of bounded varia-
tion on [a, b]. Let V : [a, b] → R be defined as
V (a) := 0, V (x) := Vf (a, x), x ∈ (a, b].
Then both V and V − f are increasing functions on [a, b].
Proof. • Let a < x < y < b. Then Vf (a, y) = Vf (a, x) + Vf (x, y). Hence V (y) −
V (x) = Vf (x, y) ≥ 0, which implies V (x) ≤ V (y). Hence V is an increasing
function.
• Let W = V − f . Then
W (y) − W (x) = (V (y) − V (x)) − (f (y) − f (x)) ≥ 0,
since f (y) − f (x) ≤ |f (y) − f (x)| ≤ Vf (x, y) = V (y) − V (x). Hence W (x) ≤ W (y).
Thus W is an increasing function.
Theorem 11.19. (Function of bounded variation as a difference of increasing functions)
Let f : [a, b] → R. Then f is of bounded variation on [a, b] iff f can be expressed as a
difference of two increasing functions on [a, b].
Proof. (⇒) Note that f = V − (V − f ), where both V and V − f are increasing.
(⇐) Increasing functions on [a, b] are of bounded variation. Moreover, the difference of
two functions of bounded variation is a function of bounded variation.
Remark 11.20. • The expression as a difference of two increasing functions is not
unique since V and V − f can be replaced by V + g and V − f + g, respectively,
for any increasing function g.
62 NIKITA AGARWAL
-1
12. Week 12
Theorem 12.1. Let f : [a, b] → R be of bounded variation on [a, b]. Let V : [a, b] → R
be defined as
V (a) := 0, V (x) := Vf (a, x), x ∈ (a, b].
Then points of continuity of V and f are the same.
Recall : Both V and V − f are increasing functions. Moreover, f = V − (V − f ).
In view of this result, we will fix the following norm on Rn : for X = (x1 , . . . , xn ) ∈ Rn ,
kXk = |x1 | + · · · + |xn |.
Check that this is a norm on Rn .
Theorem 12.7. Let k.k be any norm on Rn . The vector-valued function f is continuous
on [a, b] if and only if each of the functions f1 , . . . , fn are continuous on [a, b].
Proof. Let f be continuous on [a, b]. Let t0 ∈ [a, b]. Let > 0 be given. There exists
δ > 0 such that for all t ∈ [a, b] with |t − t0 | < δ, we have kf (t) − f (t0 )k < . Thus
n
X
> kf (t) − f (t0 )k = |(fi (t) − fi (t0 ))|.
i=1
a = tp t1 t2 t3 t4 t5 t$ = b
Definition 12.9. If the set {Λf (P ) | P ∈ P[a, b]} is bounded above, then we say that
the path f is rectifiable and its arc length is defined as
Λf (a, b) = sup{Λf (P ) | P ∈ P[a, b]}.
If the set {Λf (P ) | P ∈ P[a, b]} is unbounded, we say that f is a nonrectifiable path.
Theorem 12.10. Let f = (f1 , . . . , fn ) : [a, b] → Rn be a path. Then f is rectifiable if
and only if each of the functions f1 , . . . , fn are of bounded variation on [a, b]. Moreover,
if f is rectifiable, then
Vi (a, b) ≤ Λf (a, b) ≤ V1 (a, b) + · · · + Vn (a, b),
for all i = 1, . . . , n, where Vi (a, b) denotes the total variation of fi .
66 NIKITA AGARWAL
Hence m
P
k=1 |fi (tk ) − fi (tk−1 )| ≤ Λf (P ) ≤ V1 (a, b) + · · · + Vn (a, b).
Now take sup over all partitions P on the LHS.
Theorem 12.11. Let f : [a, b] → Rn be a rectifiable path. Let c ∈ (a, b). Then f is
rectifiable on both [a, c] and [c, b]. Moreover
Λf (a, b) = Λf (a, c) + Λf (c, b).
Proof. For any partition P of [a, b], if we include the point c, we obtain partitions P1 of
[a, c] and P2 of [c, b].
By triangle inequality, Λf (P ) ≤ Λf (P1 ) + Λf (P2 ) ≤ Λf (a, c) + Λf (c, b).
Taking sup over partitions P of [a, b] on LHS, we get Λf (a, b) ≤ Λf (a, c) + Λf (c, b).
For the reverse inequality, let P1 be a partition of [a, c] and P2 of [c, b]. Let P = P1 ∪ P2 ,
partition of [a, b].
Then Λf (P1 ) + Λf (P2 ) = Λf (P ) ≤ Λf (a, b).
Taking sup over partitions P1 , P2 of [a, c], [c, b], respectively on LHS, we get Λf (a, c) +
Λf (c, b) ≤ Λf (a, b).
Theorem 12.12. Let f : [a, b] → Rn be a rectifiable path. Define a function s : [a, b] → R
as
s(a) = 0, s(x) = Λf (a, x), x ∈ (a, b].
Then
i) s is increasing and continuous on [a, b].
ii) If there is no sub-interval of [a, b] on which f is constant, then s is strictly increasing
on [a, b].
Proof. Let a ≤ x < y ≤ b. Then s(y) − s(x) = Λf (a, y) − Λf (a, x) = Λf (x, y) ≥ 0. Hence
s is an increasing function.
Clearly Λf (x, y) = 0 implies Vk (x, y) = 0, for all k = 1, . . . , n which further implies that
f is constant on [x, y].
Since Λf (x, y) ≤ V1 (x, y) + · · · + Vn (x, y), and as y → x+ , each Vi (x, y) → 0. Hence
Λf (x, y) → 0. Therefore, s(x+) − s(x) = 0. Similarly s(x) − s(x−) = 0. Hence s is
continuous on [a, b].
Definition 12.13. Let f : [a, b] → Rn and g : [c, d] → Rn be two paths. These paths
are called equivalent if there exists a continuous, onto, and strictly monotone function
φ : [a, b] → [c, d] such that
g ◦ φ(t) = f (t), t ∈ [a, b].
Remark 12.14. A few remarks about equivalent paths.
• The equivalent paths are said to give two parametric representations of the same
curve in Rn .
• The function φ defines a change of parameter.
• Let C be the curve described by f or g.
• If φ is strictly increasing, then φ(a) = c, φ(b) = d, both f and g trace out C in
the same direction. In this case, φ is called orientation-preserving.
• If φ is strictly decreasing, then φ(a) = d, φ(b) = c, both f and g trace out C in
the reverse direction. In this case, φ is called orientation-reversing.
LECTURE NOTES ON REAL ANALYSIS I 67
• Moreover since f traces the unit circle only once, f (φ(0)) = (1, 0) (since φ(0) is
either 0 or 1) and f (φ(1/2)) 6= (1, 0).
68 NIKITA AGARWAL
Riemann-Stieltjes Integral. Let us first discuss some useful notations and definitions.
• Let f, α : [a, b] → R be two functions.
• For any partition P = {a = x0 < x1 < · · · < xn = b}, we define
∆αk = α(xk ) − α(xk−1 ), k = 1, . . . , n.
• A partition P 0 of [a, b] with P ⊂ P 0 is called a refinement of P .
• The length of the largest subinterval in the partition P is called the norm of P ,
denoted as kP k. That is,
kP k = max{∆xk = xk − xk−1 | k = 1, . . . , n}.
• Note that if P 0 is a refinement of P , then kP 0 k ≤ kP k.
• For any choice points tk ∈ [xk−1 , xk ], k = 1, . . . , n, the Riemann-Stieltjes sum is
given by
X n Xn
S(P, f, α) := f (tk )∆αk = f (tk )(α(xk ) − α(xk−1 )).
k=1 k=1
• If α(x) = x, for all x ∈ [a, b], then the Riemann-Stieltjes sum are nothing but
Riemann sums.
Definition 12.19. A function f is said to be Riemann-Stieltjes integrable with respect to
α if there exists a real number I such that for given > 0, there exists a partition P of
[a, b] such that for all refinements P of P and for all choices tk ∈ [xk−1 , xk ], k = 1, . . . , n,
|S(P, f, α) − I| < .
Remark 12.20. A few remarks about the definition.
• The number I, if it exists, is unique. ItRis called theR b Riemann-Stieltjes integral of
b
f with respect to α, and is denoted by a f dα or a f (x) dα(x).
• The function f is known as integrand and the function α is known as integrator.
• If f is Riemann-Stieltjes integrable with respect to α, we will say f ∈ R(α).
Rb
• If α or f is the zero function on [a, b], then a f dα = 0.
• If f (x) = c, for all x ∈ [a, b], then
Xn X n
S(P, f, α) = f (tk )∆αk = c (α(xk ) − α(xk−1 )) = c(α(b) − α(a)).
k=1 k=1
Rb
Hence a
f dα = c(α(b) − α(a)).
Theorem 12.21. (Linearity of integrand) Let c1 , c2 ∈ R. If f, g ∈ R(α) on [a, b], then
c1 f + c2 g ∈ R(α) on [a, b]. Moreover
Z b Z b Z b
(c1 f + c2 g) dα = c1 f dα + c2 g dα.
a a a
Let P = P0 ∪ P00 , then any refinement P of P is also a refinement of both P0 and P00 .
Let P be a refinement of P . Then
Z b Z b
|S(P, h, α) − c1 f dα − c2 g dα| ≤
a a
Z b Z b
|c1 S(P, f, α) − c1 f dα dα| + |c2 S(P, g, α) − c2 g dα| ≤ (|c1 | + |c2 |).
a a
Theorem 12.22. (Linearity of integrator) Let c1 , c2 ∈ R. If f ∈ R(α) and f ∈ R(β) on
[a, b], then f ∈ R(c1 α + c2 β) on [a, b]. Moreover
Z b Z b Z b
f d(c1 α + c2 β) = c1 f dα + c2 f dβ.
a a a
Corollary 12.23.1. If a < c1 < · · · < ck < b. If all but one integrals exist then the
remaining one also exists and
Z b Z c1 Z c2 Z ck Z b
f dα = f dα + f dα + · · · + f dα + f dα.
a a c1 ck−1 ck
13. Week 13
Example 13.1. Consider the function f (x) = [x] on the interval [0, 2]. We know that f
is a increasing function, with value 0 in [0, 1), 1 in [1, 2), and 2 at the point 2. Thus f
has discontinuity at the points 1 and 2.
To compute the variation function V on [0, 2], we have to be particularly careful at the
points of discontinuity of f .
Recall that V (x) = Vf (0, x) is the supremum of sums S(P, f ) over all partitions P of
[0, x]. If f is constant on some subinterval [a, b] I of [0, x], we can ignore all the partition
points in I since the corresponding terms in S(P, f ) will contribute to just f (b) − f (a).
Note that since f is constant on [0, 1), V (x) = Vf (0, x) = f (x) − f (0) = 0.
Now, V (1) = Vf (0, 1) = sup{x∈[0,1)} {|f (x)−f (0)|+|f (1)−f (x)|} = sup{x∈[0,1)} {f (1)} = 1
(independent of x).
For x ∈ (1, 2), V (x) = Vf (0, x) = Vf (0, 1) + Vf (1, x) = V (1) + (f (1) − f (x)) = 1.
Finally let x ∈ (1, 2), then V (2) = Vf (0, x)+Vf (x, 2) = V (x)+sup{y∈[1,2)} {|f (2)−f (y)|} =
1 + sup{y∈[1,2)} {2 − 1} = 2 (independent of y).
Thus the total variation of f on [0, 2] is V (2) = Vf (0, 2) = 2.
Suppose you were just asked to compute total variation of f on [0, 2]. Consider any
partition P = {0 = x0 < x1 < · · · < xn } of [0, 2]. WLOG assume that 1 ∈ P and xk = 1.
Let P 0 = {0 < xk < 2} = {0 < 1 < 2}. Then S(P, f ) = S(P 0 , f ) since f is constant on
[0, 1) and [1, 2). Hence Vf (0, 2) = S(P 0 , f ) = (f (1) − f (0)) + (f (2) − f (1)) = 2.
Rb
Definition. If a < b and a f dα exists, we define
Z a Z b
f dα := − f dα.
b a
Moreover we define Z a
f dα = 0.
a
Theorem 13.2. (Integration by parts) If f ∈ R(α) on [a, b], then α ∈ R(f ) on [a, b].
Moreover Z b Z b
f dα + α df = f (b)α(b) − f (a)α(a).
a a
Remark 13.3. We know that if f ∈ R(α) on [a, b] and α has a continuous derivative on
[a, b], then
Z b Z b
f dα = f (x)α0 (x) dx.
a a
Thus if f ∈ R(α) on [a, b] and α and f have continuous derivatives on [a, b], then
Z b Z b Z b
0 0
f (x)α (x) dx + α(x)f (x) dx = d(αf ).
a a a
Note: Z b
d(αf ) = f (b)α(b) − f (a)α(a).
a
Theorem 13.4. (Change of variable) Let f ∈ R(α) on [a, b] and let g : [c, d] → R be
a strictly monotonic continuous function. Assume that g(c) = a and g(d) = b. For all
x ∈ [c, d],
h(x) = f (g(x)), and β(x) = α(g(x)).
LECTURE NOTES ON REAL ANALYSIS I 71
That is,
Z g(d) Z d
f (y) dα(y) = f (g(x)) d {α(g(x))} .
g(c) c
Theorem 13.7. (Step functions as integrators) Let a < c < b. Let α : [a, b] → R be
such that α(a), α(c), α(b) are arbitrary. Further
α(x) = α(a), a ≤ x < c, α(x) = α(b), c < x ≤ b.
Let f : [a, b] → R be such that at least one of the functions f, α are continuous from the
left at c, and at least one of the functions f, α are continuous from the right at c. Then
f ∈ R(α) and
Z b
f dα = f (c)[α(b) − α(a)] = f (c)[α(c+) − α(c−)].
a
Example 13.8. The simplest step function is the greatest integer function.
• Let α(x) = [x], 0 ≤ x ≤ n.
• Then α is continuous from the right at each point, but not from the left at
1, 2, . . . , n − 1.
• Let f : [0, n] → R be a function which is continuous from the left at 1, 2, . . . , n−1.
• Then by the corollary on the previous slide, f ∈ R(α) and
Z b Xn Xn
f dα = f (k)αk = f (k),
a k=0 k=1
since α0 = 0, α1 = · · · = αn = 1.
LECTURE NOTES ON REAL ANALYSIS I 73
Example 13.9. This example shows that by changing the value of f at c in Theorem 13.7,
the integral might not even exist.
Let α(x) = 0, x 6= 0, and α(0) = −1. (jump only at 0)
1) If f is a constant function on [−1, 1], then by Theorem 13.7,
Z 1
f dα = f (0)(α(0+) − α(0−)) = 0.
−1
2) Let f (x) = 1, for x 6= 0, and f (0) = 2. Since α and f are both discontinuous at 0 from
the left as well as from the right, we cannot use Theorem 13.7.
We directly work out the calculations. For any partition of P = {−1 = x0 < x1 <
. . . xk . . . , xn = 1} containing 0 such that xk = 0,
S(P, f, α) = f (tk−1 )[α(0) − α(xk−1 )] + f (tk )[α(xk+1 ) − α(0)] = f (tk ) − f (tk−1 ),
where xk−1 ≤ tk−1 ≤ 0 ≤ tk ≤ xk .
If tk−1 < 0 and tk > 0, then S(P, f, α) = 0.
On the other hand, if tk−1 = 0 and tk > 0, then S(P, f, α) = −1.
Thus the Riemann sum takes different values for any partition P containing 0, depending
upon theR 1 choice of points tk−1 and tk .
Hence −1 f dα does not exist.
Example 13.10. We prove that
n Z n
X 1 1 [x]
= +s dx.
k=1
ks ns−1 1 xs+1
1
• Let f (x) = [x] and α(x) = on [0.5, n].
xs Rb Rb
• Since α has a derivative which is Riemann integrable, a f dα = a f (x)α0 (x) dx.
Hence Z n Z n Z n
0 [x]
f dα = f (x)α (x) dx = −s s+1
dx.
0.5 0.5 1 x
Z n n
X 1
α df = s
.
0.5 k=1
k
n 1
f (n)α(n) − f (0.5)α(0.5) = s
= s−1 .
n n
• Use integration by parts formula.
• If you use [1, n] instead of [0.5, n], everything will work fine. In this,
Z n n n
!
X 1 X 1
α df = s
= s
− 1.
1 k=2
k k=1
k
which is equivalent to
b Z b Z b
X
0 1 f (a) + f (b)
f (n) = f (x) dx + f (x) α(x) − dx + .
n=a a a 2 2
Proof. Let us use integration by parts formula
Z b Z b
f dα + α df = f (b)α(b) − f (a)α(a).
a a
Since f has a continuous derivative on [a, b], this becomes
Z b Z b
f dα + α(x)f 0 (x) dx = f (b)α(b) − f (a)α(a). (1)
a a
From Example 13.8,
Z b X
f d[x] = f (n). (2)
a a<n≤b
Note α(x) = x − [x]. Hence by linearity of R-S integral w.r.t. the integrator,
Z b Z b Z b
f dα + f d[x] = f (x) dx.
a a a
Adding equations (1) and (2) gives the required identity.
Further since
b Z b
1 b 0
Z Z
0 1 0
f (x) α(x) − dx = f (x)α(x) dx − f (x) dx
a 2 a 2 a
Z b
f (b) − f (a)
= f 0 (x)α(x) dx − ,
a 2
we get the required identity.
Remark 13.12. • This formula illustrates the use of Riemann-Stieltjes integral to
obtain a formula relation the integral of a function f on an interval [a, b] and its
values at integer points in [a, b].
• The formula is used to approximate integrals by sums, or conversely, sums by
integrals.
A solved exercise not discussed in the class. Prove that
n Z n
X 1 x − [x]
= log n − dx + 1.
k=1
k 1 x2
Solution: Let f (x) = 1/x and α(x) = [x] on [1, n]. Then
Z n n n
!
X 1 X 1
f dα = = − 1.
1 k=2
k k=1
k
LECTURE NOTES ON REAL ANALYSIS I 75
Moreover
Z n n n Z n Z n
x − [x]
Z Z
0 [x] x
α df = α(x)f (x) dx = − 2
dx = 2
dx − 2
dx
1 1 1 x 1 x 1 x
Z n Z n Z n
x − [x] 1 x − [x]
= 2
dx − dx = dx − log n.
1 x 1 x 1 x2
Using integration by parts formula
Z n Z n
f dα + f dα = f (n)α(n) − f (1)α(1) = 0,
1 1
we get the required identity.
76 NIKITA AGARWAL
14. Week 14
Monotonic Functions as integrators.
Definition 14.1. Let f, α : [a, b] → R, P = {a = x0 < x1 < · · · < xn = b} be a partition
of [a, b], and
Mk (f ) = sup{f (x) | x ∈ [xk−1 , xk ]}, mk (f ) = inf{f (x) | x ∈ [xk−1 , xk ]}.
The numbers
n
X n
X
U (P, f, α) = Mk (f )∆αk , L(P, f, α) = mk (f )∆αk ,
k=1 k=1
are called the upper and lower Riemann Stieltjes sum, respectively, of f with respect to
α for the partition P .
Remark 14.2. 1) mk (f ) ≤ Mk (f ).
2) If α is increasing, then ∆αk ≥ 0. For any tk ∈ [xk−1 , xk ], mk (f ) ≤ f (tk ) ≤ Mk (f ).
Hence L(P, f, α) ≤ S(P, f, α) ≤ U (P, f, α), for all Riemann sums.
Henceforth, we will focus on integrators α which is a monotonically increasing function.
Observe that if α is monotonically decreasing, then β = −α is monotonically increasing,
and Z b Z b
f dα = − f dβ.
a a
If α(x) = x, the upper and lower Stieltjes integral are called upper and lower Riemann
integral, respectively.
Theorem 14.6. Let α % on [a, b]. Then
Z b Z b
f dα ≤ f dα.
a a
First of all, F is defined since f ∈ R(α) on [a, b] implies f ∈ R(α) on [a, x].
Further it suffices to assume
Ry that α % on [a, b].
Since F (y) − F (x) = x f dα and α is increasing, we have
m[x,y] (α(y) − α(x)) ≤ F (y) − F (x) ≤ M[x,y] (α(y) − α(x)),
where m[x,y] = inf{f (t) : t ∈ [x, y]} and M[x,y] = sup{f (t) : t ∈ [x, y]}.
Clearly this implies (1) and (2).
Let x ∈ [a, b] be a point at which α0 exists and where f is continuous. We have
α(y) − α(x) F (y) − F (x) α(y) − α(x)
m[x,y] ≤ ≤ M[x,y] ,
y−x y−x y−x
Taking limit y → x on all sides, we get
lim m[x,y] α0 (x) ≤ lim F (y) − F (x) ≤ lim M[x,y] α0 (x),
y→x y→x y→x
LECTURE NOTES ON REAL ANALYSIS I 79
We now prove that limy→x m[x,y] = limy→x M[x,y] = f (x). Let > 0 be given. Since f is
continuous at x, there exists δ > 0 such that for all y ∈ (x − δ, x + δ), f (x) − < f (y) <
f (x) + . Hence, for all y ∈ (x − δ, x + δ),
f (x) − ≤ m[x,y] ≤ M[x,y] ≤ f (x) + .
Therefore for all y ∈ (x − δ, x + δ),
− ≤ m[x,y] − f (x) ≤ M[x,y] − f (x) ≤ ,
Thus
− ≤ lim m[x,y] − f (x) ≤ lim M[x,y] − f (x) ≤ ,
y→x y→x
Since > 0 is arbitrary, we get
lim m[x,y] = lim M[x,y] = f (x).
y→x y→x
Lebesgue’s criterion for Riemann integrability.
Definition 14.14. Let S be a subset of real numbers. The set S is said to have measure
P∞ > 0, there exists countably many intervals I1 , I2 , . . . such that S ⊂
zero if for given
∞
∪i=1 Ii and i=1 length(Ii ) < .
Example 14.15. A few examples.
• A countable
set is of measure zero. If S is a countably infinite set {a1 , a2 , . . . }.
Let Ii = ai − i+2 , ai + i+2 , i ≥ 1. Then
2 2
∞
X
∞
S ⊂ ∪i=1 Ii , length(Ii ) < .
i=1
Hence the set Q is rational numbers is measure zero.
The above argument shows that a finite set has measure zero.
• A subset of a measure zero set also has measure zero.
• An interval (a, b) with a < b is not measure zero. For if, (In )n≥1 cover (a, b), then
X∞
b−a≤ length(In ).
n=1