MA1231 Calculus Notes
MA1231 Calculus Notes
MA1231 Mathematics 1B
CALCULUS NOTES
Preface
1. Most courses at university present new material at a faster pace than you will have been
accustomed to in high school, so it is essential that you start working right from the beginning
of the semester and continue to work steadily throughout the semester. Make every effort to
keep up with the lectures and to do problems relevant to the current lectures.
2. These Notes are not intended to be a substitute for attending lectures or tutorials. The
lectures will expand on the material in the notes and help you to understand it.
3. These Notes may seem to contain a lot of material but not all of this material is equally
important. One aim of the lectures will be to give you a clearer idea of the relative importance
of the topics covered in the Notes.
4. Use the tutorials for the purpose for which they are intended, that is, to ask questions about
both the theory and the problems being covered in the current lectures.
5. Some of the material in these Notes is more difficult than the rest. This harder material is
marked with the symbol [H].
6. It is essential for you to do problems which are given at the end of each chapter. If you
find that you do not have time to attempt all of the problems, you should at least attempt
a representative selection of them. The problems set in tests and exams will be similar to
the problems given in these notes. Further information on the problems and class tests is on
pages x and 205.
7. You will be expected to use the computer algebra package Maple in tests and understand
Maple syntax and output for the end of semester examination.
Note.
We gratefully acknowledge the contributions of the School of Mathematics and Statistics towards
the creation of this resource. Copyright is vested in The University of New South Wales, c 2018.
Contents
Preface iii
Calculus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Syllabus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Problem schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
Tutorial schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Test schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
2 Integration techniques 27
2.1 Trigonometric integrals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2.1.1 Integrating powers of sine and cosine . . . . . . . . . . . . . . . . . . . . . . . 27
2.1.2 Integrating multiple angles of sine and cosine . . . . . . . . . . . . . . . . . . 30
2.1.3 Integrating powers of tan and sec . . . . . . . . . . . . . . . . . . . . . . . . . 31
2.2 Reduction formulae . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.2.1 [X] Application: the irrationality of π . . . . . . . . . . . . . . . . . . . . . . 35
2.3 Trigonometric and hyperbolic substitutions . . . . . . . . . . . . . . . . . . . . . . . 37
2.4 Integrating rational functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.4.1 The overall strategy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
2.4.2 Partial fractions decompositions . . . . . . . . . . . . . . . . . . . . . . . . . 43
2.4.3 Integrating rational functions: two examples . . . . . . . . . . . . . . . . . . 46
2.5 Other substitutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.6 Maple notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
Index 219
PROBLEM SETS
The Calculus problems are located at the end of each chapter of the Calculus Notes booklet.
To help you decide which problems to try first, each problem is marked with an [R], an [H] or an
[HH].
All students should make sure that they attempt the questions marked [R]. The problems marked
[H] or [HH] are intended as a challenge for students in MA1231. Some harder parts of [R] problems
are marked with a star. Problems marked with [V] have a video solution available on Moodle.
Solving problems and writing mathematics clearly are two separate skills that need to be devel-
oped through practice. We recommend that you keep a workbook to practice writing solutions to
mathematical problems. The following table gives the range of questions suitable for each week.
In addition it suggests specific recommended problems to do before your classroom tutorials.
The Online Tutorials will develop your problem solving skills, and give you examples of mathemati-
cal writing. Online Tutorials help build your understanding from lectures towards solving problems
on your own. Because this overlaps with the skills developed through homework, there are usually
fewer recommended homework in Online Tutorial weeks.
The main reason for having tutorials is to give you a chance to tackle and discuss problems which
you find difficult or don’t fully understand.
There are two kinds of tutorials: Online and Classroom. Calculus Online Tutorials are delivered
using MapleTA. These can be completed from home, are available for a two week period, and are
due on Sunday night in weeks 1, 3, 5, 7, 9 and 11. Calculus Classroom tutorials are delivered in
a classroom by a calculus tutor. The topics covered in a classroom tutorial are flexible, and you
can (and should) ask your tutor to cover any homework topics you find difficult. You may also be
asked to present solutions to homework questions to the rest of the class.
The following table lists the topics covered in each tutorial.
Chapter 1
Most functions which arise in real world applications depend on more than one variable. In this
chapter, we give a brief introduction to functions of two (or more) variables. Examples include
functions defined by the following well known formulae:
• A(b, h) = 12 bh (the area of a triangle);
p
• D(x, y) = x2 + y 2 (the distance of a point (x, y) from the origin);
• ℓ(x, y) = 2(x + y) (the perimeter of a rectangle of dimensions x and y units); and
Gm1 m2
• F (m1 , m2 , x1 , x2 ) = (the gravitational force between two bodies of mass m1 and
|x1 − x2 |2
m2 positioned at points P (x1 ) and Q(x2 )).
Geometrically, a function of two variables represents a surface in R3 , just as a function of one
variable represents a curve in R2 . We will introduce the partial derivative of a function of two
variables and use this to calculate the equation of the tangent plane to a surface at a point. Other
applications of the partial derivative include function and error estimation.
For each level curve, the corresponding value of C gives the height of the curve above the
xy-plane.
Example 1.1.2. Sketch level curves for the function F : R2 → R, where F (x, y) = x2 + y 2 .
Solution. The level curves of F are of the form x2 + y 2 = C, where C is a nonnegative constant
(since if C < 0 then there is no solution to the equation x2 + y 2 = C). The level curves given by
x2 + y 2 = 0, x2 + y 2 = 1, x2 + y 2 = 2, x2 + y 2 = 3 and x2 + y 2 = 4 are shown below.
y
4
=
3
z
=
2
z
=
z
1
=
z
z=0 b
x
1 2
Level curves can be interpreted in the following way. If one walked around the circle x2 + y 2 = 4,
then one would remain a constant height of 4 units above the xy-plane. If one started at the origin
and walked 2 units ‘east,’ then one would rise from ‘sea level’ to 4 units above sea level.
Some simple surfaces may be sketched in R3 by using the level curves of the surface and
considering the intersection of the surface with the yz-plane. The final sketch is drawn using
perspective.
Example 1.1.3. Sketch the surface in R3 described by the equation z = x2 + y 2 .
Solution. The level curves for the surface are circles (see the sketch in the previous example). When
x = 0, we have z = y 2 . This gives the intersection of the surface with the yz-plane. The profile of
this intersection is shown below.
z
z = y2
The yz-profile and level curves help us produce the sketch of the surface.
z
z = y2
z=4
z=3
z = x2 + y 2
z=2
z=1
Remark 1.1.4. The previous diagram illustrates the conventional orientation for the x-, y- and
z-axes.
Solution. Each level curve is obtained by setting z equal to C, for some constant C.
z level curve
0 x2 + y 2 = 1
±1 x2 + y 2 = 2
±2 x2 + y 2 = 5
±3 x2 + y 2 = 10
Each level curve is a circle. Those given in the table are sketched below.
3
±
=
2
z
±
=
= ±1
z
=
0
z
z √ x
1 10
z
y2 − z2 = 1
y
−1 1
y2 − z2 = 1
z=3
x2 + y 2 − z 2 = 1
z=2
z=1
z=0 y
z = −1
x
z = −2
z = −3
• used the derivative to calculate the equation of the tangent line to the graph of f at a point
a, and
Over the next few sections, we generalise some of these ideas and techniques to functions F of two
variables. In particular, we introduce the notion of a partial derivative and then
• use the partial derivatives to calculate the equation of the tangent plane to the graph of F
at a point (a, b), and
• use the tangent plane to give a linear approximation for F near (a, b).
Our discussion will assume that we have an intuitive idea of what is meant by a ‘tangent plane to
a surface.’ A rigorous discussion of the existence of tangent planes is connected with the formal
definition of the derivative (as opposed to partial derivative) of a function of two variables. This
rigour is pursued in some second year courses.
To introduce the notion of a partial derivative, consider the function F given by
F (x, y) = x2 + y 2 .
The surface z = x2 + y 2 , corresponding to the graph of F , was sketched in Example 1.1.3. Our
immediate goal is to quantify the rate of change of F (x, y) at the point (1, 2).
First, we find the rate of change of F (x, y) at (1, 2) in the y-direction. This means that we hold
x constant and only allow y to vary. Since we are considering the rate of change at the point (1, 2),
we have x = 1 and
z = F (x, y) = F (1, y) = 1 + y 2
d
gradient = (1 + y 2 ) = 2y = 4.
dy y=2 y=2
Fy (1, 2) = 2 × 2 = 4.
Fx (x, y) = 2x.
Fx (1, 2) = 2 × 1 = 2.
(1, 2, 5) b
(
z = 1 + y2
x=1
gradient = 4
(1, 0, 0) b b
(1, 2, 0)
Figure 1.1: The intersection of the surface z = x2 + y 2 with the plane x = 1. The dashed line is
the tangent line to the cross-section at the point (1, 2, 5).
Remark 1.2.3. As illustrated at the beginning of this section, Fy (a, b) gives the rate of change
of F at the point (a, b) in the y-direction. Interpreted geometrically, the number Fy (a, b) is the
gradient of the tangent to the cross-section at (a, b) when the surface z = F (x, y) is intersected
with the plane x = a. Similarly, Fx (a, b) gives the rate of change of F at the point (a, b) in the
x-direction.
Fx (x, y) = 2xy.
Fy (x, y) = x2 + 2.
Remark 1.2.5 (Notation). Suppose that a function F has partial derivatives Fx and Fy . Then Fx
may be denoted by
∂F
or D1 F,
∂x
while Fy may be denoted by
∂F
or D2 F.
∂y
The notation involving the ‘curly d’ is used most frequently. However, the notation D1 F and D2 F
is less ambiguous. (For example, to calculate D1 F (y, x), we differentiate F with respect to its first
variable and then evaluate this partial derivative at the point (y, x). In ‘curly d’ notation, one
∂F
would write (y, x). Here, the first x represents the first variable of the function while the x in
∂x
parentheses represents the second ordinate of the point (y, x).)
∂F ∂ xy3 3 ∂
= 3 sin(y) e + 3exy (sin y) (by using the product rule)
∂y ∂y ∂y
3
3
= 3 sin(y) 3xy 2 exy + 3exy (cos y)
3
= 3exy 3xy 2 sin y + cos y .
So far we have seen examples of first order partial derivatives. Second order partial derivatives
can be computed by differentiating first order partial derivatives. Some notation is given below:
∂2F ∂ ∂F
means ;
∂x2 ∂x ∂x
∂2F ∂ ∂F
means ;
∂y 2 ∂y ∂y
∂2F ∂ ∂F
means ; and
∂x∂y ∂x ∂y
∂2F ∂ ∂F
means .
∂y∂x ∂y ∂x
Second order partial derivatives may be denoted using other notation. For example,
∂2F
= Fxx = D12 F
∂x2
while
∂2F
= Fxy = D2 D1 F.
∂y∂x
Example 1.2.7. Compute all second order partial derivatives of F , where F (x, y) = 3xy 4 +ex sin y.
The second order partial derivatives are obtained by furher differentiation. Thus
∂
Fxx (x, y) = 3y 4 + ex sin y = ex sin y
∂x
∂
Fyy (x, y) = 12xy 3 + ex cos y = 36xy 2 − ex sin y
∂y
∂
Fyx (x, y) = 12xy 3 + ex cos y = 12y 3 + ex cos y
∂x
∂
Fxy (x, y) = 3y 4 + ex sin y = 12y 3 + ex cos y.
∂y
Similarly,
F (a + h1 , b + h2 ) − F (a + h1 , b) − F (a, b + h2 ) + F (a, b)
Fyx (a, b) = lim lim .
h1 →0 h2 →0 h1 h2
To show that Fyx (a, b) = Fxy (a, b), one need only swap the order in which the limits are taken.
This step can be justified by the continuity hypothesis of the mixed derivative theorem. The details
are not easy and will be omitted here.
Example 1.3.1. Suppose that F (x, y) = x2 + y 2 . By using vector geometry, find the Cartesian
equation of the tangent plane to the surface z = F (x, y) at the point where (x, y, z) = (1, 2, 5).
Find also a vector n that is normal to the surface at this point.
Fy (1, 2) = 4.
By using the point-gradient formula for a straight line, the Cartesian equation for this tangent is
given by
z − 5 = 4(y − 2), x = 1.
If λ = y − 2 then the equation of the tangent line in parametric vector form is
x 1 0
y = 2 + λ 1 (1.1)
z 5 4
whenever µ ∈ R. Note that this line lies in the tangent plane to the surface at (1, 2, 5).
Step 2. Now we intersect the surface with the plane y = 2 and repeat the method of Step 1.
The cross-sectional profile of this intersection is given by
(
z = x2 + 4
y = 2.
Consider the line that lies in the plane y = 2 and is tangent to z = x2 + 4 at (1, 2, 5). Its gradient
is given by
Fx (1, 2) = 2
and hence its Cartesian equation by
z − 5 = 2(x − 1), y = 2,
If µ = x − 1 then we find that the parametric vector form of the tangent line is
x 1 1
y = 2 + µ 0 (1.2)
z 5 2
whenever λ ∈ R. Note that this line also lies in the tangent plane to the surface at (1, 2, 5).
Step 3. Since the lines given by (1.1) and (1.2) both lie in the tangent plane, and since the
vectors
0 1
1 and 0
4 2
are nonparallel, the tangent plane to the surface at (1, 2, 5) is given by
x 1 0 1
y = 2 + λ 1 + µ 0
z 5 4 2
where λ and µ are arbitrary real numbers.
Step 4. We now convert the parametric vector form of the plane to point-normal form. A vector
n that is normal to the plane is given by
0 1 2
n = 1 × 0 = 4 .
4 2 −1
Hence the point-normal form for the tangent plane is
2 x−1
4 · y − 2 = 0.
−1 z−5
By expanding the dot product, one obtains z = 5 + 2(x − 1) + 4(y − 2), which simplifies to
2x + 4y − z = 5.
This is the cartesian form of the plane, and the vector (2, 4, −1)T is normal to the surface at the
point (1, 2, 5).
Note in the above example that Fx (1, 2) = 2 and Fy (1, 2) = 4. Each of these numbers appear
as coefficients in the equation of the tangent plane and as components of the normal vector. By
generalising the above example, one obtains the formulae in the following proposition.
Proposition 1.3.2. Suppose that F is a function of two variables and (x0 , y0 , z0 ) is a point that
lies on the surface z = F (x, y). If the surface has a tangent plane at the point (x0 , y0 , z0 ), then the
tangent plane is given by the equation
z = z0 + Fx (x0 , y0 )(x − x0 ) + Fy (x0 , y0 )(y − y0 )
and a normal vector to the surface at (x0 , y0 , z0 ) is given by
Fx (x0 , y0 )
Fy (x0 , y0 ) .
−1
Remark 1.3.3. The above proposition is similar to what is already known for functions of a single
variable. In fact, we have the following. Suppose that f is a function of one variable and (x0 , y0 )
is a point that lies on the curve y = f (x). If f is differentiable at x0 , then the tangent line to the
curve at (x0 , y0 ) is given by the equation
y = y0 + f ′ (x0 )(x − x0 )
and a normal vector to the curve at (x0 , y0 ) is given by
′
f (x0 )
.
−1
Remark 1.3.4. The proposition implicitly assumes that the first order partial derivatives for F
exist at (x0 , y0 ). It can be shown that if a tangent plane exists then these first order partial
derivatives also exist. Hence this implicit assumption causes no problems. (Be warned however,
that the existence of first order partial derivatives at (x0 , y0 ) does not guarantee the existence of a
tangent plane at (x0 , y0 , z0 ).)
Example 1.3.5. Suppose that F (x, y) = sin(πxy 2 ). Write down the Cartesian equation for the
tangent plane to the surface z = F (x, y) at the point (2, −1, 0) and find a vector that is normal to
the surface at this point.
Solution. The partial derivatives of F are given by
Fx (x, y) = πy 2 cos(πxy 2 ) and Fy (x, y) = 2πxy cos(πxy 2 ).
Hence
Fx (2, −1) = π and Fy (2, −1) = −4π.
So the equation of the tangent plane is given by
z = 0 + π(x − 2) − 4π(y + 1) or πx − 4πy − z = 6π.
and a normal vector is
π
−4π .
−1
Notes:
• One could also use the point normal form directly
to find the equation of the tangent plane.
fx
Thus the vector normal to the plane is n = fy (evaluated at the point P ), and so the
−1
equation of the tangent plane is (x − P ).n = 0.
2 π
Hence, in the previous example, we could simply expand x − −1 . −4π = 0 to find
0 −1
the equation of the tangent plane.
gx
• More generally, if a surface is given in the form g(x, y, z) = 0, then the vector n = gy
gz
evaluated at some point P on the surface, is a vector normal to the surface at P .
x2 y2 z2
Example 1.3.6. Find the equation of the tangent plane to the ellipsoid 4 + 2 + 8 = 1 at the
point P (0, 1, 2)
Solution. A vector normal to the ellipsoid at P is given by
x
2 0
n = y = 1 .
z
4 P 1/2
y = y0 + f ′ (x0 )(x − x0 ),
where y0 = f (x0 ). When x is close to x0 , the tangent line is close to the graph of f . In other words,
∆f ≈ f ′ (x0 )∆x.
This is called the differential approximation to ∆f . Our goal is to generalise this idea to functions
of two variables.
Suppose that a surface given by z = F (x, y) has a tangent plane at the point (x0 , y0 , z0 ). The
equation of the tangent is given by
z = z0 + Fx (x0 , y0 )(x − x0 ) + Fy (x0 , y0 )(y − y0 ).
If (x, y) is near (x0 , y0 ) then
F (x, y) ≈ z0 + Fx (x0 , y0 )(x − x0 ) + Fy (x0 , y0 )(y − y0 ).
Since (x0 , y0 , z0 ) lies on the surface, z0 = F (x0 , y0 ). Thus
F (x, y) − F (x0 , y0 ) ≈ Fx (x0 , y0 )(x − x0 ) + Fy (x0 , y0 )(y − y0 ). (1.3)
Let ∆x denote the difference x − x0 between x and x0 and let ∆y denote the difference y − y0
between y and y0 . Then (1.3) becomes
F (x0 + ∆x, y0 + ∆y) − F (x0 , y0 ) ≈ Fx (x0 , y0 )∆x + Fy (x0 , y0 )∆y.
The left-hand side of this approximation represents the change in F when x0 and y0 are changed
by ∆x and ∆y respectively. We call this the increment in F and denote it by ∆F ; that is,
∆F = F (x0 + ∆x, y0 + ∆y) − F (x0 , y0 ).
Hence
∆F ≈ Fx (x0 , y0 )(x − x0 ) + Fy (x0 , y0 )(y − y0 ).
This formula is called the total differential approximation to ∆F . By supressing the point of
evaluation, the total differential approximation may be written as
∂F ∂F
∆F ≈ ∆x + ∆y.
∂x ∂y
The approximation improves when ∆x and ∆y are smaller.
The total differential approximation can be used to estimate the change in the output of a
function given changes to each of the inputs.
Example 1.4.1. The ideal gas law asserts that the pressure P , volume V and temperature T of
an ideal gas are related by the formula
P V = kT,
where k is a constant. If the temperature is increased by 4% and the volume is decreased by 5%,
estimate the percentage increase in pressure.
Solution. We have
kT ∂P k ∂P kT
,
P = = and = − 2.
V ∂T V ∂V V
Now the temperature is increased by 4%, so ∆T = 0.04T . Similarly, the volume is decreased by
5% and so ∆V = −0.05V . By the total differential approximation,
∂P ∂P
∆P ≈ ∆T + ∆V
∂T ∂V
k kT
= × 0.04T − 2 × (−0.05V )
V V
kT
= 0.04P + 0.05P (since P = V )
= 0.09P.
Hence the pressure increases by approximately 9%.
In science, engineering, psychology, economics and so on, measurements are often made that are
not exact. Any quantities calculated from these measurements will also contain errors. The total
differential approximation can give us an idea how bad such errors can get. Given a function F of
two variables x and y, one can interpret ∆F as the error in the output given errors ∆x and ∆y in
the inputs. Typically, one does not know the precise value of ∆x and ∆y, but sometimes one can
find an upper bound for the absolute errors |∆x| and |∆y|. The total differential approximation
then gives an approximate upper bound for the absolute error |∆F | in F :
∂F ∂F
|∆F | ≈ ∆x + ∆y.
∂x ∂y
∂F ∂F
≤ |∆x| + |∆y|,
∂x ∂y
(where we have used the triangle inequality in the last step). The next example illustrates these
ideas.
Example 1.4.2. The dimensions of a cylinder are measured to the nearest millimeter using a
measuring tape. The circumference is measured to be 22.0 cm and height is measured to be 15.0 cm.
Use these measurements to (a) estimate the volume of the cylinder, and (b) estimate an upper bound
for the percentage error in your answer to part (a).
Solution. (a) Let r, C and h denote the radius, circumference and height respectively. Then
C = 2πr and so 2
C C 2h
V = πr 2 h = π h= .
2π 4π
By using the measurements C = 22 and h = 15, one finds that
1815
V = .
π
And so the volume is estimated to be 1815 3 3
π cm , which is approximately 577.73 cm .
(b) The absolute error in each measurement is at most 0.5 mm, which is 0.05 cm. Let ∆C and
∆h denote the error in each measurement. Then
The increment ∆V is the error in our calculation for the volume. Now
C 2h ∂V Ch ∂V C2
V = , = and = .
4π ∂C 2π ∂h 4π
So the total differential approximation (when C = 22 and h = 15) is
∂V ∂V
∆V ≈ ∆C + ∆h
∂C ∂h
Ch C2
= ∆C + ∆h
2π 4π
165 121
= ∆C + ∆h
π π
dF ∂F dx ∂F dy
= + . (1.4)
dt ∂x dt ∂y dt
Theorem 1.5.1. Suppose that F is a function of two variables and that x and y are both functions
of one variable. Define the function φ by φ(t) = F (x(t), y(t)) and the point (x0 , y0 ) by (x0 , y0 ) =
(x(t0 ), y(t0 )). If x and y are both differentiable at t0 and the partial derivatives of F exist and are
continuous at (x0 , y0 ), then φ is differentiable at t0 and
Remark 1.5.2. Formulae (1.4) and (1.5) are equivalent. The former is easier to remember while
the latter is more precise. To remember the rule, consider the following chain diagram.
∂F x dx
∂x dt
F t
∂F y dy
∂y dt
To construct the diagram, draw an arrow from each function to each of its variables. Then dF dt is
the sum of all paths (left to right) from F to t, where the derivatives are multiplied across each
path.
Example 1.5.3. The potential energy E of a particle at point (x, y) is given by E(x, y) = sin(πx2 y).
If the x-ordinate of the particle is increasing at a rate of 3 units per second, and the y-ordinate of
the particle is decreasing at a rate of 2 units per second, find the rate of change of potential energy
when the particle has coordinate (−1, 2).
Solution. Since the ordinates x and y of the particle change with time t, we may view x and y as
functions of t. We are told that
dx dy
=3 and = −2.
dt dt
By the chain rule,
dE ∂E dx ∂E dy
= +
dt ∂x dt ∂y dt
= 2πxy cos(πx2 y) × 3 + πx2 cos(πx2 y) × (−2)
= 2πx(3y − x) cos(πx2 y).
We now examine the case when F is a function of x and y, where each of x and y is a function
of both s and t. This situation is sometimes written as
If we treat s as a constant and differentiate F with respect to t, then chain rule (1.4) gives
∂F ∂F ∂x ∂F ∂y
= + .
∂t ∂x ∂t ∂y ∂t
Similarly, if we treat t as a constant and differentiate F with respect to s, then chain rule (1.4)
gives
∂F ∂F ∂x ∂F ∂y
= + .
∂s ∂x ∂s ∂y ∂s
Each of these new chain rules may be remembered using the following chain diagram.
∂x
∂s s
∂F x
∂x ∂y
∂s
F
∂x
∂F ∂t
∂y y
∂y t
∂t
For example, to remember the rule for ∂F ∂s , simply sum all paths (left to right) from F to s, where
the derivatives are multiplied across each path.
Example 1.5.4. Suppose that z = F (x, y). Express the point (x, y) in terms of polar coordinates
(r, θ). Hence express ∂z ∂z
∂r and ∂θ in terms of x, y, Fx and Fy . Finally, show that the partial derivatives
satisfy the equation
∂z ∂z ∂F ∂F
r + = (x − y) + (x + y) .
∂r ∂θ ∂x ∂y
Solution. We have
and
∂z ∂z ∂x ∂z ∂y
= +
∂θ ∂x ∂θ ∂y ∂θ
= −Fx (x, y)r sin θ + Fy (x, y)r cos θ
= −y Fx (x, y) + x Fy (x, y).
Finally,
!
∂z ∂z x ∂F y ∂F ∂F ∂F
r + =r p +p + −y +x
∂r ∂θ x + y ∂x
2 2 x + y ∂y
2 2 ∂x ∂y
∂F ∂F ∂F ∂F
=x +y −y +x
∂x ∂y ∂x ∂y
∂F ∂F
= (x − y) + (x + y) ,
∂x ∂y
as required.
We present one more useful version of the chain rule. Suppose that F is a function of u and
that u is a function of both x and y. This is sometimes written as
∂u x
∂x
dF
du
F u
∂u
∂y y
These chain rules may be easily written down after sketching the chain diagram.
Suppose that F is a function of three variables x, y and z. The partial derivatives of F are
defined by
F (x + h, y, z) − F (x, y, z)
Fx (x, y, z) = lim
h→0 h
F (x, y + h, z) − F (x, y, z)
Fy (x, y, z) = lim
h→0 h
F (x, y, z + h) − F (x, y, z)
Fz (x, y, z) = lim
h→0 h
wherever these limits exist. Equivalent notation for each of these partial derivatives is given below:
∂F ∂F ∂F
Fx = = D1 F, Fy = = D2 F, and Fz = = D3 F.
∂x ∂y ∂z
If (a, b, c) is a point in R3 then Fx (a, b, c) is the rate of change of F in the x-direction at (a, b, c).
Similarly, Fz (a, b, c) is the rate of change of F in the z-direction at (a, b, c).
The partial derivatives of F are calculated by differentiating F with respect to one variable and
treating the other variables as constants. For example, if
then
Fx (x, y, z) = 2e2x z cos y, Fy (x, y, z) = −e2x z sin y and Fz (x, y, z) = e2x cos y.
(assuming, of course, that that a ‘tangent plane’ to the surface exists at this point).
The total differential approximation ∆F is given by
∂F ∂F ∂F
∆F ≈ ∆x + ∆y + ∆z.
∂x ∂y ∂z
The chain rules are easily written down using chain diagrams. For example, suppose that F is
a function of x, y and z and that x, y and z are each functions of both u and v. The corresponding
chain diagram is shown below.
x
u
F y
v
z
∂F
So the chain rule for is given by
∂u
∂F ∂F ∂x ∂F ∂y ∂F ∂z
= + + ,
∂u ∂x ∂u ∂y ∂u ∂z ∂u
∂F
while the chain rule for is given by
∂v
∂F ∂F ∂x ∂F ∂y ∂F ∂z
= + + .
∂v ∂x ∂v ∂y ∂v ∂z ∂v
The generalisation of each of these formulae to a function of four (or more) variables should be
obvious.
3x2 y
> diff(x^3*y-sin(y^2),y$2);
4 sin(y 2 )y 2 − 2 cos(y 2 )
Questions marked with [R] are routine and with [H] are harder. You should make sure that you
can do the easier questions before you tackle the more difficult questions. Questions marked [HH]
are very hard and for interested students only.
2 ∂z ∂z ∂2z
2. [R] Given that z = ex y , find , and .
∂x ∂y ∂y∂x
3. [R] In each case, find all first and second order partial derivatives and verify that
∂2z ∂2z
= .
∂x∂y ∂y∂x
a) z = x2 y + y 2 b) z = tan−1 (y/x) c) z = sin(x − cy)
4. [R] Find a normal vector n and the equation of the tangent plane to the surface S at the
point x0 .
a) S : z = x2 + y 2 , x0 = (3, 5, 34).
b) S : z= 4x2 y, x0 = (2, −1, −16).
c) S : z = ln(x2 + 3y 2 ), x0 = (2, −1, ln 7).
√
d) S : z 2 + x2 + y 2 = 1, x0 = 13 , 12 , 623 .
x+1
5. [R] Suppose that z = . The measured values of x and y are 3 and 1 respectively and
y2 + 1
each of the measurements is made with an error whose absolute value is at most 0.02. Use
the total differential approximation of z to estimate the maximum error in the calculated
value of z.
6. [R] The volume V of a football in the shape of an ellipsoid of revolution with semi-axes
of length a, b and b is given by
4
V = πab2 .
3
The values of a and b are measured to be 12.0 cm and 7.0 cm respectively, each to the
nearest millimetre.
A
S= ,
A−W
where A and W are its weights in air and water respectively.
∂S ∂S
a) Find and .
∂A ∂W
b) If A and W are measured to be 15.1 gm and 5.1 gm respectively, and if each of these
measurements is made with an error whose absolute value is at most 0.2 gm, then
use the total differential approximation of S to estimate the maximum error in the
calculated value of S.
9. [R] The specific volume v of a compressible fluid flowing through a section of area A with
mean velocity V is given by
v = kAV
where k is a constant. If v decreases by 5% and A increases by 4%, then estimate the
percentage change in V .
10. [R] A triangle has two sides of length a and b with an included angle measuring π/3
radians. Given that a increases by 5%, b decreases by 6% and the included angle increases
by 2%, estimate the percentage increase of area of the triangle.
12. [R] A cylindrical metallic solid is expanding under heat in such a way that its height is
increasing at the rate of 0.1 cm/sec and its radius is increasing at the rate of 0.05 cm/sec.
Find the rate of increase of its volume at the instant when the height is 10 cm and the
radius is 5 cm.
13. [H] Suppose that f is a differentiable function of a single variable and F (x, y) is defined
by F (x, y) = f (x2 − y).
b) Given that F (0, y) = sin y for all y, find a formula for F (x, y).
∂2u ∂2u
− 16 = 0.
∂t2 ∂x2
(This is an example of the one dimensional wave equation, which can be used to model,
for example, the displacement u(x, t) of a particle at position x along a vibrating guitar
string at time t.)
F (x, y, z) = x2 + y 2 − z 2 = 1.
The position of the point moves with respect to time as x(t) = z(t) = t. The paramerisation
of y is unspecified aside from y(t) 6= 0.
dy
a) Find the parameterisation of the y co-ordinate and then find dt .
b) Calculate the normal to the hyperboloid at the point (x, y, z), this is the vector
∂F ∂F ∂F T
∇F = , , .
∂x ∂y ∂z
Chapter 2
Integration techniques
boil down to evaluating an appropriate integral. Some of these applications were explored in last
semester’s course while others will be discussed later in this course or in second year. But what
these applications demand is mastery of integration. In this chapter we work towards that goal by
examining techniques for integrating various types of integrals that arise when solving real world
problems. The hard work done here will pay off when applications of such integrals are studied.
where m and n are non-negative integers. There are essentially two cases: (i) either m or n (or
both) are odd; or (ii) both m and n are even. We’ll begin with the first case.
Case (i). Suppose that m is odd in (2.1). Then we use the substitution u = sin x along with
the identity
sin2 x + cos2 x = 1
Z
Example 2.1.1. Evaluate the integral cos3 x sin4 x dx.
u = sin x, du = cos x dx
yields
Z Z
3 4
cos x sin x dx = cos2 x sin4 x cos x dx
Z
= (1 − sin2 x) sin4 x cos x dx
Z
= (1 − u2 )u4 du
Z
= u4 − u6 du
u5 u7
= − +C
5 7
sin5 x sin7 x
= − + C.
5 7
If n is odd in (2.1) then we use the substitution u = cos x and follow the same strategy. (If
both m and n are odd, then either of the substitutions u = sin x or u = cos x will work.)
Z
Example 2.1.2. Evaluate the integral cos6 x sin5 x dx.
u = cos x, du = − sin x dx
Case (ii). The case where both m and n are even in (2.1) requires an entirely different approach.
This time we use the identities
1 + cos 2x 1 − cos 2x
cos2 x = and sin2 x = (2.2)
2 2
We then repeat the methods of Case (i) or Case (ii) until each integral in the sum is easy to
compute.
Z
Example 2.1.3. Evaluate sin2 x dx.
The first integrand of (2.3) is an even power of cos 2x and is evaluated using the first identity in
(2.2):
Z Z
2 1
cos 2x dx = 1 + cos 4x dx
2
x sin 4x
= + + C1 .
2 8
The second integrand of (2.3) is an odd power of cos 2x. The substitution
gives
Z Z
1
cos3 2x dx = (1 − sin2 2x)2 cos 2x dx
2
Z
1
= 1 − u2 du
2
u u3
= − + C2
2 6
sin 2x sin3 2x
= − + C2 .
2 6
Following from (2.3) we obtain
Z
x sin 2x x sin 4x sin 2x sin3 2x
sin2 x cos4 x dx = + − − − + +C
8 16 16 64 16 48
x sin 4x sin3 2x
= − + + C.
16 64 48
where m and n are real numbers. These have many applications, including analysis of waves,
musical harmonics and distribution of heat in solids. Such applications are discussed in some
second year courses.
To evaluate the integrals in (2.4) we need the following trigonometric identities.
Proof. We only prove the first identity; the other proofs are similar. We begin with the sum and
difference formulae
d d
tan2 x + 1 = sec2 x, tan x = sec2 x and sec x = tan x sec x
dx dx
to find suitable substitutions or strategies.
Z
Example 2.1.7. Evaluate tan2 x dx.
= tan x − x + C.
Z
Example 2.1.8. Evaluate sec4 x tan x dx.
sec4 x
= + C.
4
(Of course, one can always by-pass the substitution and integrate by inspection.)
as required.
Using (2.8), we see that
Z π/2
tan6 x dx = I6
0
1
= − I4
5
1 1
= − − I2
5 3
1 1 1
= − + − I0
5 3 1
Z π/4
1 1 1
= − + − dx
5 3 1 0
1 1 1 π
= − + −
5 3 1 4
13 π
= − .
15 4
(Note that I0 must be evaluated directly, since formula (2.8) is only valid when n ≥ 2.)
In the final example, the reduction formula has two parameters (m and n) instead of one.
Z π/2
(b) [R] Using the result of (a), evaluate cos4 x sin6 x dx.
0
sinn+1 x
u = cosm−1 x v=
n+1
u′ = −(m − 1) cosm−2 x sin x v = sinn x cos x
′
gives
π/2 Z
cosm−1 x sinn+1 x m − 1 π/2
Im,n = + cosm−2 x sinn+2 x dx
n+1 0 n + 1 0
Z π/2
m−1
= sinn x cosm−2 x(1 − cos2 x) dx
n+1 0
m−1 m−1
= Im−2,n − Im,n .
n+1 n+1
By bringing the Im,n terms to the left-hand side and rearranging, the first formula is obtained. The
second formula is proved similarly.
(b) The first formula in (2.10) allows us to reduce the first parameter:
Z π/2
cos4 x sin6 x dx = I4,6
0
3
= I2,6
10
3 1
= · I0,6 .
10 8
Lemma 2.2.4. Suppose that q is a positive integer and In is defined as above. If n ≥ 2 then
Moreover,
I1 = 4q 2 and I0 = 2.
Proof. We give an outline proof only; students should be able to fill in the details. Suppose that
n ≥ 2. Integration by parts with
n
π2 2
u= −x v = sin x
4
2 n−1
′ π 2
u = −2nx −x v ′ = cos x
4
yields
Z π/2 n−1
2nq 2n π2
In = x − x2 sin x dx.
n! −π/2 4
A second application of integration by parts with
2 n−1
π 2
u=x −x v ′ = sin x
4
gives
Z π/2 n−1 Z π/2 2 n−2
2q 2n π2 2 4q 2n 2 π 2
In = −x cos x dx − x −x cos x dx
(n − 1)!−π/2 4 (n − 2)! −π/2 4
Z π/2 2 n−2
2 4q 2n 2 π 2
= 2q In−1 − x −x cos x dx.
(n − 2)! −π/2 4
2
2 π2 π 2
In the right-most integrand, write x as − − x . Hence
4 4
Z n−2 Z n−1 !
π/2 π/2
4q 2n π2 π2 π2
In = 2q 2 In−1 − − x2 cos x dx − − x2 cos x dx
(n − 2)! 4 −π/2 4 −π/2 4
= 2q 2 In−1 − q 4 π 2 In−2 + 4(n − 1)q 2 In−1 .
If we gather both In−1 terms then we obtain (2.12) as required. The proof that I1 = 4q 2 and I0 = 2
is straightforward and is left as an exercise.
The next lemma will be used to show that 0 < In < 1 for sufficiently large n.
an
Lemma 2.2.5. If a > 0 then lim = 0.
n→∞ n!
Proof. Suppose that π = pq where p and q are positive integers and consider the integral In defined
by (2.11) whenever n ≥ 0.
First we argue by mathematical induction that In is an integer for every value of n. By Lemma
2.2.4, I0 and I1 are integers. Suppose inductively that Ik−2 and Ik−1 are integers whenever k ≥ 2.
By (2.12) and the assumption that π = p/q,
As n → ∞, the expression in (2.13) approaches 0 by Lemma 2.2.5. Hence 0 < In < 1 whenever n
is sufficiently large. In particular, there is a large value of n for which In is not an integer, giving
a contradiction.
Hence we conclude that π is an irrational number.
Many integrals can be evaluated by finding the right substitution, but unfortunately there is
no general systematic way to do this. Integrals involving square roots of quadratics often yield to
trigonometric or hyperbolic substitutions.
The following√table indicates which substitution can be tried for integrals containing an expres-
sion of the form ±x2 ± a2 .
Whether or not a trigonometric substitution is more efficient than a hyperbolic substitution de-
pends on the particular integral. In general, trigonometric substitutions are favoured because once
integration is completed in the variable θ, it is easier to restate the result in terms of x.
Z p
Example 2.3.1. Evaluate 1 − x2 dx.
yields
Z p Z p
1 − x2 dx = 1 − sin2 θ cos θ dθ
Z √
= cos2 θ cos θ dθ (since sin2 θ + cos2 θ = 1)
Z
= cos2 θ dθ
Z
1
= 1 + cos 2θ dθ (by the double-angle formula for cosine)
2
1 sin 2θ
= θ+ +C
2 2
1
= (θ + sin θ cos θ) + C (by the double-angle formula for sin).
2
x 1
sin θ = x
1
θ
√
1 − x2
√
1 − x2
We see that θ = sin−1 x and cos θ = . Hence
1
Z p
1 −1 p
1 − x2 dx = sin x + x 1 − x2 + C.
2
Z
dx
Example 2.3.2. Evaluate .
(4 + x2 )3/2
x = 2 tan θ dx = 2 sec2 θ dθ
Z Z
dx 2 sec2 θ dθ
= √ 3
(4 + x2 )3/2 4 tan2 θ + 4
Z
2 sec2 θ dθ
= √ 3
2 tan2 θ + 1
Z
2 sec2 θ dθ
=
(2 sec θ)3
Z
1 dθ
=
4 sec θ
Z
1
= cos θ dθ
4
sin θ
= + C.
4
√
x x2 + 4
tan θ = x
2
θ
2
x
Thus sin θ = √ and hence
2
x +4
Z
dx x
2 3/2
= √ + C.
(4 + x ) 4 x2 + 4
Z
x3 dx
Example 2.3.3. Use the substitution x = 3 cosh θ to evaluate √ .
x2 − 9
x = 3 cosh θ dx = 3 sinh θ
√
and the identity cosh2 θ − sinh2 θ = 1 gives x2 − 9 = 3 sinh θ. Hence
Z Z 4
x3 dx 3 cosh3 θ sinh θ dθ
√ = p
x2 − 9 9 cosh2 θ − 9
Z 4
3 cosh3 θ sinh θ dθ
= (since cosh2 θ − sinh2 θ = 1)
3 sinh θ
Z
= 27 cosh3 θ dθ
Z
= 27 cosh θ cosh2 θ dθ
Z
= 27 cosh θ(1 + sinh2 θ) dθ (since cosh2 θ − sinh2 θ = 1)
Z
= 27 1 + u2 dx (using the substitution u = sinh θ)
= 27 u + 31 u3 + C.
√
As was observed above, x2 − 9 = 3 sinh θ and hence
p
u = sinh θ = 31 x2 − 9.
Therefore
Z
x3 dx
√ = 27 u + 13 u3 + C
x2 − 9
p p
= 9 x2 − 9 + 31 ( x2 − 9)3 + C.
Exercise: Evaluate the integral in Example 2.3.3 by using an appropriate trigonometric substi-
tution.
The main result of this section is that every rational function has an antiderivative among the
elementary functions. Moreover, there is a systematic way of finding this antiderivative.
Before we begin, we remind the reader that a rational function f is of the form
p(x)
f (x) = ,
q(x)
where p and q are polynomials. We say that f is proper if the degree of the denominator q
is greater than the degree of the numerator p. We say that f is improper if the degree of the
denominator q is less than or equal to the degree of the numerator p. We say that a quadratic
polynomial is irreducible if it has no real linear factors. (Equivalently, a quadratic ax2 + bx + c is
irreducible if its discriminant b2 − 4ac is negative.)
Before articulating the general strategy for integrating a rational function, we revise some known
tactics for integrating simpler examples.
Z
x
Example 2.4.1. Evaluate dx.
x2 + 2x + 10
Solution. The first tactic is to rewrite integrand so that the derivative of the denominator is sitting
on the numerator:
Z Z
x 1 2x
dx = dx
x2 + 2x + 10 2 x2 + 2x + 10
Z
1 (2x + 2) − 2
= dx
2 x2 + 2x + 10
Z
1 2x + 2 2
= 2
− 2 dx.
2 x + 2x + 10 x + 2x + 10
The first term can now be integrated using the ln function. To integrate the second term, we
complete the square in the denominator:
x2 + 2x + 10 = x2 + 2x + 1 + 9
= (x + 1)2 + 32 .
Hence
Z Z Z
x 1 2x + 2 1
2
dx = 2
dx − dx
x + 2x + 10 2 x + 2x + 10 (x + 1)2 + 32
1 2 1 −1 x + 1
= ln |x + 2x + 10| − tan + C.
2 3 3
The integrand of Example 2.4.1 is a proper rational function whose denominator is an irreducible
quadratic. Any such function can be integrated using the techniques illustrated in that example.
We turn now to study a general strategy for integrating any rational function.
1. If the rational function is improper, then use polynomial division to write f as the sum
of a polynomial and a proper rational function. Since the polynomial is easy to integrate,
we need only focus on integrating a proper rational function.
2. It can be shown using algebra that every proper rational function f can be written as a
unique sum of functions of the form
A Bx + C
and , (2.14)
(x − a)k (x2 + bx + c)k
where the quadratic x2 + bx + c is irreducible. This sum is called the partial fractions
decomposition of f . We discuss how to find the partial fractions decomposition in the next
subsection.
3. Now we only need to integrate functions of the form given by (2.14). By completing the
square, using a substitution or performing simple algebraic manipulation, these can be
integrated by the standard formulae
Z
xk+1
xk dx = + C, k 6= −1
k+1
Z ′
g (x)
dx = ln |g(x)| + C
g(x)
Z
dx 1 x
2 2
dx = tan−1 + C.
a +x a a
Z
x4 − 5x3 + 12x2 − 21x + 35
Example 2.4.2. Find dx.
x3 − 3x2 + 4x − 12
Solution. Denote the integrand by f (x).
Step 1. Note that f is improper. So polynomial division gives
x+ 2
x3 − 3x2 + 4x − 12 ) x4− 5x3
+ 12x2 − 21x + 35
x4 − 3x3 + 4x2 − 12x
−2x3 + 8x2 − 9x + 35
−2x3 + 6x2 − 8x + 24
2x2 − x + 11
and hence
2x2 − x + 11
f (x) = x + 2 + .
x3 − 3x2 + 4x − 12
Note that rational expression on the far right-hand side is proper.
2x2 − x + 11
Step 2. The partial fractions decomposition of 3 is given by
x − 3x2 + 4x − 12
2x2 − x + 11 2 1
3 2
= − 2 . (2.15)
x − 3x + 4x − 12 x−3 x +4
(Note that the quadratic x2 + 4 is irreducible.) It is not hard to verify that (2.15) is true; the
question is, How does one find such a decomposition? We answer this question in Subsection 2.4.2.
Step 3. The results of Steps 1 and 2 give
2 1
f (x) = x − 2 + − 2 .
x−3 x +4
To integrate f , we need only integrate each term in the sum. Hence
Z 4 Z
x − 5x3 + 12x2 − 21x + 35 2 1
dx = x − 2 + − dx
x3 − 3x2 + 4x − 12 x − 3 x2 + 4
= 12 x2 − 2x + 2 ln |x − 3| − 1
2 tan−1 x
2 + C,
In the next subsection, we focus on finding the partial fractions decomposition of a proper
rational function.
Case 2: The denominator has a repeated linear factor. Examples of two such rational functions
and the form of their partial fractions decompositions are given below:
x2 + 1 A B C
3
= + 2
+
(x + 4) x + 4 (x + 4) (x + 4)3
x2 − 2 A B C
2
= + + .
(x − 1)(x − 2) x − 1 x − 2 (x − 2)2
Note carefully how the repeated factors appear on the right-hand side. The constants A, B and C
in each case can be determined using the following method.
x2 − 3x + 8
Example 2.4.4. Find the partial fractions decomposition of .
x(x − 2)2
Solution. The partial fractions decomposition takes the form
x2 − 3x + 8 A B C
= + + ,
x(x − 2)2 x x − 2 (x − 2)2
where A, B and C are constants. To find these constants, we multiply through by x(x − 2)2 to
obtain
x2 − 3x + 8 = A(x − 2)2 + Bx(x − 2) + Cx ∀x ∈ R.
Now substitute the obvious values for x to determine the values of A and C:
x=2 ⇒ 6 = 2C ⇒ C=3
x=0 ⇒ 8 = 4A ⇒ A = 2.
To determine B, we can substitute any other value for x. However, it is best to choose a small
integer to keep the arithmetic simple:
and comparing coefficients for x2 .) Hence we obtain the partial fractions decomposition
x2 − 3x + 8 2 1 3
2
= − + .
x(x − 2) x x − 2 (x − 2)2
Case 3: The denominator has an irreducible quadratic factor. Examples of two such rational
functions and the form of their partial fractions decompositions are given below:
x2 + x A Bx + C
2
= + 2
(x − 1)(x + 9) x−1 x +9
3
x − 2x + 4 Ax + B Cx + D
= 2 + 2
(x2 + 5)(x2 + x + 1) x +5 x +x+1
Note carefully how the irreducible quadratic appears on the right-hand side. As before, the con-
stants A, B, C and D in each case can be determined by algebra.
4x2 + 2x + 1
Example 2.4.5. Find the partial fractions decomposition of .
(x + 1)(x2 + x + 1)
Solution. The partial fractions decomposition takes the form
4x2 + 2x + 1 A Bx + C
2
= + 2 ,
(x + 1)(x + x + 1) x+1 x +x+1
x = −1 ⇒ 3=A ⇒ A=3
x=0 ⇒ 1 = A+C ⇒ C = 1 − A = −2
x=1 ⇒ 7 = 3A + 2(B + C) ⇒ B = 1.
(Alternatively, after finding A, we could compare the coefficients of the x2 terms on both sides to
deduce that B = 1, and compare the constant terms to deduce that C = −2.) Hence
4x2 + 2x + 1 3 x−2
2
= + 2
(x + 1)(x + x + 1) x+1 x +x+1
Case 4: The denominator has repeated irreducible quadratic factor. This case rarely appears
in first year mathematics courses because it is more computationally intensive. Nevertheless, for
completeness the basic form of decomposition is illustrated below:
x2 + x Ax + B Cx + D Ex + F
2 3
= 2 + 2 2
+ 2
(x + 9) x +9 (x + 9) (x + 9)3
x3 − 2x + 4 A Bx + C Dx + E
2 2
= + 2 + 2 .
(x − 2)(x + x + 1) x − 2 x + x + 1 (x + x + 1)2
Example 2.4.6. Write down the form of partial fractions decomposition for the rational function
given by
4x4 − 3x2 + x − 9
.
x3 (x − 7)(x2 + 3)2 (x2 + x + 2)
(You are not required to evaluate the constant coefficients.)
4x4 − 3x2 + x − 9 A B C D Ex + F Gx + H Ix + J
3 2 2 2
= + 2+ 3+ + 3 + 2 2
+ 2
x (x − 7)(x + 3) (x + x + 2) x x x x−7 x +3 (x + 3) x +x+2
Remark 2.4.7. It is important to check that the denominator of the rational function has been
completely factorised before writing down the form of partial fractions decomposition. In particular,
one should check that every quadratic factor appearing in the factorisation is irreducible.
whence
−5x − 5
f (x) = 4x +
2x2 − 3x − 2
5x + 5
= 4x − 2 .
2x − 3x − 2
Step 2. To find the partial fractions decomposition of
5x + 5
2x2 − 3x − 2
we factorise the denominator:
5x + 5 = A(x − 2) + B(2x + 1)
Z
4x2 − 15x + 29
Example 2.4.9. Find dx.
(x − 5)(x2 − 4x + 13)
Solution. The integrand is a proper rational function and its denominator completely factorised in
the real numbers. So we immediately look for its partial fractions decomposition, which is of the
form
4x2 − 15x + 29 A Bx + C
2
= + 2
(x − 5)(x − 4x + 13) x − 5 x − 4x + 13
for some real constants A, B and C. Hence
4x2 − 15x + 29 = A(x2 − 4x + 13) + (Bx + C)(x − 5),
from which appropriate substitutions allow the evaluation of the unknown constants:
x=5 ⇒ 54 = 18A ⇒ A=3
x=0 ⇒ 29 = 13A − 5C ⇒ C=2
x=1 ⇒ 18 = 10A − 4(B + C) ⇒ B = 1.
Hence
4x2 − 15x + 29 3 x+2
= + .
(x − 5)(x2 − 4x + 13) x − 5 x2 − 4x + 13
The first term of the decomposition is easy to integrate. We therefore focus on the second term:
Z Z
x+2 1 2x + 4
dx = dx
x2 − 4x + 13 2 x2 − 4x + 13
Z Z
1 2x − 4 8
= dx + dx
2 x2 − 4x + 13 x2 − 4x + 13
Z Z
1 2x − 4 1
= 2
dx − 4 2
dx
2 x − 4x + 13 x − 4x + 13
Z
1 1
= ln |x2 − 4x + 13| − 4 dx
2 (x − 2)2 + 9
1 2 4 −1 x − 2
= ln |x − 4x + 13| − tan + C.
2 3 3
Putting everything together gives
Z
4x2 − 15x + 29 1 2 4 −1 x − 2
dx = 3 ln |x − 5| + ln |x − 4x + 13| − tan + C.
(x − 5)(x2 − 4x + 13) 2 3 3
The method of partial fractions allows us, in principle, to find an antiderivative, among the
elementary functions, for any given rational function. So given a ‘non-standard’ integral, a sound
technique for integration is to look for a substitution that will convert the given integral into the
integral of rational function. Choosing a good substitution is often a matter of experience and a
little inspiration.
u3 = (u3 + 1) − 1
= (u + 1)(u2 − u + 1) − 1,
to obtain Z Z
x1/2 1
1/3 1/4
dx = 12 u13 − u12 + u11 − . . . + u − 1 + du.
x +x u+1
It is easy to evaluate the integral from here.
u = ex du = ex dx
so that
Z Z
dx ex dx
√ = √
e2x − 1 Z ex e2x − 1
du
= √ .
u u2 − 1
From here the integral can be evaluated using the substitution u = sec θ or u = cosh θ. This is left
as an exercise.
A better approach is to remove the square root from the very first substitution. The substitution
u = e2x − 1 implies that
2
du
2u = 2e2x = 2(u2 + 1),
dx
which leads to the substitution
u du
dx = 2 .
u +1
Hence
Z Z
dx u du
√ =
e2x − 1 Z u(u2 + 1)
du
=
u2 + 1
= tan−1 u + C
p
= tan−1 e2x − 1 + C.
As seen in the last example, there may more than one method to evaluate a given integral.
Choosing the most efficient substitution to use is not always easy, but intuition can be developed
with time, experience and practice. The next example is therefore left to the student as an exercise.
Z 1
x3
Example 2.5.2. Evaluate 2 5/2
dx by
0 (4 + x )
√
(i) using the substitution x = 2 tan θ (since the integrand involves 4 + x2 );
√
(ii) using the substitution x = 2 sinh θ (since the integrand involves 4 + x2 );
convert(f, parfrac, x); performs a partial fraction decomposition of the rational function f in
the variable x. For example,
Revision problems
1. [R] Evaluate each of the following integrals by inspection. Do not use substitution.
Z Z Z
2
a) xe2x dx b) x sin(x2 ) dx c) x2 cos(2x3 ) dx
Z Z Z
x 3 dx
d) 2
dx e) sin x cos x dx f)
5x − 11 x ln x
Z Z p Z
x+2 p
g) √ dx h) x 1 + x2 dx i) x2 9 − 4x3 dx
x2 + 4x + 7
Z Z Z
x2 x3 sec2 x
j) √ dx k) dx l) dx
9 − 4x3 (1 + x4 )3 tan4 x
Z Z Z
cos x 2x 2x 13 1
m) 3 dx n) e (4 + 3e ) dx o) dx
sin x x (ln x)5
4. [R]
Z
tan x + sec x
a) By multiplying the integrand by , find sec x dx.
tan x + sec x
b) The reduction formula
Z Z
n secn−2 x tan x n − 2
sec x dx = + secn−2 x dx
n−1 n−1
is valid
Z whenever n ≥ 2. Use Zit to find the following integrals.
i) sec4 x dx ii) sec5 x dx
1
In = n In−1 −
e
Z 1
whenever n > 0. Hence evaluate x3 e−x dx.
0
Z π/4
7. [R] It was proven in the notes that if In = tann x dx then
0
1
In = − In−2
n−1
whenever n > 1. Use this to evaluate I7 and I8 .
Z e
8. [R] Suppose that In = x(ln x)n dx. Show that
1
1 2
In = e − nIn−1
2
whenever n ≥ 1. Hence evaluate I3 .
9. [R] By writing cosn x as cosn−1 x cos x and integrating by parts, show that
Z π/2 Z
n n − 1 π/2
cos x dx = cosn−2 x dx
0 n 0
Z π/2 Z π/2
8
whenever n ≥ 2. Hence find cos x dx and cos7 x dx.
0 0
Z 1
xn
10. [R] Suppose that In = √ dx. Find a reduction formula for In .
0 1+x
Z 1
m!n!
11. [H] Show that xm (1 − x)n dx = for all nonnegative integers m and n.
0 (m + n + 1)!
Z π/2
12. [H] Suppose that In = cosn x dx.
0
1
a) By Writing the reduction formula of Question 9 as In = 1− In−2 , show that
n
m
1 1 1 π π Y 1
I2m = 1− 1− ... 1 − = 1−
2m 2m − 2 2 2 2 2k
k=1
and
m
Y 1
I2m+1 = 1− .
2k + 1
k=1
b) Deduce that
m
2 I2m Y 1
= 1− .
π I2m+1 (2k)2
k=1
whenever m ≥ 1.
d) Use the result of (a) and (c) and the pinching theorem to deduce that
I2m
lim = 1.
m→∞ I2m+1
e) Conclude that
m
Y 1 2
lim 1− = .
m→∞ (2k)2 π
k=1
This limit is called Wallis’ product.
f) Show that
m m
Y 1 Y (2k − 1)(2k + 1) (2m + 1)((2m)!)2
1− = =
(2k)2 (2k)2 24m (m!)4
k=1 k=1
π 24m (m!)4
= lim .
2 m→∞ (2m + 1)((2m)!)2
Z 1
x3
17. [R] Evaluate dx by
0 (4 + x2 )5/2
√
a) using the substitution x = 2 tan θ (since the integrand involves 4 + x2 );
√
b) using the substitution x = 2 sinh θ (since the integrand involves 4 + x2 );
c) using the substitution u2 = 4 + x2 (aiming for a rational function);
d) using the substitution u = 4 + x2 .
Which method works best?
18. [R] The following integrals were selected from past papers. Evaluate each one.
Z Z
dx
a) b) 8 sinh x cosh4 x dx
x(x2 + x + 1)
Z Z p
3x + 5
c) dx d) 25 − x2 dx
x2 + 4x + 8
Z Z
3x2 − 5x + 3 1
e) 2
dx f) √ dx
(x − 1) (x − 2x + 2) x2 1 + x2
Z Z
dx
g) h) cos(4x) sin(3x) dx
(x2 + 3)3/2
Z ∞ −√ x
e
i) √ dx. If convergent evaluate the integral.
1 x
Chapter 3
In many practical applications (in physics, economics, social sciences, engineering, applied science,
mathematics and so on), information is known about the relationship between a quantity and its
rates of change, but one may not have an exact formula for the quantity itself. For example,
a simple population model states that the rate of change of a population, at any given time, is
proportional to size of the population itself. If we write P (t) for the population at time t, then we
arrive at the equation
dP
= kP,
dt
where k is the constant of proportionality. An equation, such as the one given above, which involves
one (or more) of the derivatives of a function, is called a differential equation. Some other simple
examples include
d2 x
• = −k2 x, which is used to describe the displacement x from the origin of a particle
dx2
undergoing simple harmonic motion;
dT
• = k(T − 20), which is used to describe how the temperature T of an object changes
dt
in room temperature; and
dx
• − 0.08y = 0.05(60000 + 1000t), which is used to describe how the amount y (in dollars)
dy
of a particular investment changes in time (see Example 3.4.3).
If possible, the aim from here is to find an explicit formula (or formulae) describing the unknown
function (respectively P , x, T and y in the examples above) appearing in each differential equation.
The primary goal of this chapter is to examine some techniques for obtaining a formula for a function
given a differential equation for that function.
3.1 An introduction
We begin with a definition.
d2 y dy
+ 4x = ex
dx2 dx
f ′′ (x) + 4xf ′ (x) = ex
y ′′ + 4xy ′ = ex
The next example illustrates this definition as well as introducing the terms ‘particular solution’
and ‘general solution.’
x3
y(x) = + 5x + C, (3.1)
3
where C ∈ R. The family of solutions given by (3.1), where C ∈ R, is called the general solution
to the ODE.
In the above example, solution y could be expressed explicitly as a function of the independent
variable x. Hence we obtained an explicit solution to the ODE. However, this cannot always be
done, as the following example illustrates. Sometimes we must settle for an implicit solution to the
ODE.
y 2 = cos(x2 + y 2 ), (3.2)
(where we have used the chain rule to obtain the right-hand side). Hence
dy
2y + 2y sin(x2 + y 2 ) = −2x sin(x2 + y 2 ).
dx
By simple rearrangement it is easily seen that
dy
2x sin(x2 + y 2 ) + 2y sin(x2 + y 2 ) + 2y = 0,
dx
and hence the ODE is satisfied. (This ODE shall be revisited again in Section 3.5, where we shall
find the general solution, instead of merely verifying that a given function is a solution.)
For some differential equations, it may not even be possible to find an implicit solution. If it
is possible to prove that an solution exists, then mathematicians and scientists must often settle
for working with an approximate solution to the ODE. However, such issues will not concern us in
this course.
Definition 3.2.1. An initial value problem is an nth order ODE together with a
set of values of the solution and its first (n − 1) derivatives at some fixed point x0 .
These values are called the initial conditions of the initial value problem.
For example,
dy 2 dy dy
• + 5x + y = sin x, y(0) = 2, = 7;
dx2 dx dx x=0
are all initial value problems. The term ‘initial value problem’ is often abbreviated as IVP.
To solve an initial value problem, we usually try to find a general solution to the ODE (which is
expressed using unspecified constants) and then determine the values of these constants by imposing
the initial conditions.
d2 y
= 6x, y ′ (0) = 2, y(0) = −1.
dx2
Solution. Integrating the ODE once gives
dy
= 3x2 + C
dx
where C ∈ R. By imposing the initial condition y ′ (0) = 2, we deduce that C = 2. Hence
dy
= 3x2 + 2.
dx
Integrating again gives
y = x3 + 2x + D,
where D ∈ R. The initial condition y(0) = −1 implies that D = −1. Hence the solution y to the
IVP is given by
y = x3 + 2x − 1.
Note that this solution is valid for all x in R; that is, the solution y is defined on R.
Not every initial value problem is as straightforward to solve as the example above. Solving an
IVP is, in general, very difficult, and the following questions arise.
(c) If initial values are given at the point a, then how far on either side of a does the solution
extend?
The following two examples show that care must be taken in answering such questions, even for
IVPs that appear to be ‘simple.’
dy √
= y, y(0) = 0.
dx
Solution. If we assume that y(x) 6= 0 then the ODE can be written as
dx 1
=√ , (3.3)
dy y
√
from which we find that x = 2 y + C, where C is a real number. When x = 0 we have that y = 0
and hence C = 0. Rearranging gives
x2
y(x) = .
4
However, note that y(x) = 0 is also a solution to the IVP. Hence the IVP does not have a unique
solution.
dy 1
= , y(1) = 2.
dx x
How far does the solution extend on either side of the point 1?
dy
Solution. First, the ODE implies that dx does not exist at 0. However, on the interval (0, ∞), we
obtain the general solution
y(x) = ln x + C,
where C ∈ R. The initial condition implies that C = 2 and so
y(x) = ln x + 2
whenever x > 0. Hence we have found solution that extends to the interval (0, ∞).
(Note that we could give a family of solutions defined on the set {x ∈ R : x 6= 0} by
(
ln |x| + D if x < 0
y(x) =
ln |x| + 2 if x > 0,
where D ∈ R. However, for most practical applications such a solution would not be used on
(−∞, 0) because of the break in the domain of y at 0.)
A separable ODE is a differential equation where the two variables involved (say x and y) can
be separated so that all the y’s are on one side of the equation and all x’s are on the other. We
give an example and then state the general form.
dy
= y 2 (1 + x2 ), y(0) = 1.
dx
Solution. First we separate the variables x and y to obtain
1
dy = (1 + x2 ) dx. (3.4)
y2
Integrating gives Z Z
1
dy = (1 + x2 ) dx, (3.5)
y2
whence
1 x3
− =x+ + C,
y 3
where C ∈ R. This gives an implicit solution to the ODE.
We now impose the initial condition to evaluate the constant C. When x = 0 and y = 1 we
obtain
1 03
− =0+ + C,
1 3
whence C = −1 and
1 x3
− =x+ − 1.
y 3
Finally, in this particular example, one can easily make y the subject to obtain the explicit
solution
−1
y= x3
x+ −13
−3
= ,
3x + x3 − 3
thus completing the problem.
Remark 3.3.2. Equation (3.4) makes sense within the context of integration (see equation (3.5)).
The fact that this kind of symbolic manipulation with dy and dx ‘works’ can be traced back to the
chain rule, which is the basis for implicit differentiation. (To make this clear, note in the example
above that
1 dy
= 1 + x2
y 2 dx
H(y) = G(x) + C,
where C is the constant of integration. Whenever possible, isolate y on the left-hand side to find
the explicit solution. If initial conditions are given, then the constant C can be determined.
cosh y = 1
2 tan2 x + 4 tan x + C, (3.8)
where C ∈ R. In this case it is best to leave the solution in implicit form (3.8), since cosh is not a
one-to-one function.
Example 3.3.4 (Newton’s law of cooling). (a) Newton’s law of cooling states that the rate
of heat loss of a body is proportional to the difference in temperatures between the body
and its surroundings. Set up an ODE to model this law and solve it.
(b) A hot object is placed into a room of temperature 20◦ C. Unfortunately the object is too
hot for the thermometer to measure its initial temperature. However, after 6 minutes, the
temperature of the object was measured as 80◦ C, and after eight minutes as 50◦ C. What
was the original temperature of the object?
• A is the ambient temperature (that is, the temperature of the surroundings), and
dT
= k(T − A).
dt
To solve this equation, we separate variables:
1
dT = k dt
Z T −A Z
1
dT = k dt
T −A
ln(T − A) = kt + C,
T − A = ekt+C .
Hence
T = A + Kekt , (3.9)
where K = eC > 0.
(b) We have
A = 20, T (6) = 80, and T (8) = 50.
dy
(x − 1)3 + 4(x − 1)2 y = x + 1, y(0) = 2. (3.11)
dx
Solution. First rewrite the ODE into the standard form (3.10) to obtain
dy x+1
+ 4(x − 1)−1 y = . (3.12)
dx (x − 1)3
(Note that it is important to simplify h(x) before proceeding with the method.)
Multiplying (3.12) by the integrating factor gives
dy
(x − 1)4 + 4(x − 1)3 y = x2 − 1,
dx
from which we obtain
d
(x − 1)4 y = x2 − 1
dx
by the product rule. Integrating gives
(x − 1)4 y = 13 x3 − x + C,
where C ∈ R. To evaluate C, we impose the initial condition y(0) = 2 and find that
(0 − 1)4 2 = 31 03 − 0 + C.
(Note that the solution is valid when x ∈ (−∞, 1) or x ∈ (1, ∞) but not when x = 1. In fact, it is
not hard to see from (3.11) that there is no real-valued function y satisfying the ODE with 1 in its
domain.)
The following example shows an application of a first order linear ODE to a real world problem.
Example 3.4.3. An investor has a salary of $60, 000 per year which is expected to increase at a
rate of $1000 per annum. Suppose that an initial deposit of $1000 is invested in a program that
pays 8% per annum, and that the investor deposits 5% of their salary each year. Find the amount
invested after t years.
Solution. We will approximate the situation by assuming that interest is calculated continuously
and that deposits are made continuously.
After multiplying the ODE by the integrating factor and contracting the left-hand side by the
product rule, one obtains
d −0.08t
e y = 0.05(60000 + 1000t)e−0.08t .
dt
Integration (where we use integration by parts for the right-hand side) and rearrangement gives
where C is the constant of integration. Imposing the initial condition y(0) = 1000 yields the final
solution
y(t) = 45312.5 e0.08t − 625t − 46312.5,
where t ≥ 0.
To illustrate, note that after 10 years the investment totals about y(10) ≈ 51507.86 dollars.
In this section we examine another approach to solving (some) first order ODEs.
To begin, suppose that H is a function of two variables x and y satisfying the equation
H(x, y) = C,
where C is a real constant. If we consider y as a function of x and differentiate both sides with
respect to x, then the chain rule gives
∂H ∂H dy
+ = 0.
∂x ∂y dx
∂H ∂H
If and are denoted by F and G respectively, then we obtain the differential equation
∂x ∂y
dy
F (x, y) + G(x, y) = 0. (3.13)
dx
c 2018 School of Mathematics and Statistics, UNSW Sydney
68 CHAPTER 3. ORDINARY DIFFERENTIAL EQUATIONS
∂2H ∂2H
= ,
∂y∂x ∂x∂y
or in other words,
∂F ∂G
= .
∂y ∂x
This second condition on F and G is known as the condition for exactness and is much easier to
verify.
We summarise these observations in the next definition and theorem.
Theorem 3.5.2. Suppose that an ordinary differential equation of the form (3.13) is exact. Then
the solution to (3.13) is given by H(x, y) = C, where C is a constant and where H is a function
satisfying the equations
∂H ∂H
=F and = G.
∂x ∂y
dy F (x, y)
=−
dx G(x, y)
or
F (x, y)dx + G(x, y)dy = 0.
The left-hand side of the second expression is an example of a differential form.
dy 2x + y + 1
=−
dx 2y + x + 1
where the ‘constant of integration’ C1 (y) is a function of y. Similarly, integrating (3.15) with
respect to y (and treating x as a constant) gives
where the ‘constant of integration’ C2 (x) is a function of x. A comparison of (3.16) and (3.17)
shows that
H(x, y) = x2 + xy + y 2 + x + y. (3.18)
Hence the solution to the differential equation is given by
x2 + xy + y 2 + x + y = C, (3.19)
H(x, y) = x2 + xy + y 2 + x + y + K,
where K is an arbitrary constant. However, then the solution to the ODE is given by
x2 + xy + y 2 + x + y + K = C0 ,
where C0 is yet another constant. By combining the constants K and C0 on the right-hand side,
this solution is equivalent to (3.19). Hence is is customary to ignore the constant K.
The next example follows the same overall strategy, but illustrates a slightly different approach
to finding the function H.
∂F ∂G
= 4xy cos(x2 + y 2 ) = ,
∂y ∂x
and so the equation is exact. Hence we look for a function H satisfying
∂H
= F (x, y) = 2x sin(x2 + y 2 ), (3.20)
∂x
∂H
= G(x, y) = 2y sin(x2 + y 2 ) + 2y. (3.21)
∂y
As with the previous example, we integrate (3.20) with respect to x (and treating y as a constant)
to obtain
H(x, y) = − cos(x2 + y 2 ) + C1 (y), (3.22)
where the ‘constant of integration’ C1 (y) is a function of y. So now we only need to determine
C1 (y). To do so, differentiating (3.22) with respect to y (and treating x as a constant) gives
∂H
= 2y sin(x2 + y 2 ) + C1′ (y).
∂y
Comparing this with (3.21) shows that C1′ (y) = 2y, whence C1 (y) = y 2 . (Here we omit the constant
of integration for reasons given in Remark 3.5.5.) Hence
H(x, y) = − cos(x2 + y 2 ) + y 2
− cos(x2 + y 2 ) + y 2 = C,
where C ∈ R. (Note that in this example it is not possible to give an explicit expression for y in
terms of x.)
∂F ∂G
= − cos y and = 0,
∂y ∂x
the differential equation is not exact. What happens if we use the method of the last two examples
regardless?
Suppose that there is a function H such that
∂H
= F (x, y) = ex − sin y, (3.24)
∂x
∂H
= G(x, y) = cos y. (3.25)
∂y
Integrating (3.24) with respect to x gives
Since the integrating factor e−x is never zero, solutions to (3.26) will also be solutions to (3.23).
Moreover, it is easily verified that (3.26) is exact. Hence we can now (successfully) use the method
for solving exact differential equations to obtain the solution
x + e−x sin y = C,
F (x, y) dx + G(x, y) dy = 0
is not exact, then it may be possible to transform it into an exact ODE by multiplying through by
a suitable function. In general, finding such a function is difficult and lies beyond the scope of this
course.
We have seen in previous sections how to solve separable, linear and exact first order ODEs.
While not all first order ODEs are among these types, some can be transformed into one of these
types by a suitable change of variables. We illustrate the principle with two examples.
Example 3.6.1. Use the substitution y(x) = x · v(x) to solve the differential equation
dy xy − y 2
= . (3.27)
dx x2
c 2018 School of Mathematics and Statistics, UNSW Sydney
72 CHAPTER 3. ORDINARY DIFFERENTIAL EQUATIONS
Solution. The idea is to transform (3.27) into a separable ODE involving v and x. Once the general
solution for v is found, then it is easy to write down the solution for y.
Using the substitution y(x) = x · v(x) and the product rule for differentiation, we see that
dy d dx dv dv
= (xv) = v +x =v+x .
dx dx dx dx dx
Hence (3.27) becomes
dv x(xv) − (xv)2
v+x = .
dx x2
If we simplify the right-hand side then
dv
v+x = v − v2 ,
dx
and hence we obtain the separable ODE
dv dx
− = .
v2 x
Integrating both sides gives
1
= ln |x| + C
v
which implies that
1
v=
ln |x| + C
y
where C ∈ R. Now v = and so
x
x
y=
ln |x| + C
gives the general solution to (3.27).
dy
+ 2y + y 2 t2 e2t = 0 (3.28)
dt
by using the substitution z = 1/y.
Solution. Note that (3.28) is not a first order linear ODE because of the term involving y 2 . In this
example we will see that the nonlinear equation in y and t becomes a linear ODE in z and t under
the transformation z = 1/y.
dy
To make use of the substitution z = 1/y, we need to express dx in terms of z. To do so,
differentiate both sides of the equation
1
y=
z
with respect to t to obtain
dy 1 dz
=− 2 .
dt z dt
c 2018 School of Mathematics and Statistics, UNSW Sydney
3.7. MODELLING WITH FIRST ORDER ODES 73
1 dz 2 t2 e2t
− + + 2 = 0.
z 2 dt z z
Rearranging gives
dz
− 2z = t2 e2t ,
dt
which is a first order linear ODE in z. As usual, multiply through by the integrating factor e−2t to
obtain
d −2t
(e z) = t2 .
dt
Integrating gives
t3
e−2t z = + C0 ,
3
whereupon 3
2t t
z=e + C0 ,
3
where C0 ∈ R. Since y = 1/z, the solution to (3.28) is given by
3
y= ,
e2t (t3+ C)
where C = 3C0 ∈ R.
Many real-life problems can be analysed and solved by attempting to convert them into math-
ematics. In doing so, a number of assumptions have to be made and a theoretical framework set
up which attempts to reflect what is happening in the real world. Such a framework is called a
mathematical model. The reliability of that model can be judged by how well it predicts what
actually happens in the real world.
To construct a mathematical model, one should
3. decide which variables in the model are dependent and which are independent, and
4. describe how the dependent variables change as the independent ones vary (which may
lead to a differential equation).
Examples of mathematical modelling with differential equations have already been encountered (see
Examples 3.3.4 and 3.4.3). The following two subsections provide further examples and discussion.
Example 3.7.1. A martini drink is, in essence, a mixture of the two liquids gin and vermouth.
James Blond insists that his martinis be prepared as follows. Initially, 40 cc of gin are placed in a
large container. Then gin is poured into the container at a rate of 2 cc/sec and at the same time
vermouth is poured in at a rate of 6 cc/sec. The mixture is constantly shaken (not stirred) and
flows out at a rate of 4 cc/sec.
(a) Find an expression for the volume of vermouth in the container t seconds after the pouring
commences.
(b) James likes his martini to have roughly two parts gin to three of vermouth. How many
seconds should elapse before he stops pouring and inserts a cocktail glass in the outflow
from the container?
Solution. (a) To begin, it is recommended that we place the relevant information on a diagram.
Container
Initial volume: 40 cc of gin
Next, it is important to identify what we want to find. In this case, we want a formula for the
volume of Vermouth. So let V (t) denote the volume of vermouth (in cc) in the container at time t.
Now we write down as much information about V as we can. We know that V (0) = 0. The
other information given tells us how V changes with time. In particular,
dV
= rate of change of V
dt
= (rate of inflow) − (rate of outflow). (3.29)
Now the rate of inflow of vermouth is 6 cc/sec. To calculate the the rate of outflow, we note that
the total volume of liquid in the container at time t is given by
40 + 2t + 6t − 4t = 40 + 4t.
V (t)
. (3.30)
40 + 4t
Since the rate of outflow of liquid is 4 cc/sec, it follows that the rate of outflow of vermouth is
V (t)
× 4 cc/sec.
40 + 4t
dV V (t)
=6− , V (0) = 0. (3.31)
dt 10 + t
Finally, we solve the IVP. The ODE is first order linear equation, whose solution (when V (0) =
0) is given by
3t2 + 60t
V (t) = . (3.32)
10 + t
The details for finding this solution are left to the reader as an exercise.
(b) The liquid will be two parts gin to three of vermouth exactly when three-fifths of the liquid
is vermouth. Hence, using (3.30), we require that
V (t) 3
= .
40 + 4t 5
3t2 + 60t 3
2
= .
4(10 + t) 5
t2 + 20t − 400 = 0.
where we have chosen the positive solution to the quadratic equation. Hence James should insert
the cocktail glass 12.36 seconds after the mixing process begins.
Example 3.7.2 (Population model 1). In this model, we assume that the growth rate of the pop-
ulation remains constant. That is, we assume that the rate of change of population is proportional
to the population, where the constant of proportionality r is the growth rate. In other words, we
have the IVP
dP
= rP, P (0) = P0 ,
dt
where P is the population at time t, r is the growth rate and P0 is the initial population. Solving
this (separable) ODE gives the solution
P (t) = P0 ert .
(This model goes back to Thomas Malthus’ book An Essay on the Principle of Population, published
in 1798.)
Application. For Mathopolis, P0 = 3, 000, 000 and r = 0.02. Thus the population P (t) of the city
at time t is given by
P (t) = 3000000e0.02t .
The table in Figure 3.1 shows the predicted population when t is 10, 20 and 100. The graph of P
against t is also shown.
1. The model predicts that population will grow indefinitely. This ignores the fact that the
resources and space needed to support such a population are finite.
2. The model ignores external factors (such as disease, natural disasters and wars) that have
an effect on population size.
Example 3.7.3 (Population model 2). In this model the rate of population growth is not propor-
tional to the population. Instead, there is a critical population Pc which when exceeded causes the
population P to decrease; otherwise the population increases. We try the IVP
dP
= k(Pc − P ), P (0) = P0 , (3.33)
dt
where k is a positive constant. Hence the rate of change of P is positive if P < Pc and negative if
P > Pc .
To solve (3.33), we separate the variables and integrate:
Z Z
dP
= k dt.
Pc − P
In the case when P < Pc we obtain
− ln(Pc − P ) = kt + C
and so
P = Pc − Ae−kt ,
where A = e−C . Now P = P0 when t = 0 and so A = Pm − P0 . Hence
(The case when P > Pc gives the same solution, as can be easily verified by carefully working
through the details.) Note that P (t) → Pc as t → ∞.
Application. For Mathopolis, P0 = 3, 000, 000 and dP dt = 0.02P0 = 60, 000 when t = 0. Assume also
that Pc = 7, 000, 000. (That is, due to available land, resources and other factors, one expects the
city’s maximum sustainable population size is 7 million.) By considering the differential equation
(3.33) when t = 0, we conclude that
dP
60000 = = k(Pc − P0 ) = k(7000000 − 3000000)
dt
and hence that k = 0.015. Therefore the population P (t) of Mathopolis at time t is given by
See Figure 3.1 for specific population projections under this model and a corresponding graph.
Criticisms of this model.
10
9
|
8 Model 1
|
Population (millions)
7
|
Model 3
6
|
Model 2
5
|
4
|
3
|
2
|
1
|
| | | |
0 20 40 60 80 100
Time (years)
(b) Graphs showing how models compare
Remark 3.7.5. Note that as the models introduced become more realistic, the mathematics needed
to solve the corresponding differential equations is more sophisticated. In the case of modelling fluid
flow (such as water flow in the pipes or air flow around an aeroplane wing), the set of (partial) dif-
ferential equations which must be solved (known as the Navier–Stokes equations) raises difficulties
that are beyond the grasp of current mathematical knowledge. For example, it is as yet unknown
whether a solution to these equations always exists and whether (in the case that a solution exists)
it is a ‘smooth’ solution. The Clay Mathematics Institute has listed these problems as one of the
seven Millennium problems and carries prize money of US$1,000,000 for a correct solution.
In this section we consider a special class of second order equations, known as second order
linear ODEs with constant coefficients. An equation of this class has the form
d2 y dy
+a + by = f (x), (3.35)
dx2 dx
where a and b are real numbers. Such equations naturally arise in modelling wave mechanics and
prey-predator interaction. You will have seen in earlier calculus courses (and in Physics) that the
d2 x
second order equation 2 + n2 x = 0 is used to model simple harmonic motion.
dt
Definition 3.8.1. A second order linear ODE with constant coefficients is said to
be homogeneous if it is of the form
d2 y dy
2
+a + by = 0, (3.36)
dx dx
where a and b are real numbers.
It turns out that we can always solve a homogeneous second order ODE with real coefficients.
The first important observation towards proving this fact is given by the following lemma.
Lemma 3.8.2. If y1 and y2 are two solutions to the differential equation (3.36) then any linear
combination Ay1 + By2 , where A and B are real numbers, is also a solution to (3.36).
Proof. Suppose that y1 and y2 are two solutions to the differential equation (3.36). If y = Ay1 +By2 ,
Remark 3.8.3. It can also be shown that every second order ODE has at most two linearly
independent solutions (this will be demonstrated in second year linear algebra courses). Hence if
y1 and y2 are two linearly independent solutions of (3.36) then every solution y to (3.36) is of the
form y = Ay1 + By2 . In this context, y1 and y2 are linearly independent if and only if they are not
constant multiples of each other.
In view of the above lemma and remark, to find a complete solution to (3.36), one only needs
to find two linearly independent solutions. To look for a solution to (3.36), we try a function y that
does not change too much when differentiated. (The idea is that, upon substitution, the terms on
the left-hand side need to cancel each other out to give zero.) If y = eλx , where λ is a constant,
then y ′ = λeλx and y ′′ = λ2 eλx . When these are substituted into (3.36) we obtain
Definition 3.8.4. The characteristic equation of the second order linear ODE
d2 y dy
2
+a + by = 0,
dx dx
is given by
λ2 + aλ + b = 0. (3.38)
d2 y dy
−5 + 6y = 0. (3.39)
dx2 dx
c 2018 School of Mathematics and Statistics, UNSW Sydney
82 CHAPTER 3. ORDINARY DIFFERENTIAL EQUATIONS
Theorem 3.8.6. Consider the second order homogeneous ODE given by (3.36) and let λ1 and λ2
denote the roots of the corresponding characteristic equation (3.38).
(i) If λ1 and λ2 are different real numbers then the solution to (3.36) is given by
y = Aeλ1 x + Beλ2 x ,
where A, B ∈ R.
y = Aeλ1 x + Bxeλ1 x ,
where A, B ∈ R.
(a) y ′′ − 6y ′ + 25 = 0,
λ2 − 6λ + 25 = 0
has roots 3+ 4i and 3− 4i (as determined by completing the square or using the quadratic formula).
Hence the solution y to the ODE is given by
λ2 + 4λ + 4 = 0
where the constants A and B are to be determined by imposing initial conditions. Differentiation
shows that
y ′ = −2Ae−2x − 2Bxe−2x + Be−2x . (3.41)
When x = 0, (3.40), (3.41) and the initial conditions imply that A = 1 and B = 2. Hence
y = e−2x + 2xe−2x
y ′′ − 5y ′ + 6y = 12x − 4. (3.42)
Solution. Since the first and second derivatives of a polynomial are also polynomials, it seems likely
that at least one particular solution yP to the ODE is a polynomial. A little more thought shows
that if yP is polynomial that satisfies (3.42), then the degree of yP is no greater than one. So we
look for a particular solution yP of the form
yP = ax + b,
where a and b are real numbers whose values are to be determined. Now yP′ = a and yP′′ = 0, so
substituting yP into (3.42) gives
0 − 5a + 6(ax + b) = 12x − 4.
By equating coefficients we find that a = 2 and b = 1. Hence one particular solution yP to (3.39)
is given by yP = 2x + 1.
Are there any other solutions? The answer to this question is ‘yes’. To find them, we consider
the associated homogeneous ODE
y ′′ − 5y ′ + 6y = 0, (3.43)
whose solution yH is given by
yH = Ae2x + Be3x ,
where A and B are real numbers (see Example 3.8.5). Now we will show that y, where y = yH + yP ,
is a solution to (3.42):
Hence y, given by
y = yH + yP = Ae2x + Be3x + 2x − 1
where A and B are real constants, also solves the ODE. In fact, this gives the general solution (the
discussion in Subsection 3.8.4 explains why).
Bearing in mind the above example, we now detail an algorithm for solving a second order ODE
of the form (3.35).
1. Find the solution yH to the corresponding homogeneous equation (3.36) (by first identifying
the roots of the characteristic equation, as in Subsection 3.8.1).
y ′′ − 4y ′ + 5y = 0.
The roots of the characteristic equation λ2 − 4λ + 5 = 0 are 2 − i and 2 + i (these can be found
using the quadratic formula). Hence the solution yH of the homogeneous equation is given by
yP = ae−x ,
where a is a constant to be determined. Note that yP′ = −ae−x and yP′′ = ae−x . So substituting
yP into (3.44) gives
ae−x + 4ae−x + 5ae−x = 20e−x .
By comparing coefficients on each side we conclude that yP is a particular solution if and only if
a = 2. Hence our particular solution is given by yP = 2e−x .
Third, the general solution y to (3.44) is given by
y = yH + yP
= e2x (A cos x + B sin x) + 2e−x ,
y ′′ − 3y ′ + 2y = 5e2x . (3.45)
y ′′ − 3y ′ + 2y = 0.
The characteristic equation λ2 − 3λ + 2 = 0 has the solutions λ = 1 and λ = 2. Hence the solution
yH to the homogeneous equation is given by
(This guess for a particular solution is certainly not in the solution space for the homogeneous
equation.) Now we find that
This simplifies to
4ae2x − 3ae2x = 5e2x ,
y = yH + yP
= Ae2x + Bex + 5xe2x
Given a function f , the following table indicates which guess for yP will always yield a particular
solution for the nonhomogeneous ODE (3.35).
P (x)esx Q(x)esx
If any term of the guess for yP is a solution to the homogeneous ODE, then multiply it by x.
If any term of the new guess is still a solution to the homogeneous ODE, then multiply by x again.
The next example illustrates the directive given in the last two rows of the table.
Example 3.8.11. Solve the ODE
y ′′ − 6y ′ + 9y = 8e3x . (3.47)
λ2 − 6λ + 9 = 0
factorises as (λ − 3)2 = 0 and thus has the repeated root 3. So the solution yH to the corresponding
homogeneous equation is given by
yH = Ae3x + Bxe3x , (3.48)
where A and B are real numbers.
Second, we search for a particular solution yP . Our first guess yP = ae3x will not work, as it is
a solution to the corresponding homogeneous equation (to see why, simply set A as a and B as 0
in (3.48)). So we multiply by x to obtain a new guess yP = axe3x . However, this guess also solves
the homogeneous equation. So once again, multiply by x to obtain a new guess yP = ax2 e3x . It is
easy to see that yP no longer lies in the solution space to the homogeneous equation. So this guess
will work.
To determine the value of a, substitute yP = ax2 e3x into (3.47). We leave it to the reader to
verify that a = 4. Hence a particular solution yP is given by yP = 4x2 e3x .
Finally, the general solution y is the sum of yH and yP , namely
Remark 3.8.12. The previous example illustrates the importance of finding yH before making
a guess for yP ; without knowing yH it is not possible to make a suitable guess for yP . The next
example emphasises this point.
d2 y dy
+ 6 + 13y = 5e3t cos(2t). (3.49)
dt2 dt
Write down the form of a particular solution yP to this ODE. (You are not required to evaluate
the undetermined coefficients appearing in the the form of yP .)
where A, B ∈ R.
Since the right-hand side of (3.49) is a product of e3t and cos 2t, our initial guess for the
particular solution yP is given by
However, (3.50) shows that this guess solves the homogeneous equation. Instead, try
This new guess for yP does not lie in the solution space for the homogeneous equation; hence this
gives the form of particular solution that we seek.
Remark 3.8.14. One must take care in the use of the method of undetermined coefficients, and
in particular the two rules at the end of the table given above.
Consider, for example, the differential equation
y ′′ − 6y ′ + 9y = x2 e3x .
The homogeneous solution, from above, is yH = Ae3x + Bxe3x . Now since x2 e3x is not one of the
homogeneous solutions, one would try the particular solution yP = (Cx2 + Dx + E)e3x . However,
since this contains terms which are part of the homogeneous solution, we need to multiply by x
twice - thus yP = (Cx4 + Dx3 + Ex2 )e3x - so that no term in this expression is a homogeneous
1
solution. Substitution will reveal that D and E are zero, while C = 12 .
There is an easier method to solve such a problem using differential operators. This is left to
more advanced courses in differential equations.
Example 3.8.15. Suppose that a spring is mounted to a (fixed) point P and that an object of
mass m is suspended from the spring. Let x denote the (vertical) displacement from the equilibrium
position (or resting position) of the object, taking x to be positive if it lies above the equilibrium
position.
P
Object
Equilibrium position b
By using Newton’s second law of motion, Hooke’s law and making some simple assumptions, one
can show that the system satisfies the differential equation
d2 x
+ ω 2 x = 0, (3.51)
dt2
where ω is a positive constant that depends only on the mass of the object and the stiffness of the
spring.
The object is pulled downwards from its equilibrium position by a distance of 4 units and then
released from rest. Find x(t) when t ≥ 0.
Solution. We need to solve the differential equation (3.51) subject to the initial conditions x(0) =
−4 and x′ (0) = 0. The characteristic equation λ2 + ω 2 = 0 is easily solved, leading to the solution
of (3.51), where A and B are constants. Before imposing initial conditions, we calculate x′ (t). This
is given by
x′ (t) = −Aω sin ωt + Bω cos ωt.
Now x′ (0) = 0 implies that 0 = Bω, from which we conclude that B = 0 (since ω is positive).
Finally, x(0) = −4 implies that A = −4. Hence the solution is given by
This type of motion is known as simple harmonic motion and is graphed in Figure 3.2 (a).
Example 3.8.16. Consider the same scenario as Example 3.8.15, except that now the point P
vibrates up and down, such that its vertical displacement y is given by y = 2 sin Ωt. In these
circumstances, a simple physical argument shows that x obeys the differential equation
d2 x
+ ω 2 x = 2 sin Ωt. (3.52)
dt2
Describe the motion of the object, given that x(0) = −4 and x′ (0) = 0.
x(t)
4 2π
|
ω
0 | t
−4
x(t)
4 2π
|
ω
0 | t
−4
x(t)
4
|
0 | t
2π
−4 ω
(c) Resonance: ω = Ω
Solution. We have already solved the homogeneous equation in Example 3.8.15. So we look for a
particular solution xP .
Case 1: Suppose that Ω 6= ω. Then we look for a particular solution of the form
y ′′ + ay ′ + by = f, (3.53)
where a and b are real numbers and f : R → R is a function. Let V denote the vector space of all
(infinitely) differentiable functions y : R → R. We define the linear transformation T : V → V by
the formula
T (y) = y ′′ + ay ′ + by.
Observe that
′′ ′
yH is a solution to the homogeneous equation ⇐⇒ yH + ayH + byH = 0
⇐⇒ T (yH ) = 0
⇐⇒ yH ∈ ker(T ).
Hence the general solution to the homogeneous equation is the kernel of T . Also observe that
Hence the ODE (3.53) has a particular solution if and only if f is in the image of T . Moreover,
since
Therefore y − yP is in the kernel of T . But, as observed above, every function in the kernel of T is
a solution yH to the homogeneous equation. Hence y − yP = yH , where yH is some solution to the
homogeneous equation. It follows that y = yH + yP , thus completing the proof of assertion (B).
The kernel and image of T , and their connection to the homogeneous solution space and a
particular solution for the differential equation, may be represented pictorially as shown below.
T
V V
yH b
0
b
f
yP b
dsolve(deqn, y(x)); solves the ordinary differential equation (or IVP) deqn for the function
y(x). For example,
v(t) = −t2 + 6
3. [R] Oil is leaking out of a tank in such a way that the depth of oil h in the tank at time
dh √
t satisfies = − 2h. If the initial height is 4 cm, then find the time taken for the tank
dt
to empty.
6. [R] An object falling vertically experiences a resistance which is proportional to its ve-
locity.
dv
a) Explain why its acceleration is given by = g − kv, where g is the acceleration due
dt
to gravity and k is a positive constant.
b) Solve this as a linear equation for the initial condition v = 0.
(which of course ignores seasonal and other variations with time). Mathematically one of
the simplest assumptions we can make (Verhulst 1839) is that k(y) decreases linearly as y
increases. In this case (1) may be written in the form
dy y
=k 1− y, (2)
dt K
where k and K are constants.
a) i)Equation (2) has two constant (stationary) solutions. What are they?
ii)Solve (2), given that y = y0 when t = 0 and 0 < y0 < K.
iii)State what happens to y as t → ∞.
iv) For what value of y is the rate of increase of y a maximum?
(Caution — there is a simple, two line, method.)
v) If y0 > K then what happens to y as t increases?
b) [H] It has been found empirically that for certain bodies k(y) decreases linearly with
ln y. (Here y could be the volume, mass or number of cells of the body.) In this case
(1) may be written as
dy K
= α ln y. (3)
dt y
Solve this differential equation, given that y = y0 when t = 0.
12. [R] An initially unpolluted lake of 109 litres has a river flowing through it at 1, 000, 000
litres per day. A factory is built which discharges 10, 000 litres per day of pollutant into
the lake. Assume that the total volume of liquid in the lake remains constant at 109 litres.
13. [R] A tank can hold 100 litres. Initially it holds 50 litres of pure water. Brine, which
contains 2 grams of salt per litre, is run in at the rate of 3 litres per minute. The mixture,
which is stirred continuously, is run off at 1 litre per minute. Let x(t) denote the mass of
salt (in grams) present in the tank after t minutes.
14. [R] A population of size P is subject to seasonal variation. The population has a growth
rate given by
dP
+ P = 100 + 50 sin t.
dt
a) Solve the differential equation given that P (0) = 20.
b) Find the average population size over a long period of time.
16. [R] It is estimated that the population growth rate of a certain developing country will
fall linearly from 2% per year to 1.5% per year over the next decade.
17. [R] An object falling in a resisting medium has a constant acceleration due to gravity of
9.8 m/sec2 and also a drag force, which is approximately proportional to the speed (see
Question 6). For a stone falling in water with velocity v m/sec., the acceleration from this
drag force is approximately 10v m/sec2 .
a) Given that the stone is dropped from rest at the water surface, write a differential
equation describing this situation, and solve it to find v.
b) Determine the terminal velocity, lim v(t).
t→∞
c) How long does it take before the stone is travelling with 95% of its terminal velocity?
d) What if it starts at a velocity higher than the terminal velocity?
dy y
18. [R] The differential equation = λ is employed as a simple model for comparative
dx x
growth.
19. [R] An investor puts $500, 000 into Hitek Bonds, which pay a profit of 20% a year,
dP
compounded daily (i.e., if P is the amount of money in the bonds at any time, = 0.2P
dt
approximately).
under the government’s Small Business Incentive Scheme, and that at the end of each
six months, all the remaining interest should be taken out and invested in the Lake
Eyre Ricegrowers’ Cooperative,
which loses money continuously at a rate of 10% a
dP
year so that = −0.1P . This would qualify the investor for various advantages
dt
under the Rural Rorts Scheme. If the investor takes this advice, what would the total
of both his investments be after one year? [Take it that there are 52 weeks in a year.]
20. [H] There are n + 1 tanks each containing 100 litres and connected as shown.
...
Throughout, the liquid in every tank is kept well–mixed. The 0-th tank contains 100 litres
of pure water with 50 grams of salt dissolved in it. The remainder contain pure water.
Pure water is pumped into tank 0 at 3 litres per minute and liquid leaves the system from
tank n at 3 litres per minute. Let mk denote the mass (in grams) of salt in tank k.
a) Show that
dmk
= 0.03(mk−1 − mk ), k = 1, 2, . . . , n
dt
and
dm0
= −0.03m0 .
dt
b) Show that
50(0.03)n n −0.03t
mn = t e .
n!
21. [H] The decay of one atom of radioactive element A yields one atom of B which is itself
radioactive. The decay constants for A and B are 0.25 and 2 (per day) respectively. A
pure sample of K atoms of A is placed in a closed container. Let y1 (t) and y2 (t) denote
the numbers of atoms of A and B that are present at time t. Write down two differential
equations to describe this situation. Solve to obtain a formula for y2 . When is the amount
of B in the container a maximum?
22. [R] Find the general solutions of the following second order ODEs.
a) y ′′ + 3y ′ + 2y = 0 b) y ′′ + 2y ′ + 10y = 0
c) y ′ + 3y = 0 d) y ′′ + 4y ′ + 4y = 0
23. [R] Find the solutions of the following initial value problems.
a) y ′′ − 6y ′ + 5y = 0; y = 1, y ′ = 0, when x = 0.
b) y ′′ + 2y ′ + 2y = 0; y = 1, y ′ = 0, when x = 0.
25. [R] For each of the following differential equations, find the general solution of the associ-
ated homogeneous equation and write down the form of the particular solution you would
seek. (Do not evaluate the unknown coefficients.)
a) 2y ′′ − 3y ′ − 5y = (x + 4)e5x/2
b) y ′′ + 2y ′ − 24y = e4x sin 6x
c) y ′′ + 6y ′ + 9y = e−3x
26. [H] Find a particular solution for the differential equation y ′′ − 4y ′ + 4y = 6x2 e2x .
27. [R] A cylindrical buoy of 80 cm in diameter floats in water with its axis vertical. When
depressed slightly and released, it bobs up and down according to the differential equation
d2 x
m = −π402 gx,
dt2
where m is the mass (in grams) of the buoy and x is the displacement (in centimetres)
from the equilibrium position. Take the acceleration g due to gravity to be 980 cm/sec2 .
The period of oscillation is observed to be 2.5 seconds. What is the mass of the buoy?
28. [R] A block of wood is attached to a spring and slides across a surface as shown.
Let x(t) denote the horizontal distance of the block from its ‘resting’ position at time t.
The motion of the block is modelled by the initial value problem
d2 x dx
2
+c + 4x = 0, x′ (0) = 0, x(0) = 1,
dt dt
where c is the ‘coefficient of friction’ between the block and the surface.
a) By solving the differential equation, describe the motion of the block in the ‘ideal’
situation when there is no friction between the block and the surface (that is, when
c = 0).
b) Solve the initial value problem when c = 2 and when c = 5 and explain why the block
oscillates if c = 2 but does not if c = 5.
c) [H] Find the smallest positive c such that the system does not oscillate.
(This value of c corresponds to what is known as ‘critical damping.’)
29. [R] A circuit consists of an inductor and capacitor connected in series with a sinusoidal
power source. The charge q (in coulombs) stored in a capacitor is given by the differential
equation
d2 q
+ 10 000q = 1000 sin Ωt,
dt2
where Ω/(2π) is the frequency of the power source.
30. [R]
a) Find the general solution of the vibrating system modelled by the equation
d2 y dy
2
+3 + 2y = 20 sin t.
dt dt
b) The long term behaviour of this system is independent of the initial conditions. What
is this ‘steady state solution’ ?
31. [R] A stationary wave on a guitar string of length L can be (partially) modelled by the
boundary value problem
a) Suppose that k is positive and write k as µ2 , where µ ≥ 0. Show that the boundary
value problem has no nonzero solutions.
b) Are there any nonzero solutions when k = 0?
c) Suppose now that k is negative and write k as −µ2 , where µ > 0. Find all possible
values of µ such that the boundary value problem has a nonzero solution. Give the
corresponding solutions.
(Each such solution corresponds to a natural harmonic of the string.)
dX
= a(Y − Y0 ), a > 0; (1)
dt
and
(γ) an increase in the number of predators, from X0 , results in a decrease in the number
of prey at a rate (approximately) proportional to the increase in predators, so that
dY
= −b(X − X0 ), b > 0. (2)
dt
[In fact the ‘linearisation’ of a number of complicated models near an equilibrium state
leads to (1) and (2).]
If x = X − X0 and y = Y − Y0 then we obtain
dx
= ay, (3)
dt
and
dy
= −bx. (4)
dt
a) Eliminate dt between (3) and (4) and solve to obtain a relation between x and y (the
‘phase trajectories’ of the system).
b) Eliminate x by differentiating (4) and substituting from (3). Hence solve for y and
then use (4) again to obtain x.
c) Suppose that a = 0.8 and b = 3.2. If x = −1.2 and y = 3.2 when t = 0, then find x
and y in terms of t and also find the phase trajectory.
33. [HH] (Note: do not attempt this question until Chapter 7 of MA1231 Algebra has been
completed.)
Let V denote the vector space of twice differentiable functions on R. Define a linear map
L on V by the formula
d2 u du
Lu = a 2
+b + cu, where a, b and c are real numbers.
dx dx
Suppose that u1 , u2 is a basis for the solution space of L(u) = 0. Find a basis for the
solution space of the fourth order equation L(L(u)) = 0. What can you say about the
kernels of L and L2 ?
Chapter 4
Taylor series
Polynomials are nice functions to work with. Their values can be easily evaluated using a finite
number of additions and multiplications. They are easy to differentiate and integrate; moreover
their derivatives and antiderivatives are also polynomials and thus have these properties. Some
(but not all) of these properties are shared by a few other classes of functions. For example,
the derivatives of exponential functions are exponentials, but in general exponentials cannot be
evaluated using a finite number additions and multiplications. Many other useful functions share
none of these properties.
If a function can be accurately approximated by a polynomial, then we can use the polynomial
to approximate the values, derivatives and antiderivative of the function. This generalises an idea
met in MA1131, where we saw that a differentiable function can be locally approximated by a
linear function (which is a degree 1 polynomial). In this chapter we will see that many n-times
differentiable functions can be locally approximated by a polynomial of degree n. We will devote
considerable time discussing how accurate such approximations are. Finally, we shall prove that
some functions can not only be approximated by polynomials but are also equal to series consisting
of infinitely many polynomial terms. Such series are known as Taylor series.
The ideas presented in this chapter have a long history, going back to Archimedes’ method
of exhaustion, which he used to approximate π. Beginning in the fourteenth century, a school of
Indian mathematicians based in Kerala found accurate polynomial approximations to trigonometric
functions. This allowed them to solve problems in astronomy. In the seventeenth century, the
Scottish astronomer James Gregory independently employed similar techniques. However, it was
not until 1715 that the English mathemtician Brook Taylor published a theorem which gave a
general method for polynomial approximation, and which described precisely the errors involved. In
the twenty-first century, computers and calculators regularly use algorithms to find the approximate
value of functions; many of these modern computation techniques trace their roots back to Taylor’s
method.
Recall from MA1131 that the function f : R → R, given by f (x) = ex , is defined as the inverse
of the function ln : (0, ∞) → R, and that ln is defined in terms of an integral. How, then, does one
evaluate e0.1 ? (If the answer given is ‘use a calculator,’ then we merely ask the question, How does
a calculator evaluate e0.1 ?)
One approach is to suppose that y = e0.1 . Then we need to solve the equation ln y = 0.1. By
the definition of ln, this boils down to solving the integral equation
Z y
dt
= 0.1.
1 t
From here we could guess an approximate value for y and use Riemann sums to check whether our
guess is reasonable. Clearly this is an unsatisfactory approach to the problem.
Another method is to locally approximate the function f with a linear function. This technique
was discussed in MA1131 (see Chapter 4 of the MA1131 calculus notes) and is based on the idea
that the tangent lies close to the graph of f near the point of contact. Suppose, once again, that
f (x) = ex . To find an approximate value for e0.1 , we will approximate f using the tangent to the
graph of f at 0. The tangent function p1 at 0 is a polynomial of degree 1 and is given by
p1 (x) = 1 + x.
So when x is close to 0,
ex ≈ 1 + x
and hence e0.1 ≈ 1.1.
The polynomial p1 has the property that its value at 0 and gradient at 0 agree with the value
and gradient of f at 0. That is,
If we want to improve our approximation, we could generalise this idea and look for a degree two
polynomial p2 such that the value, gradient and concavity of f and p2 agree at 0. That is, if
p2 (x) = b0 + b1 x + b2 x2 ,
b0 = 1, b1 = 1 and 2b2 = 1.
Hence
x2
p2 (x) = 1 + x +
.
2
One can see in Figure 4.1 that p2 gives a better approximation to f near 0 than does p1 . Using p2 ,
we obtain the approximation
p3 (x) = c0 + c1 x + c2 x2 + c3 x3
y = p1 (x)
y = p2 (x)
y = ex
0 x
y = p3 (x)
y = p1 (x)
Figure 4.1: Polynomial approximations (in gray) for the exponential function (in black) about 0.
p3 (0) = f (0), p′3 (0) = f ′ (0), p′′3 (0) = f ′ (0) and p′′′ ′′′
3 (0) = f (0).
The table below compares the approximations to e0.1 given by these first, second and third
degree polynomials.
In fact, e0.1 (rounded to five decimal places) is equal to 1.10517 and so the approximation p3 (0.1) is
accurate to four decimal places. Each of the polynomials p1 , p2 and p3 are called Taylor polynomials
for f about 0.
Using the same technique, one can attempt to approximate any function f at 0 with an n degree
polynomial pn , provided that f is n-times differentiable at 0. Suppose that
pn (x) = a0 + a1 x + a2 x2 + a3 x3 + · · · + an xn .
We require that
pn (0) = f (0), p′n (0) = f ′ (0), p′′n (0) = f ′′ (0), p(3)
n (0) = f
(3)
(0), ..., p(n)
n (0) = f
(n)
(0),
where f (j) denotes the jth derivative of f . By calculating the derivatives of p, one finds that
a0 = f (0), a1 = f ′ (0), 2!a2 = f ′′ (0), 3!a3 = f (3) (0), ..., n!an = f (n) (0).
Hence
f ′′ (0) 2 f (3) (0) 3 f (n) (0) n
pn (x) = f (0) + f ′ (0)x + x + x + ··· + x .
2! 3! n!
Example 4.1.2. Suppose that f (x) = ex and n ≥ 0. Find the Taylor polynomial of degree n for
f about 0.
Solution. It is clear that
f ′ (x) = ex , f ′′ (x) = ex , f ′′ (x) = ex , ..., f (n) (x) = ex .
Hence f (0) = f ′ (0) = f ′′ (0) = · · · = f (n) (0) = 1 and
x2 x3 xn
pn (x) = 1 + x +
+ + ··· +
2! 3! n!
gives the Taylor polynomial of degree n about 0.
Example 4.1.3. Suppose that f (x) = sin x. Find the Taylor polynomials for f up to degree seven
about the point 0.
Solution. We have
f (x) = sin x f (0) = 0
′
f (x) = cos x f ′ (0) = 1
f ′′ (x) = − sin x f ′′ (0) = 0
f (3) (x) = − cos x f (3) (0) = −1
f (4) (x) = sin x f (4) (0) = 0
.. ..
. .
p1 (x) = x
x3
p3 (x) = x −
3!
x3 x5
p5 (x) = x − +
3! 5!
x3 x5 x7
p7 (x) = x − + −
3! 5! 7!
are the Taylor polynomials for f up to degree seven about the point 0. Their graphs are compared
to the sine function in the following diagram.
y
y = p1 (x)
y = p5 (x)
x
0
y = sin x
y = p3 (x)
y = p7 (x)
Note that the sine function is odd and that its Taylor polynomials about 0 are also odd.
The diagram in Example 4.1.3 shows that the Taylor polynomials about 0 are good approxi-
mations for f near 0. However, the approximations get worse farther away from 0. If one wants
to approximate a function f near a point a, where a is not close to 0, then one can try (i) using
Taylor polynomials about 0 of higher degree (which may or may not give satisfactory results) or
(ii) approximating f with Taylor polynomials about a. Method (ii) is particularly pertinent in the
case when f (x) = ln x; since f is not defined at 0, the Taylor polynomials for f about 0 do not
exist.
Suppose f is n-times differentiable at a. To approximate f about a, we try a degree n polynomial
pn , given by
pn (x) = a0 + a1 (x − a) + a2 (x − a)2 + · · · + an (x − a)n ,
where
pn (a) = f (a), p′n (a) = f ′ (a), p′′n (a) = f ′′ (a), ..., p(n)
n (a) = f
(n)
(a).
The nth Taylor polynomial for f about a can be expressed using summation notation as
n
X f (k) (a)
pn (x) = (x − a)k .
k!
k=0
Here 0! = 1 (by definition) and we use the convention of writing f (a) as f (0) (a).
Example 4.1.5. Suppose that f (x) = ln x. Find the Taylor polynomial of degree 5 for f about 1.
Solution. Since
f (x) = ln x f (1) = 0
1
f ′ (x) = f ′ (1) = 1
x
1
f ′′ (x) = − 2 f ′′ (1) = −1
x
(3) 2!
f (x) = 3 f (3) (1) = 2!
x
3!
f (4) (x) = − 4 f (4) (1) = −3!
x
(5) 4!
f (x) = 5 f (5) (1) = 4!,
x
we see that
−1 2! −3! 4!
p5 (x) = (x − 1) + (x − 1)2 + (x − 1)3 + (x − 1)4 + (x − 1)5
2! 3! 4! 5!
(x − 1)2 (x − 1)3 (x − 1)4 (x − 1)5
= (x − 1) − + − + .
2 3 4 5
It is preferable to express such a polynomial in powers of (x − 1) rather than in powers of x. There
is usually no need to expand each of the terms (x − 1)k .
We saw in the last section that e0.1 can be approximated using Taylor polynomials. Suppose
that a calculator (with a 10 digit display) uses Taylor polynomials to calculate the (approximate)
value of e0.1 . What degree Taylor polynomial should the calculator use so that the displayed value
is accurate to 10 digits? Importantly, is there a way of answering this question without knowing in
advance the decimal expansion of e0.1 ?
In other words, we seek a method for determining how bad the error can get when approximating
a function by one of its Taylor polynomials without knowing the precise values of the function. The
functions f and g, given in the table below, further highlight the need for such a method.
x3 x5 x7 xn
f (x) = sin x pn (x) = x − + − + ··· (n odd)
3! 5! 7! n!
x2 x3 x5 xn
g(x) = ln(1 + x) qn (x) = x − + − + ···
2 3 5 n
Suppose that we want to approximate f (7). Although 7 is not close to 0, the graph below shows
that the approximation f (7) ≈ pn (7) is reasonable if n = 19 or n = 21.
y
p17 p21
1
|
| x
7
f
-1
|
p15 p19
By plotting more graphs, one would discover that the approximation f (7) ≈ pn (7) seems to improve
as n increases. We could conjecture that as n → ∞ the error in the approximation approaches 0.
On the other hand, suppose that we want to approximate g(1.5). Although 1.5 is closer to 0
than is 7, the Taylor polynomials do not provide a good approximation to the true value of g(1.5),
as Figure 4.2 shows. The Taylor polynomials approximate g very well on the interval (−0.7, 0.7)
and are not too bad on (0.7, 1). However, to the right of 1 they should not be used to approximate
the function. Moreover, while the higher degree Taylor polynomials give better approximations
near 0, they give larger errors than lower degree polynomials to the right of 1. This surprising
observation highlights the need for establishing a rigorous basis Taylor polynomial approximation.
In particular, we must have some idea whether the error involved in each approximation is going
to be large or small.
In light of the above discussion, we want an exact expression for the difference between a
function and one of its Taylor polynomials. To obtain this expression, we use integration by parts.
Suppose that f has n + 1 continuous derivatives on an open interval I containing 0. We are
about to compute the nth Taylor polynomial of f about 0 in such a way that we keep track of the
q11
y
q17
q5
1 | g
| | | x
-1 1 1.5
-1
|
q14
q8
difference (also known as the error or remainder ) between f (x) and pn (x). Fix a number x in the
interval I and note that Z x
f ′ (t) dt = f (x) − f (0). (4.1)
0
On the other hand, we can evaluate the same integral using integration by parts. If we set
u = f ′ (t) v = −(x − t)
du dv
= f ′′ (t) =1
dt dt
then integration by parts gives
Z x h ix Z x
′ ′
f (t) dt = − f (t)(x − t) + f ′′ (t)(x − t) dt
0 0 0
Z x
′ ′′
= f (0)x + f (t)(x − t) dt. (4.2)
0
(Note that the first two terms on the right-hand side gives the Taylor polynomial of degree 1, and
that the third term on the right-hand side is the error in the approximation f (x) ≈ p1 (x).) By
applying integration by parts with
u = f ′′ (t) v = − 21 (x − t)2
du dv
= f ′′′ (t) = x − t,
dt dt
we obtain Z x
′ f ′′ (0) 1
f (x) = f (0) + f (0)x + x+ f ′′′ (t)(x − t)2 dt.
2! 2! 0
(The right-hand side is now the second Taylor polynomial of f with the associated error (also
known as remainder)). If we continue integrating by parts then we obtain after n steps
Z x
′ f ′′ (0) f (3) (0) 3 f (n) (0) n 1
f (x) = f (0) + f (0)x + x+ x + ... + x + f (n+1) (t)(x − t)n dt.
2! 3! n! n! 0
That is,
f (x) = pn (x) + Rn+1 (x)
where pn is the nth Taylor polynomial for f about 0 and
Z
1 x (n+1)
Rn+1 (x) = f (t)(x − t)n dt.
n! 0
Theorem 4.2.1 (Taylor’s theorem). Suppose that f has n + 1 continuous derivatives on an open
interval I containing a. Then for each x in I,
Taylor’s theorem tells us that the error in the approximation f (x) ≈ pn (x) is exactly equal
to Rn+1 (x). However, the remainder Rn+1 (x), as given in the integral form (4.3), is usually very
difficult to compute. A more convenient form is known as the Lagrange formula for the remainder.
Corollary 4.2.2 (Lagrange formula for the remainder). Suppose that f has n + 1 continuous
derivatives on an open interval I containing a. Then for each x in I,
f (n+1) (c)
Rn+1 (x) = (x − a)n+1 (4.4)
(n + 1)!
Remark 4.2.3. Taylor’s theorem with the Lagrange formula for the remainder is a generalisation
of the mean value theorem. To see this, suppose that f is once differentiable. Then
f (x) − f (a)
= f ′ (c)
x−a
for some c between x and a.
In most examples, it is difficult to find the exact value of the number c that appears in the
Lagrange formula for the remainder. Instead, one uses the fact that c lies between x and a to find
an upper bound for the remainder term. That is while we may not know what c is, we do know
where c is.
Example 4.2.4. Suppose that f (x) = cos x. By considering the second Taylor polynomial for f
about 0, estimate f (1/5) and find an upper bound for the error.
f ′′ (0) 2
p2 (x) = f (0) + f ′ (0)x + x
2!
cos(0) 2
= cos(0) − sin(0)x − x
2!
x2
=1− .
2!
1
|error| < .
3750
In summary, cos( 51 ) ≈ 49
50 and the absolute error in this estimate is less than 1
3750 (that is, less than
0.0002667).
Example 4.2.5. A calculator with a 10 digit display uses a Taylor polynomial about 0 to estimate
e0.1 . What degree polynomial should be used to guarantee that e0.1 is displayed accurately?
where
x2 x3 xn
pn (x) = 1 + x + + + ... +
2! 3! n!
c 2018 School of Mathematics and Statistics, UNSW Sydney
114 CHAPTER 4. TAYLOR SERIES
and
ec
Rn+1 (x) = xn+1
(n + 1)!
for some c between 0 and x. Since the calculator will display the first ten digits of pn (0.1), it suffices
if the error in the approximation e0.1 ≈ pn (0.1) is less than 10−10 . That is, we need to find n large
enough so that
|Rn+1 (0.1)| < 10−10 . (4.5)
Now
ec
|Rn+1 (0.1)| = (0.1)n+1 (for some c in [0, 0.1])
(n + 1)!
e0.1
≤ (0.1)n+1 (since exp is an increasing function)
(n + 1)!
2
< (0.1)n+1 (since e0.1 < 30.1 < 31/2 < 2)
(n + 1)!
2
= 10−(n+1) (since 0.1 = 10−1 ).
(n + 1)!
2
Now (n+1)! < 1 whenever n ≥ 1, so we obtain the (very crude) estimate
provided that n ≥ 1. Thus if n = 9 then (4.5) is satisfied. That is, if the calculator displays the
first 10 digits appearing in the decimal expansion of p9 (0.1), then the number appearing on the
display will be accurate.
However, we can do better than this. By trial and error we find that the first (positive) integer
n such that
2
10−(n+1) < 10−10
(n + 1)!
is 6. That is, the calculator should display the first 10 digits appearing in the decimal expansion
of p6 (0.1).
(Note that we did not use the decimal expansion of e0.1 to estimate the error.)
We will make the additional assumptions that f (k) (x) exists for all x sufficiently close to a and that
f (k) is continuous at a. (A proof of the general case is more complicated and will be omitted.)
Taylor’s theorem (with Lagrange’s remainder) implies that
You are given that 3 is a stationary point of f . Classify this stationary point.
By applying Corollary 4.2.6 (with k equal to 4), we conclude that 3 is a local maximum point for
f.
Since
2
lim = 0,
n→∞ 10n+1 (n + 1)!
it is seems reasonable to surmise that |Rn+1 (0.1)| (and hence Rn+1 (0.1)) approaches 0 as n → ∞.
By letting n approach infinity in (4.7), this suggests that
Does the sum converge to a real number or (since we are adding infinitely many positive
numbers) does the sum diverge to infinity? If the sum does converge to a real number
then is that number e0.1 ? More generally, given an infinite sum (also called a series)
a1 + a2 + a3 + · · · , how can we determine whether the series converges to a real number
or else diverges?
• Each of these questions may be framed in a much larger context. Given a function f which
is infinitely differentiable at a, Taylor’s theorem gives
For what values of x will lim Rn+1 (x) = 0? For what values of x will the infinite series
n→∞
converge to a finite number? If the series does converge for some x, is it always true that
The example of ln(x + 1) given at the beginning of this section suggests that we cannot always
answer ‘yes’ to each of these questions. To appreciate a comprehensive answer to the questions
posed, we must spend some time studying the limiting behaviour of sequences and series. We do
so in the next three sections.
4.3 Sequences
(Ref: SH10 §11.6–11.4)
A sequence is a real-valued function defined on (a subset of) the natural numbers. For example,
the function f : N → R, given by f (n) = n2 , is a sequence. Sequences are usually denoted using a
and b, rather than f and g. In the case of sequences, subscript notation is traditionally preferred
over function notation. Thus
a(n) = n2 ∀n ∈ N
and
an = n2 whenever n = 0, 1, 2, 3, . . .
describe the same sequence, but the second notation is used more frequently. Another way of
describing the same sequence is
or more precisely,
{an }∞ 2 ∞
n=0 = {n }n=0 .
In each case, the number an is called the nth term of the sequence.
Example 4.3.3. Suppose that f is m + 1 times differentiable at a. Then for each x in R, the
remainder term Rn+1 (x) from Taylor’s theorem gives rise to the (finite) sequence {Rn+1 (x)}m
n=1 .
Since sequences are a class of functions, we can add, subtract, multiply and divide any two
sequences that share a common domain. For example,
√ √
{n2 }n∈N { n}n∈N = {n2 n}n∈N .
√ √
If the domain (in this case N) is understood, then one can simply write {n2 }{ n} = {n2 n}.
(b) the sequence {an } is not convergent, in which case we say that {an } is divergent.
Divergent sequences can be further classified according to the list below.
(i) If an → ∞ as n → ∞ (that is, an grows without bound) then we say that the sequence
{an } diverges to infinity.
(ii) If an → −∞ as n → ∞ then we say that the sequence {an } diverges to negative infinity.
(iii) If {an } has no limit as n → ∞ but remains bounded then we say that {an } boundedly
divergent.
(iv) If {an } exhibits none of the above behaviour then we say that {an } unboundedly divergent.
There are rigorous definitions for each of these cases. We will see one of them later in Remark
4.3.5.
Example 4.3.4. Describe the behaviour of each sequence {an } as n → ∞.
(a) an = n3
(b) an = sin(nπ/2)
3n2
(c) an = n2 +4n+3
(d) an = (−1)n 2n
Solution. (a) Since an → ∞ as n → ∞, the sequence {an } diverges to infinity.
(b) Since
{an }∞
n=0 = {0, 1, 0, −1, 0, 1, 0, −1, 0, . . .}
we see that {an } is bounded but does not have a limit. Hence {an } is boundedly divergent.
(c) Since
3n2 3 3
= →
n2 + 4n + 3 1 + 4/n + 3/n2 1+0+0
as n → ∞, we conclude that {an } converges to 3.
(d) Since
{an }n∈N = {1, −2, 4, −8, 16, −32, 64, −128, . . .}
we see that {an } is not bounded. Moreover, since the even terms of the sequence approach infinity
while the odd terms approach negative infinity, we conclude that the sequence {an } is unboundedly
divergent.
Remark 4.3.5. The formal definition for lim an = L is similar to that for lim f (x) = L (see the
n→∞ x→∞
MA1131 calculus notes) and is given as follows.
lim an = L
n→∞
if, for every positive number ǫ, there is a number M such that |an − L| < ǫ
whenever n > M .
b
b
b
b
L+ǫ
b
b b b b b b b b b b b b
L
L−ǫ
| | | | | | | | | | | | | | | | | | | | | n
10 M 20
Given any small number ǫ, there is a point M such that the distance between the an and the limit
L is less than ǫ for every n past M . In other words, for every small band about the limit L, there
is a point M such the sequence always lies in the band past M .
an lim an
(iii) lim = n→∞ , provided that lim bn 6= 0 and bn 6= 0 for any n; and
n→∞ bn lim bn n→∞
n→∞
p
Solution. We proceed in the same manner as if we were asked to calculate lim ( x2 + 4x − x).
x→∞
Now
p
an = n2 + 4n − n
√ √
( n2 + 4n − n)( n2 + 4n + n)
= √ (multiplying top and bottom by the ‘conjugate’)
( n2 + 4n + n)
n2 + 4n − n2
=√ (difference of two squares)
n2 + 4n + n
4n
=√
2
n + 4n + n
4
=p (dividing top and bottom by n).
1 + 4/n + 1
Clearly 4/n → 0 as n → ∞ and so by applying the limit rules of the above proposition we find that
an → 2 as n → ∞.
The next proposition can be used when a function is composed with a sequence.
Proposition 4.3.8. Suppose that lim an = a and that f is continuous at a. Then
n→∞
The following rule allows the use of l’Hôpital’s rule when calculating limits of sequences.
Proposition 4.3.10. Suppose that {an } is a sequence and f is a function defined on some interval
(b, ∞). If an = f (n) for all n sufficiently large and lim f (x) exists then
x→∞
Note that this proposition only works for limits which are finite. If an = f (n) and f (x) diverges
as x → ∞, one cannot say that an diverges. (Consider, for example, the case when an = 0 for all
n and f (x) = x sin(πx) for all x.)
The next example shows how Proposition 4.3.10 is applied in conjunction with l’Hôpital’s rule.
Example 4.3.11. Suppose that an = (1 + 1/n)n . Determine the limiting behaviour of an as
n → ∞.
Solution. Suppose that f (x) = (1 + 1/x)x whenever x > 0. Then an = f (n) whenever n > 0.
Hence
lim an = lim f (x).
n→∞ x→∞
The method for calculating the limit of f is standard: we first take the logarithm of f (to remove
the power) and then rearrange the resulting function so that we can apply l’Hôpital’s rule. That
is,
1 x
lim an = lim 1 +
n→∞ x→∞ x
1 x
= lim exp ln 1 + (since ln and exp are inverses)
x→∞ x
1 x
= exp lim ln 1 + (since exp is continuous everywhere)
x→∞ x
1
= exp lim x ln 1 + (by the log law)
x→∞ x
ln (1 + 1/x)
= exp lim (to prepare for l’Hôpital’s rule)
x→∞ 1/x
−1/x2
1+1/x
= exp lim (by l’Hôpital’s rule)
x→∞ −1/x2
1
= exp lim (simplifying the fraction)
x→∞ 1 + 1/x
= exp{1}
= e.
In summary, an converges to e as n → ∞.
1 n
Remark 4.3.12. The limit lim 1 + = e is a standard result and should be familiar to
n→∞ n
students.
Finally, we present a version of the pinching theorem for sequences.
Proposition 4.3.13 (The pinching theorem for sequences). Suppose that {an }, {bn } and {cn } are
sequences and that for some positive integer N the inequality
an ≤ bn ≤ cn
The following example is important because sequences involving both factorials and powers
arise frequently in applications of Taylor’s theorem.
n!
Example 4.3.14. Suppose that an = . Discuss the limiting behaviour of an as n → ∞.
nn
1 2 3 n
an = · · ···
n n n n
1 n n n
≤ · · ···
n n n n
1
=
n
1
0 ≤ an ≤ .
n
cn
lim =0
n→∞ n!
whenever c > 0.
Remark 4.3.15. It is helpful to have a good intuition of the order of growth of sequences. The
following table compares the growth of various sequences as n → ∞. The lower down on the table
the sequence appears, the faster it grows at infinity.
an growth rate as n → ∞
1 constant: does not grow
ln n grows slowly
nk , where k > 0 growth rate is faster for larger k
cn , where c > 1 growth rate is faster for larger c
n! grows rapidly
nn grows very rapidly
For example, the ordering in the table reflects the fact that
en n!
lim =0 while lim = 0.
n→∞ n! n→∞ nn
The final theorem is of great theoretical importance and will be used in later sections. We begin
with a definition.
If any of these four properties holds then the sequence is said to be monotonic.
This theorem is proved using a property that distinguishes the real numbers from the rational
numbers. Given a bounded monotonic sequence of rational numbers, it is not true, in general, that
the sequence converges to a rational number.
Example 4.3.19. Find the greatest lower bound and least upper bound for the sequence {an }∞
n=1 ,
(−1)n n
where an = . Prove your answer.
n+1
Solution. We write out the first few terms of the sequence to get a feel for what is happening:
1 2 3 4 5 6 7
− , ,− , ,− , ,− ,... .
2 3 4 5 6 7 8
It is clear that the odd terms approach −1 (from above) while the even terms approach 1 (from
below).
n
We will prove that 1 is the least upper bound. First, it is clear that |an | = n+1 < 1 for every
positive integer n. So 1 is an upper bound. Suppose now that K is also an upper bound but that
K < 1. Hence K = 1 − ǫ for some positive number ǫ, while
n
<K
n+1
n
<1−ǫ
n+1
and hence
1
1− <1−ǫ
n+1
1
n< −1
ǫ
for every positive integer n, which gives a contradiction since the set of positive integers has no
upper bound. Hence no such K exists. We conclude that 1 is the least upper bound.
Using a similar technique, one can show that −1 is the greatest lower bound for the sequence.
Note that the sequence has neither a maximum nor minimum value.
The fact that every bounded monotonic sequence of real numbers has a limit in R (see Theorem
4.3.17) follows from one of the axioms of the real number system. This axiom is called the least
upper bound axiom and may be stated as
‘Every nonempty set of real numbers that has an upper bound has a least upper
bound.’
Note that this axiom is not true for the rational number system.
To prove Theorem 4.3.17 in the case when {an }∞ n=0 is a bounded increasing sequence of real
numbers, we note that the values of the sequence forms a bounded nonempty set of real numbers.
By the least upper bound axiom, it therefore has an upper bound, which we denote by L. Using
the definition of the limit (see Remark 4.3.5), one can now show that lim an = L. The proof of
n→∞
the other cases is similar.
We now introduce some alternate terminology and new notation for least upper bound and
greatest lower bound.
(a) If {an }∞
n=0 has a least upper bound M , then M is also called the supremum
of {an }∞
n=0 and is denoted by
sup an or sup{an : n ≥ 0}.
n≥0
(b) If {an }∞
n=0 has a greatest lower bound M , then M is also called the infimum
of {an }∞
n=0 and is denoted by
inf an or inf{an : n ≥ 0}.
n≥0
At the end of Section 4.2, we asked the question What is meant by the infinite sum
In this section, we will develop a framework that gives meaning to this infinite sum by using existing
notions for convergence (and divergence) of sequences. The key is to recognise that
(0.1)k
ak = ;
k!
and
• if sn denotes the sum of the first n terms in the series (so that
Thus questions concerning the meaning of an infinite series can be reduced to studying the limiting
behaviour of {sn }∞
n=0 . (Naturally, the limiting behaviour of {sn } depends on limiting properties of
the sequence {ak }; we will pay more attention to this aspect of the theory in Section 4.5.)
Definition 4.4.1. Suppose that {ak }∞k=0 is a sequence of real numbers. For each
natural number n, let sn denote the nth partial sum given by
n
X
sn = a0 + a1 + a2 + · · · + an = ak .
k=0
If the sequence {sP ∞
n }n=0 of partial sums converges to a number L then we say that
∞
the infinite series k=0 ak converges to L and we write
X∞
ak = L.
k=0
In this case we also say that the series is summable. If the sequence {sn }∞
n=0 of
∞
X
partial sums diverges then we say that the infinite series ak diverges.
k=0
Determine the values of r for which the series (a) converges and (b) diverges.
Solution. If r 6= 1 then sn is given by the formula
1 − r n+1
sn =
1−r
(as is taught in high school). In the case when r = 1, we simply have
sn = |1 + 1 + 1{z+ · · · + 1} = n.
n times
In summary, (
1−r n+1
1−r if r 6= 1
sn =
n if r = 1.
P∞ k,
To determine the convergence (or otherwise) of the infinite series k=0 r we simply determine
the convergence of {sn }∞
n=0 . We break this up into four cases.
• If |r| > 1 then r n+1 diverges (either to infinity if r > 1 or unboundedly if r < −1). The
X∞
sequence {sn } of partial sums therefore diverges and consequently the series r k also
k=0
diverges.
also diverges.
The next example illustrates the technique of comparing a series with an integral.
∞
X 1
Example 4.4.3 (The harmonic series). Show that the harmonic series diverges.
k
k=1
Solution. This proof uses results from integration. Consider the diagram below.
y
1
y= x
1
|
1
|
(k, k1 )
b
... ...
x
1 2 3 4 5 ... k k + 1 ... n n+1
It is clear that the area of the kth rectangle is 1/k, which is also equal to the kth term of the series.
Moreover, the area under the rectangles on the interval [1, n + 1] is greater than the area under the
curve under the same interval. From these two observations it follows that
n
X 1
sn =
k
k=1
Z n+1
1
≥ dx
1 x
h in+1
= ln x
1
= ln(n + 1).
Using the technique illustrated in the previous example, one can show that
∞
X 1
• converges,
k2
k=1
∞
X 1
• √ diverges, and
k=1
k
∞
X 1
• diverges.
k ln k
k=2
All one needs to do is draw a diagram and compare the series with an appropriate improper integral.
Since a convergent infinite series is the limit of a sequence (the sequence of partial sums), many
results for sequences can be interpreted as results for series. The following proposition illustrates
this point.
∞
X ∞
X
Proposition 4.4.4. Suppose that ak and bk are two summable series. Then
k=0 k=0
∞
X ∞
X ∞
X
(i) (ak + bk ) = ak + bk ; and
k=0 k=0 k=0
∞
X ∞
X
(ii) (αak ) = α ak for every real number α.
k=0 k=0
P P∞
Proof. Let sn and tn denote the partial sums of ∞ k=0 ak and k=0 bk respectively. Now apply
Proposition 4.3.6 (i) and (iv) to the sequences {sn } and {tn }.
Remark 4.4.5. While all the terms of a convergent series contribute to the value of the series, the
convergence (or otherwise) of any series only depends on the ‘tail’ of the series. That is, the first
hundred, thousand or even billion terms of the series are irrelevant to the question of whether the
series converges. More precisely, given any positive integer N ,
∞
X ∞
X
ak converges if and only if ak converges.
k=0 k=N
With this in mind, all of the theorems presented in the next section are just as true for series
of the form
∞
X ∞
X ∞
X
ak , ak or ak
k=1 k=50 k=2000
∞
X
as they are for series of the form ak . When the starting point for the series does not matter,
k=0
one sometimes simply writes
∞
X X
ak or ak .
k2 + 2k
Solution. If ak = √ then
k4 + 2
k2 + 2k
lim ak = lim √
k→∞ k→∞ k 4 + 2
1 + 2/k
= lim p (by dividing top and bottom by k2 )
k→∞ 1 + 2/k4
= 1.
Remark 4.5.5. The kth term test is not a test for convergence. For example, consider the series
P ∞ 1
k=1 k . In this case, lim 1/k = 0 but the series diverges (see Example 4.4.3).
k→∞
The kth term divergence test is equivalent to the following theorem, whose proof we give below.
∞
X
Theorem 4.5.6. If the series ak converges then ak → 0 as k → ∞.
k=0
∞
X
Proof. [H] Suppose that ak converges to the real number L and let sn denote the nth partial
k=0
sum of the series. Then
∞
k X
Since the improper integral diverges, so does the series 2
.
2k + 1
Z ∞ k=1
1
(c) Consider the improper integral, dx.
2 x(log x)2
1 N
Z ∞ Z N
1 1 1
dx = lim dx = lim − = .
2 x(log x)2 N →∞ 2 x(log x)2 N →∞ log x 2 log 2
∞
X 1
Since the improper integral converges, so does the series .
k(log k)2
k=1
The comparison test is often used in conjunction with series of the following type.
Proof. This theorem may be easily proved by the integral test, or by adapting the proof in Example
4.4.3. The details are left to the reader.
Typically, one needs some intuition as to whether the series will converge or diverge before the
comparsion test is used to construct a rigorous solution.
Solution. (a) By considering the dominant term (as k → ∞), we see that
k k 1
≈ 3 = 2
k3 + 1 k k
P 1
whenever k is a large positive integer. Since k 2 converges (p-series when p = 2), this suggests
∞
X k
that 3
also converges.
k +1
k=1
∞
X k
To prove that converges, we use part (i) of the comparison test. Note that
k3 + 1
k=1
k k 1
0≤ ≤ 3 = 2
k3 +1 k k
whenever
P k ≥ 1. So suppose that ak = k3k+1 and bk = k12 .PWe have shown that 0 ≤ ak ≤ bk . Since
bk converges, it follows from the comparison test that ak converges.
∞ ∞ ∞
X 1 X 1 X 1
(b) Looking at the dominant terms, √ ≈ √ = .
2
k − 1 k=2 k 2 k
k=2 k=2
∞
X 1
Since this series diverges (p-series when p = 1), this suggests that √ also diverges.
2
k −1
k=2
∞
X 1
To prove that √ diverges, we use part (ii) of the comparison test.
k 2−1
k=2
1 1 1
Note that √ ≥ √ = , whenever k ≥ 2. So suppose that ak = √k12 −1 and bk = k1 . We
2
k −1 k 2 k
have shown
P that a k ≥ b k . P
Since bk diverges, it follows from the comparison test that ak diverges.
(c) The same analysis as in (b) suggests that this series also diverges. However, the inequality
1 1 1
√ ≥ √ = is false. To overcome this hurdle, we introduce a ‘fudge factor’ to obtain the
2
k +1 k 2 k
1 1 1
inequality we want. Thus, √ ≥ √ = for all sufficiently large k (in fact k ≥ 1 will do-
k2 + 1 2 k2 2k
you should check this!). So suppose that ak = √k12 +1 and bk = 2k 1
. We have shown that ak ≥ bk .
P P
Since bk diverges, it follows from the comparison test that ak diverges.
∞
X 1
Example 4.5.14. Discuss the convergence of sin( )
k
k=1
Proof. Since sin x ≈ x for small x, we try comparing ak = sin( k1 ), (whose terms are positive), with
bk = k1 .
∞
an sin( k1 ) X 1
Now lim = 1 = 1. Hence, since diverges (by p-series with p = 1), so does
n→∞ bn k
k k=1
∞
X 1
sin( ).
k
k=1
X 1
Remark 4.5.15. The series diverges, since, for n ≥ 1, we have log n < n giving log1 n > n1
log n
and so the comparison test may be applied. On other hand, is we try to use the limit comparison
an n
test with an = log1 n and bn = n1 , then lim = lim → ∞ and so the test fails.
n→∞ bn n→∞ log n
Remark 4.5.17. The ratio test does not specify what happens if r = 1. In this case, the test is
inconclusive; the series may converge or diverge.
P
The reason the ratio test works is that the tail of any series ak with ‘ratio’ r given by
ak+1
r = lim
k→∞ ak
behaves likeP
a geometric series with common ratio r. When r < 1, the geometric series is convergent
and henceP ak also converges. Similarly, When r > 1, the geometric series is divergent and
therefore ak also diverges. Of course, these assertions need to be proved.
Before we see a proof of the ratio test, we shall see how it is applied. As seen in the examples
below, the ratio test is particularly useful when k! or kth powers appear in each term ak .
1
Solution. (a) Suppose that ak = . Then
k!
ak+1 k! 1
r = lim = lim = lim = 0.
k→∞ ak k→∞ (k + 1)! k→∞ k + 1
(see Example 4.3.11 for a calculation of this well known limit). Since r = e > 1, the series diverges
by the ratio test.
k
(c) Since r = lim = 1, we cannot say from the ratio test whether or not the series
k→∞ k + 1
converges. It can be shown using another method that the series diverges (see Example 4.4.3).
ak+1
<R whenever k ≥ N. (4.9)
ak
P
Our goal from here is to show that the tail ∞k=N ak of the series can be bounded above by a
convergent geometric series with common ratio R. From (4.9) we see that
Hence
∞
X ∞
X
ak = aN +j
k=N j=0
X∞
< R j aN (by inequality (4.10))
j=0
∞
X
= aN Rj (which is a geometric series)
j=0
aN
= (since R < 1).
1−R
X
Since the tail of the series ak converges, the series itself must converge.
(ii) If r > 1, then
ak+1
lim >1
k→∞ ak
and so
ak + 1
>1
ak
for all k sufficiently large. That is, ak+1 > ak for all k sufficiently large, which means that the
positive sequence {ak } eventually becomes an increasing sequence. Hence ak 6→ 0 as k → ∞. It
follows from the kth term test that the series is divergent.
Definition 4.5.19. If {ak }∞ k=0 is a sequence of positive real numbers, then the series
a0 − a1 + a2 − a3 + a4 − a5 + a6 − a7 + a8 − a9 + · · ·
is called an alternating series.
The following theorem, proved by Leibniz in the early eighteenth century, is a simple test for
the convergence of alternating series.
Theorem 4.5.20 (Alternating series test). Suppose that {ak }∞
k=0 is a sequence of real numbers
satisfying the following properties:
(a) ak ≥ 0;
(b) ak ≥ ak+1 for all k (that is, the sequence is nonincreasing); and
(c) lim ak = 0.
k→∞
∞
X
Then the alternating series (−1)k ak converges.
k=0
Before proving the theorem, we give and example and state a corollary.
∞
X (−1)k k
Example 4.5.21. Determine whether the series is summable.
k2 + 1
k=2
Solution. Since this is an alternating series, one naturally tries the alternating series test. Suppose
k
that ak = 2 . We need to check that {ak } satisfies hypotheses (a), (b) and (c) of the alternating
k +1
series test.
It is clear that (a) and (c) hold. To prove (b), consider the function f given by
x
f (x) = .
x2 +1
Now
1 − x2
f ′ (x) =
(1 + x2 )2
and hence f ′ (x) < 0 whenever x > 1. That is, f is decreasing on the interval (1, ∞). Since
f (k) = ak whenever k ≥ 2, it follows that {ak }∞
k=2 is a decreasing sequence.
We now apply the alternating series test and deduce that the series converges.
If the hypotheses of the alternating sequence test are satisfied, then not only do we know that
the series converges to some limit L, but we can also approximate L with any partial sum sn and
obtain an upper bound for the corresponding error.
Corollary 4.5.22. Suppose that {ak }∞ k=0 is a sequence of numbers satisfying properties
P (a), (b)
and (c) of the alternating series test. Denote the value of the convergent series ∞ k=0 (−1)k a by
k
L and the nth partial sum of the same series by sn . Then
In effect, the corollary says that if you chop the series off after the nth term, the error in
approximation will be less than the (n + 1)st term. The proof is given at the end of this subsection.
∞
X (−1)k 1
Example 4.5.23. Estimate the value of the series such that the error is less than 100 .
k2 + 1
k=0
Solution. It is easy to verify that the sequence {ak }, where ak = k21+1 , satisfies the hypotheses of
the alternating series test. Hence the infinite series converges. Denote the value of the series by L.
1
We will use the estimate sn ≈ L, where n is chosen such that the absolute error is less than 100 .
Now
9
X (−1)k 1 1 1 1
L ≈ s9 = 2
=1− + − + ··· −
k +1 5 10 17 82
k=0
1
and the error in this approximation is less than 100 . (Using Maple, one finds that s9 = 0.6305785114
(correct to 10 decimal places) and so L ≈ 0.63.)
We conclude this subsection by proving the alternating series test and its corollary. The follow-
ing diagram illustrates the typical behaviour of the partial sums of a series that satisfies hypotheses
(a), (b) and (c) of the alternating series test. It will be helpful to bear this diagram in mind when
reading the proofs.
sn
· even partial sums
· ·
limit
· · · ·
b b
b
b
b
Proof of Theorem 4.5.20. [X] Let sn denote the nth partial sum of the series and suppose that
properties (a), (b) and (c) hold. The proof proceeds in three steps.
Step 1. We will prove that the sequence {s2n }∞ n=0 of even partial sums is bounded above by 0.
Now
s2n = (a0 − a1 ) + (a2 − a3 ) + (a4 − a5 ) + · · · + (a2n−2 − a2n−1 ) + a2n . (4.12)
and by property (a) it is evident that a2n ≥ 0. It follows from (4.12) that s2n ≥ 0 for every n.
since a2n+1 ≥ a2n+2 by property (b). Thus s2n ≥ s2n+2 for all n, which means that {s2n }∞ n=0 is
nonincreasing.
Step 3. From Steps 1 and 2, we conclude that {s2n }∞n=0 is a bounded monotonic sequence and
hence convergent. Call the limit of this sequence L. If we can show that the sequence {s2n+1 }∞
n=0
of odd partial sums also converges to L, then we can conclude that {sn } converges. Now
Proof of Corollary 4.5.22. [X] Suppose that {ak } satisfies the hypotheses (a), (b) and (c) of the
alternating series test. Since the infinite series converges, lim sn = L for some real number L. If
n→∞
n is odd then
sn+2 = sn + an+1 − an+2 ≥ sn ,
and so the odd partial sums increase towards L from below. If n is even then
and so the even partial sums decrease towards L from above. Hence if n is odd then
sn ≤ L ≤ sn+1 = sn + an+1 ,
∞
X
Definition 4.5.24. A series ak is said to be absolutely convergent if the series
k=0
∞
X
|ak |
k=0
is convergent.
−|ak | ≤ ak ≤ |ak |
and hence
0 ≤ ak + |ak | ≤ 2|ak |. (4.14)
P P P
Since |ak | converges, it follows that 2 |a Pk | converges and hence 2|ak | converges. By the
comparison test, we deduce from (4.14) that (ak + |ak |) converges. Now
Example 4.5.26. Determine whether or not the series given by (4.13) is convergent.
Solution. Let ak denote the kth term of the series. By Theorem 4.5.25, it is enough to show that
the series converges absolutely. Now
∞ ∞
X X 1
|ak | =
k!
k=1 k=1
and this series converges by the ratio test (see Example 4.5.18 (a)).
Not every convergent series is absolutely convergent. For example, the alternating series
1 1 1 1 1
1− + − + − + ··· (4.15)
2 3 4 5 6
converges (by the alternating series test) but the corresponding absolute series
1 1 1 1 1
1+ + + + + + ···
2 3 4 5 6
diverges (see Example 4.4.3). In this situation, we say that the series (4.15) is conditionally con-
vergent.
∞
X
Definition 4.5.27. A series ak is said to be conditionally convergent if it con-
k=0
verges but the series
∞
X
|ak |
k=0
diverges.
The distinction between conditionally and absolutely convergent series is brought into bold
relief when considering rearrangements of series.
P
Definition 4.5.28. A rearrangement of a series ak is a series that has exactly
the same terms but that is summed in a different order.
For example,
1 1 1 1 1 1 1
1+ + − + + − + + ···
3 5 2 7 9 4 11
and
1 1 1 1 1 1 1
− + 1 − + − + − + − ···
2 4 3 6 5 8 7
are both rearrangements of
1 1 1 1 1 1 1
1− + − + − + − + ··· .
2 3 4 5 6 7 8
If the series is finite, then every rearrangement has the same value (since addition of real numbers is
commutative). However, if the series is infinite, then the value (if it exists) of each rearrangement
is determined by a limit of partial sums, and one cannot appeal to commutativity of addition,
as in the finite case. In fact, some rather surprising phenomena occur with rearrangements of
conditionally convergent series.
∞
X
Theorem 4.5.29. Suppose that ak is an infinite series.
k=0
P
(i) If ak converges absolutely, then every rearrangement
P of the series converges absolutely
and all rearrangements have the same limit as ak .
P
(ii) If ak converges conditionally, then given any real number L, the series has a rear-
rangement that converges to L. Moreover, every conditionally convergent series has a
rearrangement that diverges to ∞, and another rearrangement that diverges to −∞.
This theorem was published in 1867 by Riemann. One of the tutorial problems illustrates that
the conditionally convergent series
1 1 1 1 1 1
1 − + − + − + − ···
2 3 4 5 6 7
can be rearranged to sum to different real numbers. The moral of the story is that one should not
rearrange a conditionally convergent series to determine its value.
At the end of Section 4.2 we posed the question, When is it true that
f ′′ (a) f (3) (a)
f (x) = f (a) + f ′ (a)(x − a) + (x − a)2 + (x − a)3 + · · ·?
2! 3!
Having studied sequences and series of real numbers, we now have the tools to deal with this and
related questions. First, we give the above series expansion a special name.
Definition 4.6.1. Suppose that a function f has derivatives of all orders at a. Then
the series
f ′′ (a) f (3) (a)
f (a) + f ′ (a)(x − a) + (x − a)2 + (x − a)3 + · · · ,
2! 3!
which may also be written as
∞
X f (k) (a)
(x − a)k ,
k!
k=0
is called the Taylor series for f about a. In the case when a = 0, the series is also
called the Maclaurin series for f .
Next, we need to define what we mean by the convergence (or divergence) of a Taylor series.
Definition 4.6.2. Suppose that I is an interval and that f has derivatives of all
orders at some point a. We say that
(b) the Taylor series for f about a converges to f on I if for each x in I, x lies
in the domain of f and
∞
X f (k)(a)
f (x) = (x − a)k ;
k!
k=0
and
Thus the question asked at the beginning of this section may be rephrased as,
Corollary 4.6.3. Suppose that f has derivatives of all orders at a and that x lies in the domain
of f . Let Rn+1 (x) denote the remainder term of Theorem 4.2.1 (or its equivalent form as given in
Corollary 4.2.2). If
lim Rn+1 (x) = 0 (4.16)
n→∞
then
∞
X f (n) (a)
f (x) = (x − a)n .
n=0
n!
Proof. Let pn denote the nth Taylor polynomial for f about a. Taylor’s theorem implies that
Now
as n → ∞ by (4.16). That is, the distance between pn (x) and f (x) can be made as small as we
like. Hence (4.18) follows.
x2 x3 x4
ex = 1 + x + + + + ··· .
2! 3! 4!
n
Solution. Suppose that f (t) = et and fix x in R. The sum of the terms up to (and including) xn!
is equal to pn (x), where pn is the nth Taylor polynomial for f about 0. So by Corollary 4.6.3, we
only need to show that lim Rn+1 (x) = 0. Now
n→∞
f (n) (t) = et ∀t ∈ R,
0 ≤ |Rn+1 (x)|
ec
= |x|n+1
(n + 1)!
M |x|n+1
≤
(n + 1)!
→0
We have just proved that the Taylor series about 0 for the exponential function converges to the
exponential function on R. We say that the exponential function is represented by its Taylor series
about 0 on R. Some other convergent Taylor series representations are given in the next theorem.
Theorem 4.6.5. The following formulae hold whenever x lies in the given interval.
1
= 1 + x + x2 + x3 + x4 + . . . x ∈ (−1, 1)
1−x
x2 x3 x4
ex = 1 + x + + + + ··· x∈R
2! 3! 4!
x3 x5 x7
sin x = x − + − + ··· x∈R
3! 5! 7!
x2 x4 x6
cos x = 1 − + − + ··· x∈R
2! 4! 6!
x3 x5 x7
sinh x = x + + + + ··· x∈R
3! 5! 7!
x2 x4 x6
cosh x = 1 + + + + ··· x∈R
2! 4! 6!
x2 x3 x4
ln(1 + x) = x − + − + ··· x ∈ (−1, 1]
2 3 4
x3 x5 x7
tan−1 x = x − + − + ··· x ∈ [−1, 1]
3 5 7
Moreover, if x lies outside the given interval then the corresponding Maclaurin series diverges.
Most of these formulae can be proved by showing that the Lagrange formula for the remainder
tends to 0 as n → ∞. However, sometimes one must resort to using the integral form of the
remainder (as given by Theorem 4.2.1). One of the tutorial problems illustrates its use. In Section
4.8, we introduce tools that provide an alternate approach to deriving some of these expansions.
Remark 4.6.6. The Taylor series expansions for sin x and ln(1+x) given by Theorem 4.6.5 explain
the phenomena discussed at the beginning of Section 4.2. In particular, the Taylor series for sin x
converges for all x in R, which explains why sin(7) could be approximated by Taylor polynomials
of sufficiently high degree. On the other hand, we cannot use Taylor polynomials to approximate
ln(1 + x) when x > 1 (as suggested by Figure 4.2) because the Taylor series diverges when x > 1.
This explains why higher order Taylor polynomials give worse approximations for ln(1 + x) when
x > 1.
Remark 4.6.7. The Maclaurin series given by Theorem 4.6.5 can be used to obtain beautiful series
expansions for some irrational numbers. By substituting particular values for x into an appropriate
Maclaurin series, one finds that
1 1 1 1
e=1+ + + + + ···
1! 2! 3! 4!
1 1 1 1
ln 2 = 1 − + − + − · · ·
2 3 4 5
π 1 1 1
= 1 − + − + ··· .
4 3 5 7
Unfortunately, the last two series converge too slowly to be of high computational value.
Remark 4.6.8. If f equals its Taylor series on an interval I, then the corresponding Taylor
polynomial pn can be used to approximate f on I. However, it is important to appreciate that
some Taylor series (such as that for ex ) converge much more quickly to the function than do others
(such as that for ln(1 + x), which converges slowly). If the series converges very slowly then the
approximation f ≈ pn is only accurate when n is very large.
a0 + a1 x + a2 x2 + a3 x3 + a4 x4 + a5 x5 + · · · , (4.19)
Thus a Maclaurin series is a power series in powers of x, while a Taylor series about a is a power
series in powers of x − a. For the last two sections of this chapter, we discuss the convergence,
addition, multiplication, integration and differentiation of power series. Hence whatever is said
about power series also applies to Maclaurin and Taylor series.
In this section, we focus on the convergence and divergence of power series.
Using the ratio test, one can often determine for what values of x a power series converges
absolutely.
∞
X kxk
Example 4.7.3. Find an interval I such that the power series converges on I.
3k
k=0
Solution. We first find an interval I on which the series converges absolutely. To do so, we apply
the ratio test to the (absolute) series
∞
X kxk
.
3k
k=0
Now
(k + 1)xk+1 3k
r = lim .
k→∞ 3k+1 kxk
(k + 1)|x|
= lim
k→∞ 3k
|x|
= .
3
To conclude from the ratio test that the series converges, we require that r < 1, which means
∞
X kxk
that |x| < 3. So the series converges absolutely whenever −3 < x < 3. Hence the series
3k
k=0
converges on the interval (−3, 3).
Remark 4.7.4. In the previous example, one can also conclude that the series diverges when
|x| > 3. To see this, fix x in R such that |x| > 3. Let bk denote the kth term
kxk
3k
bk+1 |x|
lim = .
k→∞ bk 3
|bk+1 | |bk+1 |
Since |x| > 3 we deduce that lim > 1. This shows that > 1 whenever k is sufficiently
k→∞ |bk | |bk |
large. Rearranging implies that
|bk+1 | > |bk |
for all sufficiently large k and hence the tail of the sequence
P{|bk |} is increasing. Thus |bk | 6→ 0 as
k → ∞. We conclude that bk 6→ 0 as k → ∞ and hence bk diverges by the kth term test for
divergence.
∞
X
Definition 4.7.5. If a power series of the form ak (x− a)k converges at all points
k=0
in some interval (−R + a, R + a), or equivalently, for |z − a| < R, then the number R
is called the radius of convergence for the power series. The corresponding interval
(−R + a, R + a) is called the open interval of convergence for the power series.
If the power series converges for all real x, we say that the radius of convergence is
infinite.
Notes: 1. The term ‘radius’ is used since, when x is replaced by the complex variable z, the
open interval is replaced by an open disc, |z − a| < R, in the Argand plane. The number R then
is the radius of this open disc.
2. It is easiest to find the interval of convergence first, using the ratio test, and then write down
ak
the radius of convergence. It can be shown that R = lim , provided this limit exists. There
n→∞ ak+1
are, however, power series which have a radius of convergence, but for which this limit does not
exist.
By generalising the solution to Example 4.7.3 and the argument in Remark 4.7.4, one obtains
the following theorem.
Theorem 4.7.6. Suppose that {ak }∞
k=0 is a sequence of real numbers such that
ak
lim =R
k→∞ ak+1
∞
X
for some real number R. Then the power series ak (x − a)k
k=0
Note that we cannot tell from the theorem whether or not the power series converges at the
endpoints a + R or a − R. Sometimes the power series will converge at one endpoint but not at the
other. Other times it will converge at both endpoints or diverge at both endpoints.
Example 4.7.7. Find the largest open interval on which the power series
∞
X (5x + 2)k
k2 + 1
k=0
will converge.
P∞ (5x+2)k
Solution. We apply the ratio test to the series k=0 k 2 +1 . Now
(5x + 2)k+1 k2 + 1
r = lim
k→∞ (k + 1)2 + 1 (5x + 2)k
k2 + 1
= lim |5x + 2|
k→∞ (k + 1)2 + 1
= |5x + 2|.
−1 < 5x + 2 < 1
or in other words,
3 1
− <x<− .
5 5
Example 4.7.8. Find the interval of convergence (including endpoints, if appropriate) for the
∞
X xk
power series .
ln k
k=2
xk+1 ln k
r = lim · k
k→∞ ln(k + 1) x
ln k
= lim |x|
k→∞ ln(k + 1)
1/k
= lim |x| (by l’Hôpital’s rule)
k→∞ 1/(k + 1)
k+1
= lim |x|
x→∞ k
= |x|.
The series converges absolutely whenever r = |x| < 1. Hence the largest open interval of conver-
gence is (−1, 1) and the series diverges whenever |x| > 1.
Now we determine whether the series converges at the endpoints 1 and −1. When x = 1, the
series becomes
∞
X 1
,
ln k
k=2
P1
which diverges by comparison with the harmonic series k . When x = −1, the series becomes
∞
X (−1)k
,
ln k
k=2
In this section we investigate what sense (if any) can be made of adding, multiplying, differen-
tiating and integrating power series. Since differentiation and integration are operations applied to
functions, it is most natural to approach this investigation by viewing a power series as a function.
X∞
Suppose that a power series ak xk converges in the interval (−R, R), where R is its radius
n=0
of convergence. Then one can define a function f : (−R, R) → R by the formula
∞
X
f (x) = ak x k whenever |x| < R.
k=0
Thus the value of f at each point x is a convergent sum of real numbers. Sometimes it is possible
to find a closed form for f , but other times we must approximate each value f (x) by using partial
sums.
By using, say, the ratio test, we see that the series converges whenever |x| < 1 and diverges when
|x| > 1. Hence natural domain for f is (−1, 1).
1
In fact, by summing the geometric series, we find that f (x) = whenever |x| < 1. This is
1−x
the closed form of f (x).
Example 4.8.2. Suppose that f is defined by the rule
∞
X xk
f (x) = .
k!
k=0
We instantly recognise this series as the Maclaurin series for the exponential function. Since this
series converges on R, the maximal domain of f is R. The closed form of f (x) is given by f (x) = ex
whenever x ∈ R.
Example 4.8.3. Suppose that f is defined by the rule
∞
X xk
f (x) = .
k2
k=1
By the ratio test, we find that the series converges whenever |x| < 1 and diverges whenever |x| > 1.
Therefore we take the domain of f to be (−1, 1). (Note that the power series also converges when
x = 1 and x = −1. So the domain could be extended to [−1, 1].)
There seems to be no obvious closed form for f (x) whenever |x| < 1. How, then, does one
evaluate f (− 12 )? Note that
∞
X (−1)k
f (− 21 ) =
2k k2
k=1
1 1 1 1 1
=− + − + − + ···
21 12 22 22 23 33 24 42 25 52
and that the right-hand side is an alternating series. Thus
1 1 1 1 1 1
f (− 12 ) ≈ − + − + − + ··· + ,
21 12 22 22 23 33 24 42 25 52 210 102
1
where the absolute error in this approximation is less than by Corollary 4.5.22.
211 112
It turns out that power series are very well behaved as functions defined on their interval of
convergence. Given two power series with the same interval of convergence, you can add, subtract
and multiply them together in the ‘natural’ way. Power series are also differentiable and integrable,
and their derivatives and antiderivatives can also be expressed as power series in the ‘natural’ way.
The following theorems articulate the precise details. Their proofs are given later in Subsection
4.8.1.
and
∞
X
(f g)(x) = ck (x − a)k , (4.20)
k=0
where
k
X
ck = aj bk−j .
j=0
whenever x ∈ I, where I denotes the open interval of convergence for the power series. Then
whenever x ∈ I; and
Remark 4.8.7. This theorem says that a power series can be differentiated and integrated ‘term
by term’ inside its open interval of convergence. Another way of saying this is that
∞
! ∞
d X k
X d k
ak (x − a) = ak (x − a)
dx dx
k=1 k=1
and !
Z ∞
X ∞ Z
X
k k
ak (x − a) dx = ak (x − a) dx .
k=1 k=1
Students should note that one cannot always swap infinite summation with differentiation (or with
integration). For example, if
∞
X sin(2k x)
f (x) =
2k
k=1
whenever x ∈ I, where I denotes the open interval of convergence for the power series. Then f is
continuous on I and has derivatives of all orders on I.
where I is the open interval of convergence for the power series. By the corollary, f has derivatives
of all orders at a and therefore has a Taylor series about a. One can easily show that the Taylor
series for f about a converges on I to f . Thus the Taylor series for f about a is equal to the power
series that defines f .
Theorems 4.8.4 and 4.8.6 allow us to find valid Taylor series expansions of functions without
having to derive the Taylor coefficients and verify that the remainder term from Taylor’s theorem
vanishes.
x2 x3 x4 x5 x6
ex = 1 + x + + + + + + ··· (x ∈ R) (4.21)
2! 3! 4! 5! 6!
and
1
= 1 + x + x2 + x3 + x4 + x5 + · · · (|x| < 1), (4.22)
1−x
find Taylor expansions for each function f , making sure that you state the interval of convergence.
(a) f (x) = cosh x (b) f (x) = sinh x (c) f (x) = tan−1 (x)
Solution. (a) First note that cosh x = 21 (ex + e−x ). So we aim to add the Maclaurin series for ex
and e−x . By replacing x with −x in (4.21), we find that
x2 x3 x4 x5 x6
e−x = 1 − x + − + − + − ··· (x ∈ R).
2! 3! 4! 5! 6!
So
x2 x4 x6
ex + e−x = 2 + 2 + 2 + 2 + ··· (x ∈ R)
2! 4! 6!
by Theorem 4.8.4. Hence
1 x
cosh x = (e + e−x )
2
x2 x4 x6
=1+ + + + ···
2! 4! 6!
whenever x ∈ R.
(b) By differentiating both sides of the expansion
x2 x4 x6 x8
cosh x = 1 + + + + + ··· (x ∈ R)
2! 4! 6! 8!
we find that
x3 x5 x7
sinh x = x + + + + ···
3! 5! 7!
whenever x ∈ R.
(c) If |x| < 1 then | − x2 | < 1. So we can replace x with −x2 in (4.22) to obtain the convergent
expansion
1
= 1 − x2 + x4 − x6 + x8 − x10 + · · ·
1 + x2
whenever |x| < 1. By integrating both sides this of identity, we find that
x3 x5 x7 x9 x11
tan−1 x = x − + − + − + ···
3 5 7 9 11
whenever |x| < 1.
2
The function f , given by f (x) = e−x , has no antiderivative among the elementary functions.
In MA1131, we used Riemann sums to estimate the area underneath the graph of f . As the next
example shows, the use of Taylor series provides a more efficient approach to the same problem.
2
Example 4.8.11. Suppose that f (x) = e−x . By using the Maclaurin expansion for f , estimate
Z 1
f (x) dx and give an upper bound for the absolute error.
0
x2 x3 x4 x5
ex = 1 + x + + + + + ··· ,
2! 3! 4! 5!
which is valid for all x in R. By replacing x with −x2 we find that
2 x4 x6 x8 x10
e−x = 1 − x2 + − + − + ···
2! 3! 4! 5!
for all real numbers x. By integrating both sides of this equation on the interval [0, 1], we find that
Z 1 1
−x2 x3 x5 x7 x9 x11
e dx = x − + − + − + ···
0 3 5(2!) 7(3!) 9(4!) 11(5!) 0
1 1 1 1 1
=1− + − + − + ··· .
3 5(2!) 7(3!) 9(4!) 11(5!)
P
Hence the integral is expressed as alternating series of the form (−1)k ak , where {ak } is a
positive decreasing sequence. If we estimate the series using a partial sum, then Corollary 4.5.22
gives an upper bound for the absolute error. For example, the absolute error in the approximation
Z 1
2 1 1 1
e−x dx ≈ 1 − + −
0 3 5(2!) 7(3!)
1
is no greater than 9(4!) . One can evaluate this partial sum numerically to obtain
Z 1
2
e−x dx ≈ 0.7429
0
Proof of Theorem 4.8.4. We shall only prove the product formula (4.20) when a = 0. Fix x in I
and define the partial sums sn (x) and tn (x) by
n
X n
X
k
sn (x) = ak x and tn (x) = bk xk .
k=0 k=0
Then f (x) = lim sn (x) and g(x) = lim tn (x). So using Proposition 4.3.6, we find that the
n→∞ n→∞
sequence {sn (x)tn (x)} converges and
(f.g)(x) = f (x).g(x) = lim sn (x) × lim tn (x) = lim sn (x)tn (x) .
n→∞ n→∞ n→∞
But
sn (x)tn (x) = a0 + a1 x + a2 x2 + · · · an xn × b0 + a1 x + b2 x2 + · · · + bn xn
= a0 b0 + (a0 b1 + a1 b0 )x + (a0 b2 + a1 b1 + a2 b0 )x2
+ · · · + (a0 bn + a1 bn−1 + · · · + an−1 b1 + an b0 )xn .
We move now to the proof of Theorem 4.8.6, which shall be broken into two parts. First we
prove the differentiation result, which is difficult and uses the mean value theorem. After this, the
integration result can be easily deduced from the first part.
∞
X
f (x) = ak xk
k=0
whenever x ∈ (−R, R), where R is the radius of convergence for the power series. It can be easily
shown (see the tutorial problems) that the radius of convergence for the power series
∞
X
kak xk−1
k=1
∞
X
g(x) = kak xk−1 .
k=1
Fix, now, a number x in (−R, R). Our task is to show that f ′ (x) = g(x), or in other words,
that
f (x + h) − f (x)
lim = g(x).
h→0 h
Now if x + h ∈ (−R, R) and h 6= 0 then
∞ ∞
f (x + h) − f (x) X X ak (x + h)k − ak xk
g(x) − = kak xk−1 −
h h
k=1 k=0
∞ ∞
X
k−1
X (x + h)k − xk
= kak x − ak .
h
k=1 k=1
Thus
∞
f (x + h) − f (x) X
g(x) − ≤ |h| k(k − 1)ak M k−2 .
h
k=2
One can show using the ratio test that the series on the right-hand side converges and hence
∞
X
lim |h| k(k − 1)ak M k−2 = 0.
h→0
k=2
Therefore
f (x + h) − f (x)
lim g(x) − =0
h→0 h
(by the pinching theorem for limits) and we conclude that
f (x + h) − f (x)
lim = g(x).
h→0 h
Hence f ′ (x) = g(x) for all x in (−R, R).
Now that we have proved that a power series is differentiable inside its open interval of conver-
gence, it is relatively easy to prove that it is integrable inside this interval.
whenever x ∈ (−R, R), where R is the radius of convergence for the power series. It can be easily
shown (see the tutorial problems) that the radius of convergence for the power series
∞
X ak k+1
x
k+1
k=0
whenever x ∈ (−R, R). Hence F is an antiderivative for f on (−R, R) and hence f is integrable on
(−R, R).
sum(f(k) , k=m..n); computes the sum of f(k) as k runs from m to n. For example,
30
taylor(expr, x=a, k); computes the Taylor series for expr about x=a, up to the term of order k.
convert(taylor(expr, x=a, k), polynom); computes the Taylor polynomial of order k-1 for
expr about x=a.
coeftayl(expr, x=a, k); computes the kth coefficient in the Taylor series expansion of expr
about x=a.
For example,
2. [R] Suppose that f (x) = sin x and m ≥ 0. Using summation notation, find a formula for
the Taylor polynomial p2m+1 of degree 2m + 1 for f about 0.
3. [R]
√
a) Suppose that f (x) = x. Find the Taylor polynomial of degree 3 for f about 4.
b) Suppose that g(x) = cos x. Find the Taylor polynomial of degree 4 for g about π/4.
a) of degree n = 1 about 1.
b) of degree n = 2 about 1.
c) of degree n = 2 about 2.
a) Express f (x) in the form p1 (x) + R2 (x), where p1 is the first Taylor polynomial for f
about 0 and R2 is the Lagrange formula for the remainder.
b) Suppose that x ∈ [−0.1, 0.1] and consider the approximation ln(1 + x) ≈ x. Use your
answer to (a) to show that an upper bound for the absolute error in this approximation
is 1/162.
√
6. [R] Suppose that f (x) = 1 + x and let p2 denote the second Taylor polynomial for f
about 0. If x ∈ [0, 1] then show that the absolute error in the approximation f (x) ≈ p2 (x)
1
does not exceed 16 .
7. [R] Suppose that f (x) = cos x and that n is a positive even integer.
a) Find the nth Taylor polynomial pn for f about 0 and the Lagrange formula for the
remainder Rn+1 .
b) Use the mean value theorem to prove that
c) Use parts (a) and (b) to find an upper bound for the absolute error in the approxi-
mation f (1/10) ≈ pn (1/10).
d) Hence find a value for n such that the absolute error in the approximation of (c) is
less than 10−6 .
e) The value of cos 2 is estimated using pn (2) for some n. Explain why it is better not
to use the inequality of (b) to find an upper bound for |Rn+1 (2)|.
f) Find a value for n such that the absolute error in the approximation f (2) ≈ pn (2) is
less than 10−6 .
g) The Taylor polynomial p10 is used to approximate f on the interval [−a, a], where
a is a positive real number. Find a value for a such that the absolute error in the
approximation f (x) ≈ p10 (x) is less than 10−6 whenever x ∈ [−a, a].
9. [R]
a) Suppose that
f (x) = x7 + 5x6 + 3x5 − 17x4 − 16x3 + 24x2 + 16x − 11.
Verify that 1 and −2 are stationary points for f and use the corollary to Taylor’s
theorem to classify each of these stationary points.
b) Suppose that
f (x) = x7 − 7x6 + 10x5 + 22x4 − 43x3 − 35x2 + 48x + 40.
Verify that −1, 2 and 3 are stationary points for f and classify each of these stationary
points.
b) Suppose that
1 1 1
sk = 1 + + + ... + .
1! 2! k!
Show that k!(e − sk ) is an integer.
c) Show that 0 < k!(e − sk ) < 1.
d) Conclude that e is irrational.
11. [R] Describe the limiting behaviour of the following sequences. If the sequence converges,
then state its limit.
n2 − 2n + 1 ln n
a) 2
b) , where a > 0.
2n + 4n − 1 na
n sin(nπ/4) n + cos nπ
c) √ d)
2
n +1 n − cos nπ
n! (2n)!
e) f)
nn (n!)2
g) (an + bn )1/n , where a ≥ b > 0.
n2 − 2n + 1
12. [H] Suppose that an = .
2n2 + 4n − 1
a) Find L, where L = lim an .
n→∞
b) For each positive number ǫ, find a number N such that
∞
X 1
a) Consider the series ak , where ak = .
k(k + 1)
k=1
16. [R] Let sn denote the nth partial sum of the series
1 1
1 + √ + √ + · · ·.
2 3
√
a) Show that sn > n whenever n > 1.
b) Hence explain why the series diverges.
∞
X 1
17. [R] Let sn denote the nth partial sum of the harmonic series series . When n = 2k−1 ,
k
k=1
the terms of sn may be bracketed as shown:
1 1 1 1 1 1 1 1
sn = 1 + + + + + ... + + ··· + + + ... + .
2 3 4 5 8 2k−2 + 1 2k−2 + 2 2k−1
Hence use an argument similar to that in Question 16 to show that the harmonic series
diverges.
18. [R] The following three questions are similar to Example 4.4.3.
a) By drawing a diagram and interpreting each term in sum as the area of rectangle,
show that
n Z n
X 1 dx
2
≤ 2
.
k 1 x
k=2
∞
X 1
b) Deduce that converges.
k2
k=2
19. [R]
a) By drawing a diagram and interpreting each term in sum as the area of rectangle,
show that
n Z n+1
X 1 dx
√ ≥ √ .
k 1 x
k=1
∞
X 1
b) Deduce that √ diverges.
x
k=1
20. [R] By using the technique of the previous two questions, determine whether or not the
∞
X 1
sum converges.
k ln k
k=2
22. [R] Use a comparison test to determine whether or not each series converges.
∞ ∞ ∞
X 1 X 1 X k
a) b) c)
(k + 3)1/2
3 (k − 1)1/3
2 k2 −6
k=1 k=2 k=1
∞ ∞ ∞
X 1 X 1 X 1
d) e) f) sin2
ln k (ln k)9 k
k=2 k=2 k=1
23. [R] Use the ratio test to examine the convergence of each series.
∞ ∞ ∞ ∞
X k2 X 3k X k! X 5k
a) b) c) d)
2k k! kk 2k + 4k
k=1 k=1 k=1 k=1
24. [R] Determine which of the following alternating series converge. Which are absolutely
convergent?
∞ ∞
X (−1)k X (−1)k kk
a) b)
ln k (k + 1)k
k=3 k=1
∞ ∞
X (−1)k+1 X (−1)k
c) p d) [HH] √
k=2
k(k2 − 2) k=2
k + (−1)k
∞
X (−1)k
25. [R] Consider the alternating series . Let L denote the value of the series and
k3 + 1
k=0
let sn denote the nth partial sum of the series whenever n ≥ 0.
26. [R] By using an appropriate test, determine whether or not each series converges.
∞ ∞ ∞
X (−1)k X 3k X 3k
a) √ b) c)
k k3 1 + 7k
k=2 k=1 k=1
∞ ∞ ∞
X 2k k! X (−1)k+1 k2 X sin (2k − 1)π/4
d) e) √ f)
kk 4k4 + 1 2k
k=2 k=2 k=1
28. [R] Find, in each case, the Maclaurin series for f . Express your answer using summation
notation. (You may find your answers to some questions of Problems 4.1 : Taylor polynomials
helpful.)
a) f (x) = ex b) f (x) = sin x c) f (x) = sinh x
1
d) f (x) = ln(1 + x) e) f (x) =
x−1
a) Express f in the form f (x) = pn (x)+ Rn+1 (x), where pn is the nth Taylor polynomial
for f about 0 and Rn+1 is the Lagrange formula for the remainder.
b) Fix x in R and show that Rn+1 (x) → 0 as n → ∞.
c) Hence write down the Taylor series expansion for f (x), stating clearly where the
expansion is valid.
30. [H] Repeat the previous question in the case when f (x) = sinh x.
a) Express f in the form f (x) = pn (x)+ Rn+1 (x), where pn is the nth Taylor polynomial
for f about 0 and Rn+1 is the Lagrange formula for the remainder.
b) Suppose that 0 ≤ x ≤ 1 and show that Rn+1 (x) → 0 as n → ∞.
c) Hence write down the Taylor series expansion for f (x), when 0 ≤ x ≤ 1.
d) [HH] We will show that this Taylor series expansion is also valid on (−1, 0). Suppose
that −1 < x < 0.
i) By using the integral form for the remainder, show that
Z x
t−x n 1
Rn+1 (x) = dt.
0 1+t 1+t
ii) Use the mean value theorem for integrals (when g(t) = 1; see Question 8) to
show that
cn + |x| n |x|
|Rn+1 (x)| <
1 + cn 1+x
for some number cn between x and 0.
iii) Deduce that
n |x|
|Rn+1 (x)| < |x|
1+x
and hence that Rn+1 (x) → 0 as n → ∞.
32. [H] Let I denote the interval (x0 − R, x0 + R), where x0 and R are real numbers. Suppose
that a function f has derivatives of all orders on I and that all these derivatives have a
common bound (that is, |f (n) (x)| ≤ M for all x in I and for all positive integers n). Show
that f is represented by its Taylor series about x0 on I.
33. [H] (This exercise illustrates that a conditionally convergent series, when rearranged, can
have a different sum.)
Consider the series s and t, given by
1 1 1 1 1
s=1− + − + − + ···
2 3 4 5 6
and
1 1 1 1 1 1 1 1
t=1− − + − − + − − + ··· .
2 4 3 6 8 5 10 12
Note that second series is a rearrangement of the first.
34. [R] Determine the open interval of convergence for each of the following power series.
∞ ∞ ∞
X x k X xk X kxk
a) b) c)
6 k2 + 1 2k
k=0 k=0 k=0
∞ ∞ ∞
X (x − 2)k X (3x − 2)k X (−1)k xk
d) e) f)
k3 k ln k (k + 1)3k
k=1 k=2 k=1
∞
X (ln k)k xk
g) [HH]
kk
k=1
37. [R] Use your answers to Question 28 to deduce the Maclaurin series for each function g.
a) g(x) = (x + 1)ex b) g(x) = sin(x2 ) c) g(x) = (x − 1)−2
38. [R] Suppose that f (x) = (1 − x)−1 . Write down the Maclaurin series for f and hence
find the Maclaurin series for each function g given below. On what open interval is each
function represented by its Maclaurin series?
a) g(x) = (1 + x)−1 b) g(x) = (1 + x2 )−1 c) g(x) = tan−1 x
a) By using the Maclaurin series for sine, find the Maclaurin series for f .
b) Hence show that 0 is a stationary point for f .
c) Is 0 a local maximum point, local minimum point or a horizontal point of inflexion?
Explain.
1
= 1 + x + x2 + x3 + x4 + · · · ,
1−x
where (
sin t
t if t 6= 0
f (t) =
1 if t = 0.
The Si function is used in signal processing and by surveyors for GPS.
a) Show that Si has a stationary point at π and classify this stationary point.
b) By first writing down the Maclaurin series for the sine function, find the Maclaurin
series for Si.
c) Hence find an estimate for the value of Si(π) such that the absolute error is less than
1/100.
d2 y dy
x2 +x = ex − 1.
dx2 dx
Suppose that a solution y has a power series representation given by
∞
X
y= ak x k ,
k=0
Note: This method for solving differential equations will be developed in some second
year courses.
Chapter 5
• finding the average height of a cable, or the average temperature over a certain time
interval;
• finding the speed of a particle that travels along a curve in the plane; and
Each of these applications involves integration, either through approximating a quantity with a
Riemann sum, or through approximating the rate of change of a quantity and thereafter applying
the fundamental theorem of calculus.
3 metres
2 metres
What is the average height of the cable above the ground? Clearly it must be somewhere between
2 and 3 metres. To obtain a precise answer, recall from MA1131 that any suspended cable is the
| | x
a b
One way to proceed is the following. Divide the interval [a, b] into n subintervals of equal length.
We sample the height of the graph in the kth subinterval by choosing a point ck in that subinterval
and calculating f (ck ).
y
f (ck )
| | | | | | | | | | | x
a b
c1 c2 c3c4 c5 ··· ck · · · cn−1 cn
The average (that is, arithmetic mean) an of these sampled heights is given by
1
an = f (c1 ) + f (c2 ) + f (c3 ) + · · · + f (cn ) .
n
As the number n of subintervals increases, an should get closer to what we intuitively understand
by ‘the average height of the graph.’
b−a
Note that f (ck ) and is the height and width of the kth rectangle in the following diagram.
n
y
b−a
n
f (ck )
| | | | | | | | | | | x
a b
c1 c2 c3c4 c5 ··· ck · · · cn−1 cn
Definition 5.1.1. Suppose that f is integrable on a closed interval [a, b]. Then the
average value f of f on [a, b] is defined by the formula
Z b
1
f= f (x) dx.
b−a a
Remark 5.1.2. By rearranging this formula, we see that f is the unique constant such that
Z b
(b − a)f = f (x) dx.
a
Interpreted geometrically, f is the unique y-value such that the area of the shaded rectangle is
equal to the area under the graph of f .
| | x
a b
Solution. (a) Suppose that f (x) = 2 cosh(x/2). The average value f of f on the interval [−a, a] is
given by
Z a
1
f= 2 cosh(x/2) dx
a + a −a
Z a
2
= 2 cosh(x/2) dx (since cosh is even)
2a 0
1h ia
= 4 sinh(x/2)
a 0
4
= sinh(a/2)
a
2
= −1 sinh cosh−1 (3/2) .
cosh (3/2)
Now cosh2 (t) − sinh2 (t) = 1 and so
√
−1
q 5
sinh cosh (3/2) = cosh2 cosh−1 (3/2) − 1 = .
2
Hence √
2 5
f= −1 × .
cosh (3/2) 2
By using a calculator, we find that f ≈ 2.32. So the average height of the cable above the ground
is approximately 2.32 metres.
We saw in MA1131 that every continuous function f defined on a closed interval [a, b] attains
its maximum and minimum values. (This result is called the maximum-minimum theorem; see
Chapter 2 in the MA1131 calculus notes). The next theorem says that such a function also attains
its average value.
Theorem 5.1.4 (The mean value theorem for integrals). Suppose that f is continuous on [a, b].
Then there is a number c in (a, b) such that
Z b
f (t) dt = f (c)(b − a).
a
Restated, the conclusion of the mean value theorem for integrals says that there exists a point
c in [a, b] such that f (c) = f , where f is the average value of f on [a, b].
By the fundamental theorem of calculus, F is continuous on [a, b], differentiable on (a, b) and
F ′ (x) = f (x). By the mean value theorem, there exists c ∈ [a, b] such that
F (b) − F (a)
= F ′ (c). (5.2)
b−a
But Z b
F (a) = 0, F (b) = f (t) dt and F ′ (c) = f (c).
a
as required.
Remark 5.1.5. A more general version of the mean value theorem for integrals is given in the
tutorial problems for Chapter 4 and is used to prove the Lagrange formula for the remainder in
Taylor’s theorem.
Suppose that P0 (x0 , y0 ) and P1 (x1 , y1 ) are two points in R2 . The distance between P0 and P1
is given by p
dist(P0 , P1 ) = (x1 − x0 )2 + (y1 − y0 )2 .
Suppose that the points P0 and P1 are the endpoints of a straight line segment P0 P1 , as shown.
P1 (x1 , y1 )
P0 (x0 , y0 )
Then we define the length of the line segment P0 P1 to be the distance between P0 and P1 . In other
words,
p
length(P0 P1 ) = (x1 − x0 )2 + (y1 − y0 )2 .
The line segment P0 P1 is a special example of a curve in R2 . In this section we study the
lengths of curves that are not necessarily straight line segments. We begin by presenting an intuitive
derivation of a formula that gives the arc length of a curve. (A rigorous approach to proving the
validity of such a formula would involve giving a formal definition for arc length and considering
the limits of some technically difficult Riemann sums; we shall not delve into this here.) The
subsections following this derivation present variations of this formula and some examples.
C (x(b), y(b))
(x(a), y(a))
We also assume that the parametrisation is chosen so that the path traversed by the moving point
(x(t), y(t)) does not retrace its steps (either forwards or backwards).
When a ≤ t ≤ b, let ℓ(s) denote the arc length of the curve Cs , given by
Cs = (x(t), y(t)) ∈ R2 : a ≤ t ≤ s .
The segment Cs corresponding to the arc length ℓ(s) is illustrated in black in the diagram below.
C (x(b), y(b))
Cs
(x(s), y(s))
b
(x(a), y(a))
The idea is to take a small segment of the curve and approximate its length with the length of
a secant. Suppose that a < t < b and that h is a small real nonzero number. Consider the points
P (x(t), y(t)) and Q(x(t + h), y(t + h)).
Q b
(x(b), y(b))
P b
(x(a), y(a))
The length of the arc from P to Q is approximately equal to the length of secant P Q. That is
p
ℓ(t + h) − ℓ(t) ≈ [x(t + h) − x(t)]2 + [y(t + h) − y(t)]2 ,
where the length of the secant is calculated using the distance formula. If we divide both sides by
h then s
ℓ(t + h) − ℓ(t) x(t + h) − x(t) 2 y(t + h) − y(t) 2
≈ + .
h h h
This approximation gets better as h gets smaller. If we make the assumption that ℓ is a differentiable
function of s then, by taking the limit as h approaches zero, one obtains
p
ℓ′ (t) = [x′ (t)]2 + [y ′ (t)]2 .
Hence Z sp
ℓ(s) = [x′ (t)]2 + [y ′ (t)]2 dt + K
a
for some constant of integration K, by the fundamental theorem of calculus. To evaluate K, note
that ℓ(a) = 0. So if s = a then
Z ap
0 = ℓ(a) = [x′ (t)]2 + [y ′ (t)]2 dt + K = 0 + K = K.
a
Finally, the length of the entire curve is ℓ(b). So the arc length of C is
Z bp
[x′ (t)]2 + [y ′ (t)]2 dt.
a
where x and y are differentiable functions of t. Then its arc length ℓ is given by the formula
Z bp
ℓ= [x′ (t)]2 + [y ′ (t)]2 dt (5.3)
a
The next example shows how this formula is applied. We consider the cycloid, which is closely
related to the so-called ‘curve of fastest descent’ (see Section 7.2 of the MA1131 calculus course
notes).
Example 5.2.1 (The arc length of a cycloid). Find the arc length of one arch of the cycloid
2r
|
| x
2πr
Hence
since cos2 t + sin2 t = 1. We want to substitute this into formula (5.3). Before doing so, it is best
to express 1 − cos t as a square. Now 1 − cos 2θ = 2 sin2 θ and so
Remark 5.2.2. For parametrisations of closed curves, one should be careful with the limits of
integration. For example, a circle of radius r and centre (0, 0) may be parametrised as
Hence
Z 2π p Z 2π
ℓ= 2 2
[−r sin t] + [r cos t] dt = r dt = 2πr,
0 0
then
Z 2π p Z 2π
[−2r sin 2t]2 + [2r cos 2t]2 dt = 2r dt = 4πr,
0 0
which is not the circumference of the circle. The reason for this is that, as t varies from 0 to 2π, the
point (x(t), y(t)) moves around the circle twice! To find the arc length using this parametrisation,
one should instead integrate from 0 to π.
Suppose that f is a function of one variable. To find the arc length of the graph of f on the interval
[a, b], we parametrise the curve
y = f (x)
by
x(t) = t, y(t) = f (t), a ≤ t ≤ b.
Now
x′ (t) = 1 and y ′ (t) = f ′ (t).
Z bp
ℓ= 1 + [f ′ (t)]2 dt
a
Z bp
ℓ= 1 + [f ′ (x)]2 dx. (5.4)
a
The use of this formula is illustrated below. We remind readers that a catenary is the shape
of a hanging cable and is described using the hyperbolic cosine function. See Chapter 10 of the
MA1131 calculus notes for further details.
Example 5.2.3 (The arc length of a catenary). Find the arc length of a catenary whose graph is
given by
1
y = cosh(ax), x ∈ [−b, b].
a
1/a
| | x
−b b
1
Solution. Suppose that f (x) = a cosh(ax). By formula (5.4),
Z b p
ℓ= 1 + [f ′ (x)]2 dx
−b
Z bq
= 1 + sinh2 (ax) dx
−b
Z bq
= cosh2 (ax) dx (since cosh2 t − sinh2 t = 1)
−b
Z b
= cosh(ax) dx (since cosh is always positive)
−b
Z b
=2 cosh(ax) dx (since cosh is even)
0
b
1
=2 sinh ax
a 0
2
= sinh(ab)
a
1 ab −ab
= e −e .
a
1
So the arc length of the catenary is a eab − e−ab units.
r = f (θ), θ0 ≤ θ ≤ θ1 .
Since
x = r cos θ = f (θ) cos θ and y = r sin θ = f (θ) sin θ,
we have a parametrisation for the curve in terms of θ. Now
x′ (θ) = −f (θ) sin θ + f ′ (θ) cos θ, while y ′ (θ) = f (θ) cos θ + f ′ (θ) sin θ.
Hence
[x′ (θ)]2 + [y ′ (θ)]2 = [f (θ)]2 sin2 θ − 2f (θ)f ′ (θ) sin θ cos θ + [f ′ (θ)]2 cos2 θ
+ [f (θ)]2 cos2 θ + 2f (θ)f ′ (θ) sin θ cos θ + [f ′ (θ)]2 sin2 θ
= [f (θ)]2 + [f ′ (θ)]2 ,
where we have used the fact that sin2 θ + cos2 θ = 1. So by using the parametric form (5.3) for arc
length, we find that the arc length ℓ of the polar curve is given by
Z θ1 p
ℓ= [f (θ)]2 + [f ′ (θ)]2 dθ.
θ0
dr
We usually write f (θ) as r and f ′ (θ) as dθ .
Example 5.2.4. The spiral graphed below is given by the polar equation r = e−θ/10 , where θ ≥ 0.
Is the total arc length finite? Explain.
x
1
Solution. We begin by calculating the arc length for the segment of the curve when 0 ≤ θ ≤ θ1 .
Now
dr 1
r = e−θ/10 and = − e−θ/10 .
dθ 10
Hence
Z θ1 q
2
1 −θ/10 2
ℓ= e−θ/10 + − 10 e dθ
0
Z θ1 q
1
= 1 + 100 e−2θ/10 dθ
√0 Z
101 θ1 −θ/10
= e dθ
10 0
√
= 101 1 − e−θ1 /10 .
√ √
Now as θ1 → ∞, ℓ → 101. Hence the total arc length is finite and equals 101 units.
In Chapter 4 of the MA1131 calculus notes, we discussed the speed of a particle that moves
along a straight line. Now we consider the speed of a particle that moves along a curve in the plane.
Suppose that a particle P is moving in the plane and that its position at time t is given by
(x(t), y(t)). The distance s(t) that the particle has travelled from time zero to any later time t is
given by the formula Z tp
s(t) = [x′ (u)]2 + [y ′ (u)]2 du
0
(which is simply the arc length formula for the path that P traverses in this time interval). By
definition, the speed of P is the rate of change of its distance with respect to time. So if v(t)
denotes the speed of P at time t then
p
v(t) = s′ (t) = [x′ (t)]2 + [y ′ (t)]2
by the fundamental theorem of calculus.
In summary, the speed v(t) of a particle P at time t is given by
p
v(t) = [x′ (t)]2 + [y ′ (t)]2 ,
where the functions x and y give the position (x(t), y(t)) of P at time t.
Example 5.3.1. A stone is thrown horizontally from the deck of the Sydney Harbour Bridge at
20 metres per second. Its position (x(t), y(t)) exactly t seconds after the stone is thrown is given
by √
x(t) = 20t, y(t) = 50 − 5t2 , 0 ≤ t ≤ 10,
where y(t) is the height above the water (see Example 7.2.1 in the MA1131 calculus notes). Find
the speed of the stone an instant before it hits the water.
Solution. We have
x′ (t) = 20 and y ′ (t) = −10t.
So the speed v(t) of the stone at time t is given by
p
v(t) = 202 + 100t2
√
whenever
√ 0 < t < 10. Now the stone hits the water when y(t) = 0, which is precisely when
t = 10. Hence the speed of the stone an instant before it hits the water is given by
q √ √
lim
√ v(t) = 202 + 100( 10)2 = 10 14 ≈ 37.42.
t→( 10)−
So the speed of the stone just before it hits the water is approximately 37.42 metres per second.
The problem of finding the surface area of a surface or solid in R3 is not easy. In this section,
we focus on finding the surface area for a surface (or solid) that is formed by rotating a curve
about one of the axes. In the first subsection we derive, intuitively, a formula for the area of such
a surface. In the second subsection, the relevant formulae are summarised and examples given.
The formulae presented all rely on the formula for the surface area of the frustum of a right
circular cone.
r
b
b
R
Given a frustum of slant height s and radii r and R, the surface area A of the ‘curved surface’ is
given by
A = π(r + R)s. (5.5)
This formula may be proved using elementary methods and is left as an exercise in the tutorial
problems.
• the curve lies in the upper half-plane (more precisely, x(t) ≥ 0 and if the curve meets the
x-axis then it does so at only a finite number of points); and
• the curve C is simple: if (x(t0 ), y(t0 )) = (x(t1 ), y(t1 )) then t0 = t1 (that is, the curve does
not intersect itself).
If we rotate the curve about the axis, then a surface of revolution is formed.
The goal of this subsection is to derive a formula for the area of this surface.
Let A(s) denote the area of the surface formed when the curve segment
(x(t), y(t)) ∈ R2 : a ≤ t ≤ s
is rotated about the x-axis. We make the assumption that A is a differentiable function.
Our immediate goal is to compute the derivative of A. Fix t in (a, b) and suppose that h is a
small nonzero real number. Consider the points P (x(t), y(t)) and Q(x(t + h), y(t + h)) and note
that A(t + h) − A(t) is the area of the surface formed by rotating the curve segment from P to Q
about the x-axis.
y
C
Q
P
Since h is small, this surface area is approximately equal to the area of the surface formed when
the secant P Q is rotated about the x axis.
C
Q
P
then the area A of the surface of revolution about the x-axis is given by
Z b p
A= 2πy(t) [x′ (t)]2 + [y ′ (t)]2 dt. (5.6)
a
If C is the graph
y = f (x), x ∈ [a, b],
of a function f on [a, b] then the area A of the surface of revolution about the x-axis is given by
Z b p
A= 2πf (x) 1 + [f ′ (x)]2 dx. (5.7)
a
r = f (θ), θ0 ≤ θ ≤ θ1 ,
then the area A of the surface of revolution about the x-axis is given by
s 2
Z θ1
dr
A= 2πr sin θ r2 + dθ. (5.8)
θ0 dθ
Remark 5.4.1. Formula (5.6) was derived heuristically in Subsection 5.4.1. Formula (5.7) may be
easily deduced from (5.6) by using the following parameterisation of the graph of f :
Formula (5.8) may be easily deduced from (5.6) by using the following parameterisation of the
polar curve:
x(θ) = f (θ) cos θ, y(θ) = f (θ) sin θ, θ0 ≤ θ ≤ θ1 .
Remark 5.4.2. In parametric form, the formula for the area A of surface of revolution about the
y-axis is given by
Z b p
A= 2πx(t) [x′ (t)]2 + [y ′ (t)]2 dt.
a
Other versions of this formula may be easily deduced using the parametrisations given in the
previous remark.
Remark 5.4.3. Each of these formulae only give the area of the surface of revolution. To find
the surface area of the solid of revolution, one must also add the surface area contributed by any
circular ‘caps’ appearing at each end of the surface of revolution. See, for example, Example 5.4.5.
about the x-axis. Find the surface area of the solid, making sure that the every face of the solid is
accounted for.
y
√
2
x
2
It has two faces: the truncated paraboloid (shaded in lighter gray) and the circular cap (shaded in
darker gray). The area A1 of the truncated paraboloid is given by
Z 2 p √
A1 = 2πf (x) 1 + [f ′ (x)]2 dx (where f (x) = 2 − x)
0
Z 2 2 !1/2
√ −1
= 2π 2 − x 1 + √ dx
0 2 2−x
Z 2 1/2
√ 1
= 2π 2 − x 1 + dx
0 4(2 − x)
Z 2p
=π 4(2 − x) + 1 dx
0
Z 2
√
=π 9 − 4x dx
0
" #2
(9 − 4x)3/2
=π
−6
0
13π
= .
3
The area A2 of the circular cap is given by
√
A2 = πr 2 = π( 2)2 = 2π.
We end with a simple but interesting example. Recall from high school that the volume V of
the solid formed when the graph of a function f : [a, b] → [0, ∞) is rotated about the x-axis is given
by
Z b
V = π[f (x)]2 dx. (5.9)
a
Example 5.4.6 (Gabriel’s horn). Suppose that the function f : [1, ∞) → R is defined by f (x) = x1 .
Rotate the graph of f about the x-axis, as shown.
The surface of revolution formed is known as Gabriel’s horn (after the biblical figure Gabriel) or
Torricelli’s trumpet (after the mathematician and philosopher Evangelista Torricelli, who was a
pupil of Galileo). Even though the length of the horn is infinite, it may still be possible to calculate
its surface area and the volume of the corresponding solid.
We begin with the volume. First, consider the volume VR of the truncated solid shown below.
y
| x
1 R
2. [R] Suppose that the air temperature T (t), measured in degrees Celsius t hours after noon,
is given by
t2
T (t) = 25 + 2t − .
3
Find the average temperature between noon and 5 p.m.
ii) Hence calculate the arc length of the astroid by using the implicit equation (1).
7. [R] A projectile is fired from an elevated cannon. Its horizontal distance x (in metres)
from the cannon and height y (in metres) above the ground, exactly t seconds after it is
fired, is given by
a) Find t1 .
b) Find the speed of the projectile immediately prior to impact.
c) What was the average height of the projectile above the ground during the period
after it was fired and before impact?
d) [HH] What distance did the projectile travel during this period?
9. [R] In this question we will show that the surface area of the frustum of a right circular
cone is given by π(R + r)s. (For a diagram, see the beginning of Section 5.4.)
Consider a truncated right circular cone with slant height s and base radius R. Cut a line
from the vertex Q to the base and flatten the cone as shown below.
b
Q
R
10. [R] Find the area of the surface of revolution formed when the given curve is rotated
about the x-axis.
a) y = x3 , where 0 ≤ x ≤ 2. b) x = t − sin t, y = 1 − cos t, where 0 ≤ t ≤ 2π.
11. [R] Show that if −a ≤ b < c ≤ a then the surface area of the sphere x2 + y 2 + z 2 = a2
between the planes x = b and x = c is 2πa(c − b).
12. [R] Suppose that 0 < r < R. A surface (doughnut) is formed by rotating a circle of
radius r and centre (0, R) about the x-axis. By finding a suitable parametrisation for the
circle, show that the area of the surface is (2πR)(2πr).
13. [R] Find the area of the surface formed when the polar curve r = 1 + cos θ, where
0 ≤ θ ≤ π, is rotated about the x-axis.
Chapter 1
∂z ∂z ∂2 z ∂2 z ∂2 z ∂2z
∂x ∂y ∂x2 ∂x∂y = ∂y∂x ∂y 2
a) 2xy x2 + 2y 2y 2x 2
3. −y x 2xy (y 2 − x2 ) −2xy
b)
(x2 + y 2 ) (x2 + y 2 ) (x2 + y 2 )2 (x2 + y 2 )2 (x2 + y 2 )2
c) cos(x − cy) −c cos(x − cy) − sin(x − cy) c sin(x − cy) −c2 sin(x − cy)
5. 0.05
217π
6. a) 784π cm3 b) 15 cm3 c) 1.85%
8. |∆S| ≤ 0.0404
9. 9% decrease.
10. 0.21%
b) 4, −4
15. a) y = ±1, dy
dt = 0.
b) ∇F = (2x, 2y, −2z)T .
T
dy dz
c) The vector dx , ,
dt dt dt representes the velocity of the raindrop. So the equation states that
the velocity is perpendicular to the normal to the curve.
Chapter 2
1 2x2 1 1
1. a) e b) − cos(x2 ) c) sin(2x3 )
4 2 6
1 1 f) ln(ln x)
d) ln |5x2 − 11| e) − cos4 x
10 4
p 1 3 1 3
g) x2 + 4x + 7 h) (1 + x2 ) 2 i) − (9 − 4x3 ) 2
3 18
1 1 1 −1
j) − (9 − 4x3 ) 2 k) − l)
6 8(1 + x4 )2 3 tan3 x
−1 1 4 −1
m) n) (4 + 3e2x ) 3 o)
2 sin2 x 8 4(ln x)4
3. a) 1/8 b) 4/15
c) 13 sec3 x + C d) 14 sin 2θ + 21 θ + C
1 1 1 1
e) − 99 (sin x cos 10x − 10 cos x sin 10x) + C or 2 9 sin 9x + 11 sin 11x + C
1 1
f) − 10 cos 5x + 2 cos x + C
4. a) ln | tan x + sec x| + C
1 2
b) i) 3 sec2 x tan x + 3 tan x + C
1 3 3
ii) 4 sec3 x tan x + 8 sec x tan x + 8 ln | tan x + sec x| + C
6. 6 − 16e−1
8. (e2 + 3)/8
9. 35π/256, 16/35
√
10. In = (2 2 − 2nIn−1 )/(1 + 2n)
√
13. a) π/3 − 3/2; x = 2 sin θ
√
b) sinh−1 x−3
2 +C or ln(x − 3 + x2 − 6x + 13) + K; complete the square.
c) 9π/4
√ Z
x2 + 16 cos θ
d) − + C; x = 4 tan θ to obtain dθ.
16x sin2 θ
√
e) x/ 1 − x2 + C
f) tan−1 2
√
14. x2 − 4 + C
√
16. a) 21 ln(x2 + 2x+ 10)− 31 tan−1 x+1
3 +C b) x2 + 2x + 10 − sinh−1 x+1
3 +C
√ √ 6
c) 2 x − 2 ln(1 + x) + C d) 11 − 6 ln(3/2); x = u first.
1 √1 2x+1
18. a) ln x − 2 ln(x2 + x + 1) − 3
tan−1 √
3
+C
8 5
b) 5 cosh (x) + C
3 2 1 −1 x+2
c) 2 ln(x + 4x + 8) − 2 tan 2 +C
1
√ 25 −1 x
d) 2
2 x 25 − x + 2 sin 5 +C
e) ln |x − 1| + ln(x − 2x + 2) + tan−1 (x − 1) + C
2
√
1+x2
f) − x +C
1 √ x
g) 3 x2 +3
+C
1
h) − 14 cos(7x) + 21 cos(x) + C
i) 2/e
Chapter 3
1. a) y = tan(t3 /3 + C) b) y = −2/(x2 + A)
√
c) y = 3 A − 3 cos x d) y = C(x − 1)/x
e) ex+y + Cey + 1 = 0 f) y 2 = tan2 x+ 4 tan x− 1, where y > 0
g) (ln x)2 = 2 ln y + C h) y = 1/(1 − x3 )
2. Let a and b be arbitrary real numbers with a < b. Then there are solutions of the form
3
(x − a)
if x < a
y= 0 if a ≤ x ≤ b .
(x − b)3
if x > b
√
3. 2 2
5. x = t − 1 + Ce−t
7. a) 3x2 y + y 3 = A b) x sin y − 21 x2 y 2 = C
9. a) xy 2 − 3y tan x = C b) y 2 = ln(x2 + 1) + C
ln x + C d) y = Axe−1/x
c) y =
x 1/3
x2 17
e) y = 3 ln |x| + +
2 2
10. xy 2 = 2y 5 + C
11. a) i) y = 0, y=K
y0 K
ii) y=
y0 + (K − y0 )e−kt
iii) y is strictly increasing and approaches K.
iv) y = K/2; work from the differential equation.
v) The solution is the same as for ii); y is strictly decreasing (and concave upwards) with
y = K as a horizontal asymptote.
b) y = K exp {− ln(K/y0 )e−αt } ; one way, let z = ln y.
13. With an inflow of 3 litres per minute and an outflow of 1 litre per minute, the volume of liquid in
the tank at time t is 50 + 2t litres. The inflow of salt is 3 × 2 grams per minute. In running off 1 litre
per minute with a concentration of x/(50 + 2t) grams of salt per litre, the rate of removal of salt is
dx
1 × x/(50 + 2t) grams per minute. So the net rate of increase of x is given by = 6 − x/(50 + 2t)
dt
dx 1
or + x = 6. This is a first order linear ODE. (You may find it helpful to consider the
dt 50 + 2t
outflow over a small time interval [t, t + ∆ t].)
n a o
15. y = A exp k(t + sin(2πt))
2π
dv
17. a) = g − kv; with g = 9.8, k = 10. So v = Ae−kt + g/k. With v = 0 at t = 0,
dt
v = kg (1 − e−kt ) = 50
49
(1 − e−10t )
b) g/k = 49/50
ln 20
c) t ≥ (≈ 0.3 seconds)
k
d) A > 0 and v decreases (rapidly) towards g/k.
18. a) y = Axλ
b) Graph ln y against ln x. From the graph, λ ≈ 1.54 and ln A ≈ −4.55 (so that A ≈ 0.0106).
19. a) $610701.38
dP
b) Treating the car payments as continuous at the rate of $10400 a year, = 0.2P − 10400.
dt
0.2t
Then P = 52000 + 448000e , for 0 ≤ t ≤ 1/2. At t = 1/2, P = 547116.57. The capital
remaining in the cooperative after 6 months is 47116.57 e−0.05 = 44818.67. At the end of one
year, the total is 547116.57 (capital plus new interest in Hitek) + 44818.67 (in the co-op) =
591935.24 dollars.
dy1 dy2
21. = − 0.25y1, = 0.25 y1 − 2y2 with y1 (0) = K, y2 (0) = 0. Thus y1 = Ke−0.25t
dt dt
and hence y2 = K7 (e
−0.25t
− e−2t ). The maximum value of y2 occurs for t = 12
7 ln 2. That is, after
about 1.188 days.
1
23. a) 4 (5e
x − e5x ) b) y = e−x (cos x + sin x)
26. y = 12 x4 e2x .
28. a) x(t) = cos 2t, so the block oscillates with fixed amplitude.
√ √
b) If c = 2 then x(t) = e−t (cos 3t + √13 sin 3t), so the system has damped oscillations.
If c = 5 then x(t) = 13 (e−t − e−4t ), so the system does not oscillate.
c) If the characteristic equation has real roots then the solution has no oscillating terms. This
happens whenever c ≥ 4. So the smallest value of c is 4.
31. b) No
c) µ = nπ/L, where n = 1, 2, 3, . . .. The corresponding solutions are yn (x) = Bn sin(nπx/L).
x2 y2
32. a) + = C, a family of ellipses.
a b
d2 y
b) + aby = 0, y = A cos ωt + B sin ωt, where ω 2 = ab
dx2
and x = (Aω/b) sin ωt − (Bω/b) cos ωt.
c) ω = 1.6, A = 3.2, B = 2.4
x = 1.6 sin ωt − 1.2 cos ωt, y = 3.2 cos ωt + 2.4 sin ωt or
x = −2 cos(ωt + φ) = 2 sin(ωt + φ − π/2) and y = 4 sin(ωt + φ)
4 x2 y2
where φ = sin−1 , and + = 1. The peaks in the predator population lag behind the
5 4 16
peaks in the prey population by a quarter of the period.
33. Care is required if the characteristic equation of Lu = 0 has a double root. Otherwise a basis for
ker(L2 ) is {u1 , xu1 , u2 , xu2 }.
The two dimensional kernel of L is a subspace of the four dimensional kernel of L2 .
Chapter 4
x2 x3 x9
1. a) 1 + x + + + ··· +
2! 3! 9!
x3 x 5
x 7
x 9
b) x − + − +
3! 5! 7! 9!
x3 x5 x7 x9
c) x + + + +
3! 5! 7! 9!
m
X (−1)k x2k+1
2. p2m+1 (x) =
(2k + 1)!
k=0
3. 1
a) 2 + 41 (x − 4) − 64 1
(x − 4)2 + 512 (x − 4)3
1 1 π 1 π 2 1 π 3 1 π 4
b) √ − √ x − − √ x− + √ x− + √ x−
2 2 4 2 2 4 6 2 4 24 2 4
4. a) 3 + 3(x − 1)
b) 3 + 3(x − 1) + (x − 1)2
c) 7 + 5(x − 2) + (x − 2)2
x2
5. a) p1 (x) = x and R2 (x) = − for some c between 0 and x.
2(1 + c)2
x2 x4 x6 xn
7. a) pn (x) = 1 − + − + · · · + (−1)k where n = 2k;
2! 4! 6! n!
(−1)k+1 sin c n+1
Rn+1 (x) = x for some c between 0 and x.
(n + 1)!
1
c) |Rn+1 (x)| < n+2
10 (n + 1)!
d) n = 4
e) The estimate sin x ≤ 1 (whenever x ∈ R) is less crude in the case when x ≥ 1.
f) n = 14
a11 √
< 10−6 gives a <
11
g) Rearranging the inequality |error| ≤ 11!10−6. So a less than 1.398
11!
will do.
13. a) e4 b) 1/e
√
14. e) (1 + 5)/2
20. diverges
∞ ∞ ∞
X xk X (−1)k x2k+1 X x2k+1
28. a) b) c)
k! (2k + 1)! (2k + 1)!
k=0 k=0 k=0
∞ ∞
X
k+1 xk X
k
d) (−1) e) − x
k
k=1 k=0
x2 xn ecn xn+1
29. a) ex = 1 + x + ···+ + , for some cn between 0 and x.
2! n! (n + 1)!
(−1)n xn+1
31. a) Rn+1 (x) = for some cn between 0 and x.
(n + 1)(1 + cn )n+1
33. b) ln 2
1
f) 2 ln 2
∞ ∞
X (k + 1)xk X (−1)k x4k+2
37. a) b)
k! (2k + 1)!
k=0 k=0
∞
X
c) Differentiate 28(e): kxk−1
k=1
∞
x11 x17 x23 X (−1)k+1 x6k−1
39. a) f (x) = x5 − + − + ··· =
3! 5! 7! (2k − 1)!
k=1
c) A horizontal point of inflexion.
56
40. R = 1, ln 2 ≈ 81 .
π3 π5 π7
c) Si(π) ≈ π − 3!3 + 5!5 − 7!7 ≈ 1.84
x
42. a) (−1, 1) b) f (x) =
(1 − x)2
∞ ∞ ∞
X xk X X
43. a) b) y ′ = kak xk−1 , y ′′ = k(k − 1)ak xk−2
k!
k=1 k=1 k=2
∞
1 X xk
c) ak = 2 whenever k ≥ 1 d) y = whenever x ∈ R.
k k! k 2 k!
k=1
Chapter 5
2. 27 92 ◦ C
8
√
3. a) (133/2 − 8)/27 b) 8 c) 27 (10 10 − 1)
4. 6a
√ 2π
5. 2(e − 1)
6. 8
7. a) 9 seconds
√
b) 10 41 ≈ 64.03 metres per second
c) 90 metres
√ √ √ √
d) 80 2 − 80 ln( 2 − 1) + 25 41 + 160 ln 2 − 80 ln( 41 − 5) ≈ 427.53 metres
π2
8. a) v(t) = 2 | sin(πt)|
1
b) (i) t = 2 + k, where k is a positive integer. (ii) t = n, where n is a positive integer.
c) A semicircle of centre (0, 0) and radius 1 in the upper half-plane.
d) π
e) 3π
π 3/2
10. a) 27 (145 − 1) b) 64π/3
13. 32π/5
The information booklet for MA1231 lists the material available for examination in the current
schedule of class tests, see also page xii of these notes.
The following tests are samples only and simply are a guide to style and level of difficulty. They
are not a replacement for doing the tutorial problems.
z = 3x2 − y 2 − 2
3. (2 marks)
Z
Find sec4 θ dθ.
4. (3 marks)
Z 2p
Use a trigonometric substitution to find 4 − x2 dx.
0
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2011
TEST 1 VERSION 1a
This sheet must be filled in and stapled to the front of your answers
5. (2 marks)
Z 2
1
Use a trigonometric substitution to find dx.
0 (4 + x2 )3/2
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2011
TEST 1 VERSION 1b
This sheet must be filled in and stapled to the front of your answers
z = x2 y − 2y 2 + 3x
3. (2 marks)
Z 3
1
Use a trigonometric substitution to find dx.
0 (9 + x2 )3/2
4. (1 mark )
∂z
Let z = ln (x2 + y 2 ). Find .
∂x
5. (2 marks)
∂2z ∂2z
Let z = sin(x + 2y). Show that z satisfies the differential equation 4 − = 0.
∂x2 ∂y 2
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2011
TEST 1 VERSION 2a
This sheet must be filled in and stapled to the front of your answers
3. (2 marks)
Z π/2
Find sin3 θ cos2 θ dθ.
0
4. (2 marks)
Given that Z Z
1 1
2n
(1 − x2 )n dx = (1 − x2 )n−1 dx
0 2n + 1 0
Z 1
for n ≥ 1, find (1 − x2 )4 dx. [Note that you are NOT being asked to prove the recurrence
0
relation.]
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2008
TEST 2 VERSION 3b
This sheet must be filled in and stapled to the front of your answers
2. (2 marks)
Find the general solution of
d2 y dy
+ 8 + 16y = 0.
dt2 dt
3. (3 marks)
Z
x R du 1 u
Find 2
dx. [You are given that 2 2
= tan−1 + C for a 6= 0]
x + 2x + 10 u +a a a
4. (3 marks)
Solve
dy
2 − y = ex
dx
given that y = 0 at x = 0.
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2009
TEST 2 VERSION 3a
This sheet must be filled in and stapled to the front of your answers
2. (3 marks)
Show that the differential equation
3. (4 marks)
d2 y dy
− 7 + 12y = 0
dt2 dt
dy
= 10 at t = 0.
(ii) Find the solution to the equation in part (i) that satisfies y = 3 and
dt
(iii) If the 0 on the right hand side of the equation in part (i) were changed to e3t ,
what form of particular solution would you seek? (Do not evaluate the unknown
coefficients.)
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2013
TEST 2 VERSION 1a
This sheet must be filled in and stapled to the front of your answers
2. (3 marks)
Show that the differential equation
3. (4 marks)
d2 y dy
− − 12y = 0.
dt2 dt
dy
= 2 at t = 0.
(ii) Find the solution to the equation in part (i) that satisfies y = 3 and
dt
(iii) If the 0 on the right hand side of the equation in part (i) were changed to e−3t ,
what form of particular solution would you seek? (Do not evaluate the unknown
coefficients.)
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2013
TEST 2 VERSION 1b
This sheet must be filled in and stapled to the front of your answers
2. (4 marks)
d2 y dy
+ − 6y = 0.
dt2 dt
dy
(ii) Find the solution to the equation in part (i) that satisfies y = 1 and = −4 at
dt
t = 0.
(iii) If the 0 on the right hand side of the equation in part (i) were changed to e−3t ,
what form of particular solution would you seek? (Do not evaluate the unknown
coefficients.)
3. (3 marks)
Z
2x + 6
Find dx.
(3x + 1)(x − 1)
UNIVERSITY OF NEW SOUTH WALES
SCHOOL OF MATHEMATICS AND STATISTICS
MATH1231/MATH1241 CALCULUS S2 2013
TEST 2 VERSION 2a
This sheet must be filled in and stapled to the front of your answers
2. (3 marks)
Show that the differential equation
3. (4 marks)
d2 y
+ 4y = 0.
dt2
dy
(ii) Find the solution to the equation in part (i) that satisfies y = 2 and= 6 at t = 0.
dt
(iii) If the 0 on the right hand side of the equation in part (i) were changed to cos 2t,
what form of particular solution would you seek? (Do not evaluate the unknown
coefficients.)
215
Index