Differential Calculus: Theory, Rules &
Applications
A Comprehensive Academic Guide to Derivatives
Subject: Advanced Mathematics & Physics | Topic: Differential Calculus | Reference Guide
Table of Contents
1. Introduction & Historical Foundations — Concept of Change, Tangent Problem & Limit Definition
2. Formal Definition & Differentiability — One-sided Limits, Continuity vs Differentiability
3. Fundamental Rules of Differentiation — Power, Product, Quotient, and Chain Rules
4. Derivatives of Elementary Functions — Polynomial, Exponential, Logarithmic & Trigonometric
5. Inverse & Implicit Differentiation — Inverse Functions, Implicit Differentiation Technique
6. Higher-Order Derivatives & Taylor Series — Successive Differentiation, Concavity & Series
Expansions
7. Partial Derivatives & Multivariable Calculus — Gradient, Directional Derivative & Partial Differentials
8. Applications in Geometry & Optimization — Curve Sketching, Maxima/Minima, Related Rates
9. Physical & Engineering Applications — Kinematics, Differential Equations & Thermodynamics
10. Worked Practice Problems & Detailed Solutions — Comprehensive Step-by-Step Examples
1. Introduction & Historical Foundations
Differential calculus is one of the most powerful and transformative branches of mathematics. At its core, calculus deals
with continuous change and how quantities vary relative to one another. The central operation in differential calculus is
differentiation, a process that computes the instantaneous rate of change of a mathematical function with respect to its
independent variable.
Historically, the development of differential calculus was driven by two fundamental geometric and physical problems
in the 17th century:
1. The Tangent Line Problem: Determining the precise slope of a straight line tangent to a smooth curve at any
given point.
2. The Instantaneous Velocity Problem: Calculating the exact velocity of an object moving under varying speed at a
single moment in time.
Independently formulated by Sir Isaac Newton and Gottfried Wilhelm Leibniz, calculus unified these seemingly
distinct problems under a single coherent framework. Newton approached the concept from a physical perspective,
Comprehensive Notes: Derivatives & Applications Page 1 of 11
referring to changing quantities as "fluents" and their rates of change as "fluxions." Leibniz approached the topic from a
geometric and philosophical standpoint, introducing the notation of infinitesimals (dx and dy) which remains the
standard in modern mathematical analysis.
CONCEPTUAL MEANING OF THE DERIVATIVE
While algebra allows us to compute the average rate of change over a discrete interval, differential calculus
enables us to calculate the instantaneous rate of change at a specific point. Geometrically, the derivative of a
function f(x) at x = a represents the precise slope of the line tangent to the curve y = f(x) at the point (a, f(a)).
Consider a secant line passing through two distinct points on the graph of y = f(x), given by P(x, f(x)) and Q(x+h,
f(x+h)). The slope of this secant line represents the average rate of change over the interval [x, x+h]:
msecant = Δy / Δx = [ f(x + h) - f(x) ] / h
As the increment h shrinks closer and closer to zero (h → 0), the second point Q moves along the curve toward P. In
the limit as h approaches zero, the secant line approaches the tangent line at P, yielding the exact slope of the curve at
that point.
2. Formal Definition & Differentiability
2.1 The Limit Definition of the Derivative
Formally, the derivative of a function f with respect to x is defined as a limit of the difference quotient, provided the
limit exists.
FORMAL LIMIT DEFINITION
Let f: I → &mathbb;R be a function defined on an open interval I. For any point x ∈ I, the derivative f'(x) is
defined by:
f'(x) = limh → 0 [ f(x + h) - f(x) ] / h
Alternatively, letting z = x + h, the limit can be expressed as:
f'(x) = limz → x [ f(z) - f(x) ] / (z - x)
2.2 Standard Notations
Different mathematical traditions and applications utilize different notations for the derivative:
Comprehensive Notes: Derivatives & Applications Page 2 of 11
Higher
Notation First Derivative Primary Application Context
Derivatives
dy / dx or d/dx Multivariable calculus, differential equations,
Leibniz Notation d²y / dx², d³y / dx³
[f(x)] physics units
Lagrange Pure analysis, general calculus, single variable
f'(x) or y' f''(x), f'''(x), f(n)(x)
Notation functions
Differential operator theory, linear algebra
Euler Notation D f or Dx f D²f, Dnf
applications
Newton Notation ˙y &ddot;y Classical mechanics, physics time-derivatives (d/dt)
2.3 Continuity vs. Differentiability
A crucial theorem in real analysis establishes the relationship between continuity and differentiability:
THEOREM: DIFFERENTIABILITY IMPLIES CONTINUITY
If a function f(x) is differentiable at a point x = c, then f(x) must also be continuous at x = c.
Proof Sketch: Note that f(x) - f(c) = [ (f(x) - f(c)) / (x - c) ] · (x - c) for x ≠ c. Taking limits as x → c gives limx→c
[f(x) - f(c)] = f'(c) · 0 = 0, which implies limx→c f(x) = f(c). Thus, f is continuous at c.
Converse Notice: The converse is not true. A function can be continuous at a point without being differentiable there.
Common failure modes include:
• Corners and Cusps: Where left-hand and right-hand derivatives exist but are not equal (e.g., f(x) = |x| at x = 0).
• Vertical Tangents: Where the limit approaches infinity (e.g., f(x) = x1/3 at x = 0).
• Discontinuities: Jump, removable, or essential discontinuities automatically destroy differentiability.
3. Fundamental Rules of Differentiation
While the limit definition provides the foundational basis, evaluating derivatives directly via limits for complex
expressions is computationally cumbersome. Arithmetic properties of limits lead to systemic algebraic rules.
SUMMARY OF CORE OPERATIONAL RULES
• Constant Rule: d/dx [c] = 0
• Power Rule: d/dx [xn] = n · xn-1 (for any real number n)
• Constant Multiple Rule: d/dx [c · f(x)] = c · f'(x)
• Sum and Difference Rule: d/dx [f(x) ± g(x)] = f'(x) ± g'(x)
Comprehensive Notes: Derivatives & Applications Page 3 of 11
3.1 Product Rule
The derivative of a product of two differentiable functions is not simply the product of their derivatives. Instead, it
follows a cross-term pattern.
PRODUCT RULE THEOREM
If u(x) and v(x) are differentiable functions, then:
d/dx [ u(x) · v(x) ] = u'(x) · v(x) + u(x) · v'(x)
Proof Derivation: From definition,
limh→0 [ u(x+h)v(x+h) - u(x)v(x) ] / h
Add and subtract u(x+h)v(x) in the numerator:
= limh→0 [ u(x+h)(v(x+h) - v(x)) + v(x)(u(x+h) - u(x)) ] / h
= u(x) · v'(x) + v(x) · u'(x)
3.2 Quotient Rule
Similarly, for the quotient of two functions where the denominator is non-zero:
QUOTIENT RULE THEOREM
If u(x) and v(x) are differentiable and v(x) ≠ 0, then:
d/dx [ u(x) / v(x) ] = [ u'(x)·v(x) - u(x)·v'(x) ] / [ v(x) ]²
3.3 Composite Functions & The Chain Rule
The Chain Rule is arguably the most essential rule in calculus, allowing differentiation of nested or composite functions
y = f(g(x)).
Comprehensive Notes: Derivatives & Applications Page 4 of 11
CHAIN RULE THEOREM
If g is differentiable at x and f is differentiable at g(x), the composite function (f ˆ g)(x) = f(g(x)) is differentiable
at x, and:
d/dx [ f(g(x)) ] = f'(g(x)) · g'(x)
In Leibniz notation, if y = f(u) and u = g(x), then:
dy / dx = (dy / du) · (du / dx)
4. Derivatives of Elementary Functions
Below is a comprehensive tabular summary of standard derivative formulas for elementary functions used across
mathematical disciplines.
Function Category Function f(x) Derivative f'(x) Domain / Constraints
xn n xn-1 All x ∈ &mathbb;R (if n ≥ 1)
Power & Polynomial 1/x -1 / x² x≠0
√x 1 / (2√x) x>0
ex ex All x ∈ &mathbb;R
Exponential
ax ax · ln(a) a > 0, a ≠ 1
ln(x) 1/x x>0
Logarithmic
loga(x) 1 / (x · ln(a)) x > 0, a > 0, a ≠ 1
sin(x) cos(x) All x ∈ &mathbb;R
cos(x) -sin(x) All x ∈ &mathbb;R
tan(x) sec²(x) x ≠ π/2 + kπ
Trigonometric
csc(x) -csc(x)cot(x) x ≠ kπ
sec(x) sec(x)tan(x) x ≠ π/2 + kπ
cot(x) -csc²(x) x ≠ kπ
Comprehensive Notes: Derivatives & Applications Page 5 of 11
4.1 Inverse Trigonometric Derivatives
By applying implicit differentiation to inverse trigonometric definitions, we obtain clean algebraic forms:
• d/dx [ arcsin(x) ] = 1 / √(1 - x²) for |x| < 1
• d/dx [ arccos(x) ] = -1 / √(1 - x²) for |x| < 1
• d/dx [ arctan(x) ] = 1 / (1 + x²) for all x ∈ &mathbb;R
• d/dx [ arccot(x) ] = -1 / (1 + x²) for all x ∈ &mathbb;R
5. Inverse & Implicit Differentiation
5.1 Implicit Differentiation
When an equation defines an implicit relationship between x and y (e.g., x² + y² = r²) without explicitly solving for y =
f(x), we differentiate both sides with respect to x, applying the Chain Rule to any terms containing y, and then
algebraically solve for dy/dx.
EXAMPLE: IMPLICIT DIFFERENTIATION OF A CIRCLE
Find dy/dx for the circle equation x² + y² = 25.
Solution: Differentiate term-by-term with respect to x:
d/dx [ x² ] + d/dx [ y² ] = d/dx [ 25 ]
2x + 2y · (dy/dx) = 0
Rearranging to solve for dy/dx:
2y · (dy/dx) = -2x ⇒ dy/dx = -x / y
5.2 Logarithmic Differentiation
Logarithmic differentiation is an invaluable technique for functions involving products of multiple terms or variables in
both the base and exponent, such as y = xx.
Comprehensive Notes: Derivatives & Applications Page 6 of 11
EXAMPLE: DIFFERENTIATING Y = X X
Take the natural logarithm of both sides:
ln(y) = ln(xx) = x · ln(x)
Differentiate implicitly with respect to x using the Product Rule on the right:
(1/y) · (dy/dx) = 1 · ln(x) + x · (1/x) = ln(x) + 1
Multiply both sides by y:
dy/dx = y · [ ln(x) + 1 ] = xx [ ln(x) + 1 ]
6. Higher-Order Derivatives & Taylor Series
6.1 Successive Differentiation
Since the derivative of a function f'(x) is itself a function, taking its derivative produces the second derivative, denoted
f''(x) or d²y/dx². Repeating this process yields higher-order derivatives f(n)(x).
HIGHER-ORDER NOTATIONS
f'(x) = dy/dx (1st Derivative: Velocity / Rate of change)
f''(x) = d²y/dx² (2nd Derivative: Acceleration / Concavity)
f'''(x) = d³y/dx³ (3rd Derivative: Jerk)
f(n)(x) = dny/dxn (n-th Derivative)
6.2 Concavity and Inflection Points
The second derivative measures the rate at which the first derivative (slope) changes:
• If f''(x) > 0 on an interval, the curve is concave upward (holds water).
• If f''(x) < 0 on an interval, the curve is concave downward (sheds water).
• A point where concavity changes sign and f''(x) = 0 (or is undefined) is an inflection point.
6.3 Taylor and Maclaurin Series
Higher-order derivatives allow smooth infinitely differentiable functions to be represented as infinite power series
expanded around a point x = a.
Comprehensive Notes: Derivatives & Applications Page 7 of 11
TAYLOR SERIES EXPANSION
The Taylor series of f(x) centered at x = a is given by:
f(x) = ∑n=0&infty; [ f(n)(a) / n! ] · (x - a)n
= f(a) + f'(a)(x-a) + [f''(a)/2!](x-a)² + [f'''(a)/3!](x-a)³ + ...
When a = 0, the expansion is called a Maclaurin Series.
7. Partial Derivatives & Multivariable Calculus
For functions of several variables z = f(x, y), change can occur along different spatial coordinate directions. We measure
directional rates of change using partial derivatives.
DEFINITION OF PARTIAL DERIVATIVE
The partial derivative of f(x, y) with respect to x holds y constant as a parameter:
∂f / ∂x = limh→0 [ f(x + h, y) - f(x, y) ] / h
Similarly, the partial derivative with respect to y holds x constant:
∂f / ∂y = limh→0 [ f(x, y + h) - f(x, y) ] / h
7.1 The Gradient Vector
Combining all first-order partial derivatives produces a vector called the gradient, denoted by ∇f (del f):
∇f(x, y) = [ ∂f/∂x, ∂f/∂y ] = (∂f/∂x) iˆ + (∂f/∂y) jˆ
Geometrical Property: The gradient vector points in the direction of maximum rate of increase of the scalar field f,
and its magnitude ||∇f|| represents that maximum rate of increase.
8. Applications in Geometry & Optimization
8.1 Tangent and Normal Line Equations
For a function y = f(x) at point (x_0, y_0), the slope of the tangent line is m = f'(x_0).
Comprehensive Notes: Derivatives & Applications Page 8 of 11
Tangent Line Equation: y - y_0 = f'(x_0)(x - x_0)
Normal Line Equation: y - y_0 = -[ 1 / f'(x_0) ] (x - x_0) (if f'(x_0) ≠ 0)
8.2 Optimization & Critical Points
Optimization is the process of finding maximum or minimum values of a function within a domain.
FERMAT'S THEOREM & CRITICAL POINTS
A point c in the domain of f is a critical point if f'(c) = 0 or f'(c) does not exist.
If f has a local extremum (maximum or minimum) at c, then c must be a critical point of f.
THE SECOND DERIVATIVE TEST
Suppose f'(c) = 0 and f'' is continuous near c:
• If f''(c) > 0, then f has a local minimum at c.
• If f''(c) < 0, then f has a local maximum at c.
• If f''(c) = 0, the test is inconclusive (use the First Derivative Test).
9. Physical & Engineering Applications
9.1 Kinematics of Motion
In classical mechanics, the relationship between displacement s(t), velocity v(t), acceleration a(t), and jerk j(t) is
governed by time derivatives:
Physical Quantity Mathematical Definition SI Units
Position / Displacement s(t) meters (m)
Velocity v(t) = ds/dt = s'(t) m/s
Acceleration a(t) = dv/dt = d²s/dt² = s''(t) m/s²
Jerk j(t) = da/dt = d³s/dt³ = s'''(t) m/s³
Comprehensive Notes: Derivatives & Applications Page 9 of 11
9.2 Differential Equations
Derivatives form the bedrock of physical modeling through ordinary and partial differential equations (ODEs & PDEs).
Examples include:
• Newton's Second Law: F = m · (d²x / dt²)
• Radioactive Decay Model: dN/dt = -λ N
• Heat Transfer Equation: ∂u/∂t = α · (∂²u/∂x²)
• Wave Equation: ∂²u/∂t² = c² · (∂²u/∂x²)
10. Worked Practice Problems & Solutions
PROBLEM 1: DERIVATIVE USING THE LIMIT DEFINITION
Question: Find the derivative of f(x) = 2x² - 3x + 5 using the limit definition.
Solution: Apply the definition f'(x) = limh→0 [ f(x+h) - f(x) ] / h:
f(x+h) = 2(x+h)² - 3(x+h) + 5 = 2(x² + 2xh + h²) - 3x - 3h + 5 = 2x² + 4xh + 2h² - 3x - 3h + 5
Subtracting f(x):
f(x+h) - f(x) = (2x² + 4xh + 2h² - 3x - 3h + 5) - (2x² - 3x + 5) = 4xh + 2h² - 3h
Dividing by h:
[ f(x+h) - f(x) ] / h = (4xh + 2h² - 3h) / h = 4x + 2h - 3
Taking the limit as h → 0:
f'(x) = limh→0 (4x + 2h - 3) = 4x - 3
PROBLEM 2: PRODUCT & CHAIN RULE APPLICATION
Question: Differentiate f(x) = x³ · e2x.
Solution: Identify u(x) = x³ and v(x) = e2x.
Compute individual derivatives: u'(x) = 3x², and by the Chain Rule, v'(x) = 2e2x.
Apply Product Rule f'(x) = u'(x)v(x) + u(x)v'(x):
f'(x) = (3x²)(e2x) + (x³)(2e2x) = x² e2x (3 + 2x)
Comprehensive Notes: Derivatives & Applications Page 10 of 11
PROBLEM 3: OPTIMIZATION ANALYSIS
Question: Find the global maximum and minimum of f(x) = x³ - 3x + 2 on the interval [-2, 2].
Solution:
1. Find derivative: f'(x) = 3x² - 3.
2. Set f'(x) = 0 to locate critical points: 3(x² - 1) = 0 ⇒ x = ±1. Both points lie inside [-2, 2].
3. Evaluate f(x) at endpoints and critical points:
◦ f(-2) = (-2)³ - 3(-2) + 2 = -8 + 6 + 2 = 0
◦ f(-1) = (-1)³ - 3(-1) + 2 = -1 + 3 + 2 = 4
◦ f(1) = (1)³ - 3(1) + 2 = 1 - 3 + 2 = 0
◦ f(2) = (2)³ - 3(2) + 2 = 8 - 6 + 2 = 4
Conclusion: Absolute Maximum value is 4 (at x = -1 and x = 2). Absolute Minimum value is 0 (at x = -2 and x =
1).
Comprehensive Notes: Derivatives & Applications Page 11 of 11