0% found this document useful (0 votes)
4 views20 pages

Numerical Analysis: Error Sources Explained

This document discusses various aspects of numerical analysis, focusing on the solution of non-linear equations, linear systems, and the approximation of eigenvalues. It highlights the types of errors in numerical computations, including inherent errors, local round-off errors, and local truncation errors, explaining their sources and impacts. The document also provides examples of how these errors can affect calculations, particularly in the context of Taylor series expansions.

Uploaded by

xibejir727
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
4 views20 pages

Numerical Analysis: Error Sources Explained

This document discusses various aspects of numerical analysis, focusing on the solution of non-linear equations, linear systems, and the approximation of eigenvalues. It highlights the types of errors in numerical computations, including inherent errors, local round-off errors, and local truncation errors, explaining their sources and impacts. The document also provides examples of how these errors can affect calculations, particularly in the context of Taylor series expansions.

Uploaded by

xibejir727
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd

Numerical

Analysis
Lecture 2
Introduction
Solution of Non Linear
Equations
Solution of Linear System
of Equations
Approximation of Eigen
Values
Interpolation and
Polynomial Approximation
Numerical Differentiation
Numerical Integration
Numerical Solution of
Ordinary Differential
Equations
Errors in
Computations
Numerically, computed
solutions are subject to
certain errors. It may be
fruitful to identify the error
sources and their growth
while classifying the errors
in numerical computation.
These are
Inherent errors,
local round-off errors
local truncation errors
Inherent errors
It is that quantity of error
which is present in the
statement of the problem
itself, before finding its
solution. It arises due to the
simplified assumptions made
in the mathematical modeling
of a problem.
It can also arise when
the data is obtained from
certain physical
measurements of the
parameters of the
problem.
Local round-off errors
Every computer has a
finite word length and
therefore it is possible to
store only a fixed
number of digits of a
given input number.
Since computers store
information in binary form,
storing an exact decimal
number in its binary form
into the computer memory
gives an error. This error is
computer dependent.
At the end of computation of a
particular problem, the final
results in the computer, which is
obviously in binary form, should
be converted into decimal form-a
form understandable to the user-
before their print out. Therefore,
an additional error is committed
at this stage too.
This error is called local round-off
error.
(0.7625)10 (0.11000011(0011)) 2

If a particular computer
system has a word length of
12 bits only, then the decimal
number 0.7625 is stored in the
computer memory in binary
form as 0.110000110011.
However, it is equivalent to
0.76245.
Thus, in storing the number
0.7625, we have committed an
error equal to 0.00005, which is
the round-off error; inherent with
the computer system considered.
Thus, we define the error as
Error = True value – Computed
value
Absolute error, denoted by |Error|,
while, the relative error is defined as

Error
Relative error 
True value
Local truncation error
It is generally easier to expand a function
into a power series using Taylor series
expansion and evaluate it by retaining
the first few terms. For example, we may
approximate the function f (x) = cos x
by the series
2 4 2n
x x n x
cos x 1      ( 1) 
2! 4! (2n)!
If we use only the first three terms to
compute cos x for a given x, we get an
approximate answer. Here, the error is
due to truncating the series. Suppose, we
retain the first n terms, the truncation
error (TE) is given by
2 n 2
x
TE 
(2n  2)!

The TE is independent of the computer


used.
If we wish to compute cos x for
accurate with five significant digits,
the question is, how many terms in
the expansion are to be included? In
this situation
2 n 2
x 5 6
 .5 10 5 10
(2n  2)!
Taking logarithm on both sides, we get
(2n  2) log x  log[(2n  2)!]
 log10 5  6 log10 10 0.699  6  5.3

or log[(2n  2)!]  (2n  2) log x  5.3

We can observe that, the above


inequality is satisfied for n = 7. Hence,
seven terms in the expansion are
required to get the value of cos x, with
the prescribed accuracy
The truncation error is given by

16
x
TE 
16!
Numerical
Analysis
Lecture 2

Common questions

Powered by AI

Retaining too few terms in a Taylor series can significantly increase truncation errors, leading to inaccurate results. This is particularly problematic for functions that rapidly oscillate or have sharp changes in values, as the series may not converge quickly for such functions . As truncation error depends on the terms excluded from the series, omitting significant terms can result in large errors, especially if the omitted terms make substantial contributions to the accurate representation of the function. For example, in approximating \( \cos x \), insufficient terms can lead to a substantial deviation from true values for large \( x \), affecting system stability and precision .

The truncation error (TE) of a Taylor series expansion is calculated by considering the remainder after truncating the series, and it is independent of the computing device used. For a function like \( \cos x \), which can be approximated by the series \( \cos x = 1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \dots \), the TE is determined by the terms not included in the approximation . Specifically, if only the first \( n \) terms are used, the TE is provided by \( \left| \frac{x^{2n+2}}{(2n+2)!} \right| \). For example, computing \( \cos x \) accurately for five significant digits as described requires keeping seven terms, satisfying the error threshold of \( 5 \times 10^{-6} \).

The primary types of errors in numerical computations are inherent errors, local round-off errors, and local truncation errors. Inherent errors are present in the problem's formulation due to simplified mathematical modeling and measurement inaccuracies . Local round-off errors occur because computers store numbers in binary form, leading to discrepancies during conversion between binary and decimal forms . Local truncation errors arise from approximating functions using truncated series expansions, such as Taylor series . These errors affect the accuracy by deviating the computed solution from the true value, potentially compromising the reliability of numerical results.

Absolute error is the magnitude of the difference between the true value and the computed value, expressed as \( |\text{True value} - \text{Computed value}| \). Relative error is the absolute error divided by the true value, providing a dimensionless measure expressed as a fraction or percentage, showing error magnitude in relation to the size of the actual value . These errors offer complementary information: while absolute error indicates the extent of deviation in the same units as the quantity measured, relative error contextualizes the magnitude of the error in terms of the size of the value being measured, which is crucial for assessing acceptable error levels in various practical contexts.

Local truncation errors are considered independent of the computer system used because they arise from the mathematical approximation of functions, like a Taylor series, rather than the limitations of computer architecture. These errors depend on the terms omitted from a series and are determined by the mathematical properties of the function being approximated, rather than the computational resources available . In contrast, round-off errors are directly linked to a computer's finite word length and binary representation of numbers, which vary across different computer systems .

Local round-off errors are discrepancies that occur when numbers are stored in a computer's finite binary format. These errors arise during the conversion of exact decimal numbers into binary, where only a limited number of digits can be stored, and when converting results back to decimal format for user interpretation . The significance of local round-off errors lies in their impact on the precision of numerical computations, potentially leading to accumulated inaccuracies, especially in iterative processes. The magnitude of these errors can vary depending on the word length of the computer's storage system, with shorter word lengths typically resulting in larger errors .

To determine the number of terms required in a Taylor series expansion to achieve a specific precision, one must ensure the truncation error (TE) is within a prescribed accuracy. This involves setting the TE condition, \( |x|^{2n+2}/(2n+2)! \leq \text{desired precision} \). For example, to ensure five significant digits of precision, the condition becomes \( |x|^{2n+2}/(2n+2)! < 5 \times 10^{-6} \). By taking logarithms, this inequality helps derive the minimum \( n \) value satisfying the constraint. For computing \( \cos x \) in the example given, the inequality was satisfied when \( n = 7 \), meaning seven terms are necessary .

Computer word length affects the degree of round-off error by limiting the number of digits that can be accurately represented and stored. A system with a short word length has a larger round-off error because fewer digits are retained, leading to greater conversion inaccuracies between decimal and binary forms . For example, a computer with a 12-bit word length storing the number 0.7625 in binary results in the stored number 0.76245 due to limited precision, yielding a round-off error of 0.00005 . Systems with longer word lengths would reduce this error, allowing closer approximations to the true value.

Understanding inherent and implementation errors is crucial in designing computational models because they collectively impact the accuracy and reliability of numerical results. Inherent errors arise from the problem formulation due to simplified assumptions and measurement inaccuracies . These errors define the baseline accuracy of the model. Implementation errors, comprising round-off and truncation errors, result from numerical operations during computation, which can compound inaccuracies . Analyzing and mitigating these errors through strategic model design ensures that computational solutions are as close to reality as possible, enhancing their applicability and trustworthiness in real-world scenarios.

To determine the necessary number of terms in a Taylor expansion ensuring a predefined accuracy, one uses the truncation error formula, setting it smaller than the desired accuracy . The process involves calculating \( |x|^{2n+2}/(2n+2)! \) and solving the inequality \( |x|^{2n+2}/(2n+2)! < \text{precision threshold} \). Taking the logarithm helps solve for \( n \), the number of terms needed. This analytical approach means conducting several algebraic manipulations to determine when additional terms add negligible error, as shown for calculating \( \cos x \) with five significant digits . This ensures that the retained terms meet the prescribed error bounds.

You might also like