Truncation error

{{Short description|Error from taking a finite sum of an infinite series}}

{{Other uses|Truncation error (numerical integration)}}

In numerical analysis and scientific computing, truncation error is an error caused by approximating a mathematical process.{{Cite book|last=Atkinson|first=Kendall E.| url=https://www.worldcat.org/oclc/803318878 |title=An Introduction to Numerical Analysis | edition = 2nd |date=1989|publisher=Wiley | isbn=978-0-471-62489-9|location=New York | language=English | oclc=803318878|page=20}}{{Citation|last1=Stoer|first1=Josef|last2=Bulirsch|first2=Roland | title=Introduction to Numerical Analysis | edition = 3rd |date=2002 |url=https://www.worldcat.org/oclc/50556273|place=Princeton, N.J. | publisher=Recording for the Blind & Dyslexic | language=English|oclc=50556273|access-date=2022-02-08}} The term truncation comes from the fact that these simplifications often involve the truncation of an infinite series expansion so as to make the computation possible and practical.

Examples

= Infinite series =

A summation series for e^x is given by an infinite series such as

e^x=1+ x+ \frac{x^2}{2!} + \frac{x^3}{3!}+ \frac{x^4}{4!}+ \cdots

In reality, we can only use a finite number of these terms as it would take an infinite amount of computational time to make use of all of them. So let's suppose we use only three terms of the series, then

e^x\approx 1+x+ \frac{x^2}{2!}

In this case, the truncation error is \frac{x^3}{3!}+\frac{x^4}{4!}+ \cdots

Example A:

Given the following infinite series, find the truncation error for {{math|1=x = 0.75}} if only the first three terms of the series are used.

S = 1 + x + x^2 + x^3 + \cdots, \qquad \left|x\right|<1.

Solution

Using only first three terms of the series gives

\begin{align}

S_3 &= \left(1+x+x^2\right)_{x=0.75} \\

& = 1+0.75+\left(0.75\right)^2 \\

&= 2.3125

\end{align}

The sum of an infinite geometrical series

S = a + ar + ar^2 + ar^3 + \cdots,\ r<1

is given by

S = \frac{a}{1-r}

For our series, {{math|1=a = 1}} and {{math|1=r = 0.75}}, to give

S=\frac{1}{1-0.75}=4

The truncation error hence is

\mathrm{TE} = 4 - 2.3125 = 1.6875

= Differentiation =

The definition of the exact first derivative of the function is given by

f'(x) = \lim_{h \to 0} \frac{f(x+h)-f(x)}{h}

However, if we are calculating the derivative numerically, h has to be finite. The error caused by choosing h to be finite is a truncation error in the mathematical process of differentiation.

Example A:

Find the truncation in calculating the first derivative of f(x)=5x^3 at x=7 using a step size of h=0.25

Solution:

The first derivative of f(x)=5x^3 is

f'(x) = 15x^2,

and at x=7,

f'(7) = 735.

The approximate value is given by

f'(7) = \frac{f(7+0.25)-f(7)}{0.25} = 761.5625

The truncation error hence is

\mathrm{TE} = 735 - 761.5625 = -26.5625

= Integration =

The definition of the exact integral of a function f(x) from a to b is given as follows.

Let f: [a,b] \to \Reals be a function defined on a closed interval [a,b] of the real numbers, \Reals, and

P = \left \{[x_0,x_1], [x_1,x_2], \dots,[x_{n-1},x_n] \right \},

be a partition of I, where

a = x_0 < x_1 < x_2 < \cdots < x_n = b.

\int_{a}^b f(x) \, dx = \sum_{i=1}^{n} f(x_i^*)\, \Delta x_i

where \Delta x_i = x_i - x_{i-1} and x_i^* \in [x_{i-1}, x_i].

This implies that we are finding the area under the curve using infinite rectangles. However, if we are calculating the integral numerically, we can only use a finite number of rectangles. The error caused by choosing a finite number of rectangles as opposed to an infinite number of them is a truncation error in the mathematical process of integration.

Example A.

For the integral

\int_{3}^{9}x^{2}{dx}

find the truncation error if a two-segment left-hand Riemann sum is used with equal width of segments.

Solution

We have the exact value as

\begin{align}

\int_{3}^{9}{x^{2}{dx}} &= \left[ \frac{x^{3}}{3} \right]_{3}^{9} \\

& = \left[ \frac{9^{3} - 3^{3}}{3} \right] \\

& = 234

\end{align}

Using two rectangles of equal width to approximate the area (see Figure 2) under the curve, the approximate value of the integral

\begin{align}

\int_3^9 x^2 \, dx &\approx \left. \left(x^2\right) \right|_{x = 3}(6 - 3) + \left. \left(x^2\right) \right|_{x = 6}(9 - 6) \\

& = (3^2)3 + (6^2)3 \\

&= 27 + 108 \\

&= 135

\end{align}

\begin{align}

\text{Truncation Error} &= \text{Exact Value} - \text{Approximate Value} \\

&= 234 - 135 \\

&= 99.

\end{align}

Occasionally, by mistake, round-off error (the consequence of using finite precision floating point numbers on computers), is also called truncation error, especially if the number is rounded by chopping. That is not the correct use of "truncation error"; however calling it truncating a number may be acceptable.

= Addition =

Truncation error can cause (A+B)+C \neq A+(B+C) within a computer when A = -10^{25}, B = 10^{25}, C = 1 because (A+B)+C = (0)+C = 1 (like it should), while A+(B+C) = A+(B)=0. Here, A+(B+C) has a truncation error equal to 1. This truncation error occurs because computers do not store the least significant digits of an extremely large integer.

See also

References

{{reflist}}

  • {{Citation | last1=Atkinson | first1=Kendall E. | title=An Introduction to Numerical Analysis | publisher=John Wiley & Sons | location=New York | edition=2nd | isbn=978-0-471-50023-0 | year=1989 | page=20 }}
  • {{Citation | last1=Stoer | first1=Josef | last2=Bulirsch | first2=Roland | title=Introduction to Numerical Analysis | publisher=Springer-Verlag | location=Berlin, New York | edition=3rd | isbn=978-0-387-95452-3 | year=2002 | page=1 |url=https://books.google.com/books?id=1oDXWLb9qEkC&pg=PA1}}.

Category:Numerical analysis