Series acceleration

Overview

Two classical techniques for series acceleration are Euler's transformation of series and Kummer's transformation of series. A variety of much more rapidly convergent and special-case tools have been developed in the 20th century, including Richardson extrapolation, introduced by Lewis Fry Richardson in the early 20th century but also known and used by Katahiro Takebe in 1722; the Aitken delta-squared process, introduced by Alexander Aitken in 1926 but also known and used by Takakazu Seki in the 18th century; the epsilon method given by Peter Wynn in 1956; the Levin u-transform; and the Wilf-Zeilberger-Ekhad method or WZ method.

For alternating series, several powerful techniques, offering convergence rates from ${\displaystyle {5.828}^{-n}}$ all the way to ${\displaystyle {17.93}^{-n}}$ for a summation of ${\displaystyle n}$ terms, are described by Cohen et al.

Euler's transform

A basic example of a linear sequence transformation, offering improved convergence, is Euler's transform. It is intended to be applied to an alternating series; it is given by

${\displaystyle \sum _{n=0}^{\mathrm{\infty }}(-1{)}^n{a}_n=\sum _{n=0}^{\mathrm{\infty }}(-1{)}^n\frac{({\mathrm{\Delta }}^{n}a{)}_0}{2^{n+1}}}$

where ${\displaystyle \mathrm{\Delta }}$ is the forward difference operator, for which one has the formula

${\displaystyle ({\mathrm{\Delta }}^{n}a{)}_0=\sum _{k=0}^n(-1{)}^k(\genfrac{}{}{0ex}{}{n}{k})a_{n-k}.}$

If the original series, on the left hand side, is only slowly converging, the forward differences will tend to become small quite rapidly; the additional power of two further improves the rate at which the right hand side converges.

A particularly efficient numerical implementation of the Euler transform is the van Wijngaarden transformation.

Conformal mappings

A series

${\displaystyle S=\sum _{n=0}^{\mathrm{\infty }}{a}_n}$

can be written as ${\displaystyle f(1)}$, where the function f is defined as

${\displaystyle f(z)=\sum _{n=0}^{\mathrm{\infty }}{a}_n{z}^n.}$

The function ${\displaystyle f(z)}$ can have singularities in the complex plane (branch point singularities, poles or essential singularities), which limit the radius of convergence of the series. If the point ${\displaystyle z=1}$ is close to or on the boundary of the disk of convergence, the series for ${\displaystyle S}$ will converge very slowly. One can then improve the convergence of the series by means of a conformal mapping that moves the singularities such that the point that is mapped to ${\displaystyle z=1}$ends up deeper in the new disk of convergence.

The conformal transform ${\displaystyle z=\mathrm{\Phi }(w)}$ needs to be chosen such that ${\displaystyle \mathrm{\Phi }(0)=0}$, and one usually chooses a function that has a finite derivative at w = 0. One can assume that ${\displaystyle \mathrm{\Phi }(1)=1}$ without loss of generality, as one can always rescale w to redefine ${\displaystyle \mathrm{\Phi }}$. We then consider the function

${\displaystyle g(w)=f(\mathrm{\Phi }(w)).}$

Since ${\displaystyle \mathrm{\Phi }(1)=1}$, we have ${\displaystyle f(1)=g(1)}$. We can obtain the series expansion of ${\displaystyle g(w)}$ by putting ${\displaystyle z=\mathrm{\Phi }(w)}$ in the series expansion of ${\displaystyle f(z)}$ because ${\displaystyle \mathrm{\Phi }(0)=0}$; the first ${\displaystyle n}$ terms of the series expansion for ${\displaystyle f(z)}$ will yield the first ${\displaystyle n}$ terms of the series expansion for ${\displaystyle g(w)}$ if ${\displaystyle {\mathrm{\Phi }}^{\prime }(0)\ne 0}$. Putting ${\displaystyle w=1}$ in that series expansion will thus yield a series such that if it converges, it will converge to the same value as the original series.

Non-linear sequence transformations

Examples of such nonlinear sequence transformations are Padé approximants, the Shanks transformation, and Levin-type sequence transformations.

Especially nonlinear sequence transformations often provide powerful numerical methods for the summation of divergent series or asymptotic series that arise for instance in perturbation theory, and therefore may be used as effective extrapolation methods.

Aitken method

A simple nonlinear sequence transformation is the Aitken extrapolation or delta-squared method,

${\displaystyle \mathbb{A}:S\to S^{\prime }=\mathbb{A}(S)={(s_n^{\prime })}_{n\in \mathbb{N}}}$

defined by

${\displaystyle s_n^{\prime }=s_{n+2}-\frac{(s_{n+2}-s_{n+1}{)}^2}{s_{n+2}-2s_{n+1}+s_n}.}$

This transformation is commonly used to improve the rate of convergence of a slowly converging sequence; heuristically, it eliminates the largest part of the absolute error.