Tricki
a repository of mathematical know-how

Revision of Numerical solution of nonlinear equations from Wed, 10/06/2009 - 12:45

Quick description

Nonlinear equations are ubiquitous in mathematics, and we need practical methods to solve such equations. Methods vary in their reliability and robustness as well as their speed and ease of implementation, as well as applicability. For example, the Newton-Raphson method can be applied to systems of nonlinear equations \R^n\to\R^n and can converge very fast, while bisection is extremely reliable, but is much slower and can only be used for a single scalar equation in one variable.

Prerequisites

Calculus.

Example 1

Bisection is extremely robust but relatively slow for solving \R\to\R once we have a<b where f(a) and f(b) have opposite signs.

One simply computes c\gets (a+b)/2 and determines the sign of f(c). One then either updates a\gets c or b\gets c and repeats the process depending on the sign of f(c) to ensure that we again have f(a) and f(b) of opposite signs. Of course, if f(c)=0, we stop. Normally we stop when |a-b|<\epsilon, a pre-determined tolerance.

As long as f is continuous, this method will converge thanks to the intermediate value theorem.

Speed can be improved using so-called bracketing methods such as Dekker's or Brent's method.

Example 2

The so-called Newton-Raphson method is based on the linear approximation f(x)\approx f(x_0)+\nabla f(x_0)(x-x_0) for x\approx x_0.

General discussion