Equation solving

Solution sets

The solution set of a given set of equations or inequalities is the set of all its solutions, a solution being a tuple of values, one for each unknown, that satisfies all the equations or inequalities. If the solution set is empty, then there are no values of the unknowns that satisfy simultaneously all equations and inequalities.

For a simple example, consider the equation

${\displaystyle x^2=2.}$

This equation can be viewed as a Diophantine equation, that is, an equation for which only integer solutions are sought. In this case, the solution set is the empty set, since 2 is not the square of an integer. However, if one searches for real solutions, there are two solutions, √2 and –√2; in other words, the solution set is {√2, −√2}.

When an equation contains several unknowns, and when one has several equations with more unknowns than equations, the solution set is often infinite. In this case, the solutions cannot be listed. For representing them, a parametrization is often useful, which consists of expressing the solutions in terms of some of the unknowns or auxiliary variables. This is always possible when all the equations are linear.

Such infinite solution sets can naturally be interpreted as geometric shapes such as lines, curves (see picture), planes, and more generally algebraic varieties or manifolds. In particular, algebraic geometry may be viewed as the study of solution sets of algebraic equations.

Methods of solution

The methods for solving equations generally depend on the type of equation, both the kind of expressions in the equation and the kind of values that may be assumed by the unknowns. The variety in types of equations is large, and so are the corresponding methods. Only a few specific types are mentioned below.

In general, given a class of equations, there may be no known systematic method (algorithm) that is guaranteed to work. This may be due to a lack of mathematical knowledge; some problems were only solved after centuries of effort. But this also reflects that, in general, no such method can exist: some problems are known to be unsolvable by an algorithm, such as Hilbert's tenth problem, which was proved unsolvable in 1970.

For several classes of equations, algorithms have been found for solving them, some of which have been implemented and incorporated in computer algebra systems, but often require no more sophisticated technology than pencil and paper. In some other cases, heuristic methods are known that are often successful but that are not guaranteed to lead to success.

Brute force, trial and error, inspired guess

If the solution set of an equation is restricted to a finite set (as is the case for equations in modular arithmetic, for example), or can be limited to a finite number of possibilities (as is the case with some Diophantine equations), the solution set can be found by brute force, that is, by testing each of the possible values (candidate solutions). It may be the case, though, that the number of possibilities to be considered, although finite, is so huge that an exhaustive search is not practically feasible; this is, in fact, a requirement for strong encryption methods.

As with all kinds of problem solving, trial and error may sometimes yield a solution, in particular where the form of the equation, or its similarity to another equation with a known solution, may lead to an "inspired guess" at the solution. If a guess, when tested, fails to be a solution, consideration of the way in which it fails may lead to a modified guess.

Elementary algebra

Equations involving linear or simple rational functions of a single real-valued unknown, say x, such as

${\displaystyle 8x+7=4x+35\text{or}\frac{4x+9}{3x+4}=2,}$

can be solved using the methods of elementary algebra.

Systems of linear equations

Smaller systems of linear equations can be solved likewise by methods of elementary algebra. For solving larger systems, algorithms are used that are based on linear algebra. See Gaussian elimination and numerical solution of linear systems.

Polynomial equations

Polynomial equations of degree up to four can be solved exactly using algebraic methods, of which the quadratic formula is the simplest example. Polynomial equations with a degree of five or higher require in general numerical methods (see below) or special functions such as Bring radicals, although some specific cases may be solvable algebraically, for example

${\displaystyle 4x^5-x^3-3=0}$

(by using the rational root theorem), and

${\displaystyle x^6-5x^3+6=0,}$

(by using the substitution x = z^1⁄3, which simplifies this to a quadratic equation in z).

Diophantine equations

In Diophantine equations the solutions are required to be integers. In some cases a brute force approach can be used, as mentioned above. In some other cases, in particular if the equation is in one unknown, it is possible to solve the equation for rational-valued unknowns (see Rational root theorem), and then find solutions to the Diophantine equation by restricting the solution set to integer-valued solutions. For example, the polynomial equation

${\displaystyle 2x^5-5x^4-x^3-7x^2+2x+3=0}$

has as rational solutions x = −⁠1/2⁠ and x = 3, and so, viewed as a Diophantine equation, it has the unique solution x = 3.

In general, however, Diophantine equations are among the most difficult equations to solve.

Inverse functions

In the simple case of a function of one variable, say, h(x), we can solve an equation of the form h(x) = c for some constant c by considering what is known as the inverse function of h.

Given a function h : A → B, the inverse function, denoted h⁻¹ and defined as h⁻¹ : B → A, is a function such that

${\displaystyle h^{-1}(h(x))=h(h^{-1}(x))=x.}$

Now, if we apply the inverse function to both sides of h(x) = c, where c is a constant value in B, we obtain

${\displaystyle \begin{array}{cc}{h}^{-1}(h(x))& =h^{-1}(c)\\ x& =h^{-1}(c)\end{array}}$

and we have found the solution to the equation. However, depending on the function, the inverse may be difficult to be defined, or may not be a function on all of the set B (only on some subset), and have many values at some point.

If just one solution will do, instead of the full solution set, it is actually sufficient if only the functional identity

${\displaystyle h\left(h^{-1}(x)\right)=x}$

holds. For example, the projection π₁ : R² → R defined by π₁(x, y) = x has no post-inverse, but it has a pre-inverse π⁻¹
₁ defined by π⁻¹
₁(x) = (x, 0). Indeed, the equation π₁(x, y) = c is solved by

${\displaystyle (x,y)={\pi }_1^{-1}(c)=(c,0).}$

Examples of inverse functions include the nth root (inverse of xⁿ); the logarithm (inverse of a^x); the inverse trigonometric functions; and Lambert's W function (inverse of xe^x).

Factorization

If the left-hand side expression of an equation P = 0 can be factorized as P = QR, the solution set of the original solution consists of the union of the solution sets of the two equations Q = 0 and R = 0. For example, the equation

${\displaystyle \tan x+\cot x=2}$

can be rewritten, using the identity tan x cot x = 1 as

${\displaystyle \frac{{\tan }^{2}x-2\tan x+1}{\tan x}=0,}$

which can be factorized into

${\displaystyle \frac{{\left(\tan x-1\right)}^2}{\tan x}=0.}$

The solutions are thus the solutions of the equation tan x = 1, and are thus the set

${\displaystyle x=\frac{\pi }{4}+k\pi ,k=0,\pm 1,\pm 2,\dots .}$

Numerical methods

With more complicated equations in real or complex numbers, simple methods to solve equations can fail. Often, root-finding algorithms like the Newton–Raphson method can be used to find a numerical solution to an equation, which, for some applications, can be entirely sufficient to solve some problem. There are also numerical methods for systems of linear equations.

Matrix equations

Equations involving matrices and vectors of real numbers can often be solved by using methods from linear algebra.

Differential equations

There is a vast body of methods for solving various kinds of differential equations, both numerically and analytically. A particular class of problem that can be considered to belong here is integration, and the analytic methods for solving this kind of problems are now called symbolic integration. Solutions of differential equations can be implicit or explicit.