Mode (statistics) · Lablypedia

Like the statistical mean and median, the mode is a summary statistic about the central tendency of a random variable or a population. The numerical value of the mode is the same as that of the mean and median in a normal distribution, but it may be very different in highly skewed distributions.

The mode is not necessarily unique in a given discrete distribution since the probability mass function may take the same maximum value at several points x₁, x₂, etc. The most extreme case occurs in uniform distributions, where all values occur equally frequently.

A mode of a continuous probability distribution is often considered to be any value x at which its probability density function has a locally maximum value. When the probability density function of a continuous distribution has multiple local maxima it is common to refer to all of the local maxima as modes of the distribution, so any peak is a mode. Such a continuous distribution is called multimodal (as opposed to unimodal).

In symmetric unimodal distributions, such as the normal distribution, the mean (if defined), median and mode all coincide. For samples, if it is known that they are drawn from a symmetric unimodal distribution, the sample mean can be used as an estimate of the population mode.

Mode of a sample

The mode of a sample is the element that occurs most often in the collection. For example, the mode of the sample [1, 3, 6, 6, 6, 6, 7, 7, 12, 12, 17] is 6. Given the list of data [1, 1, 2, 4, 4] its mode is not unique. A dataset, in such a case, is said to be bimodal, while a set with more than two modes may be described as multimodal.

For a sample from a continuous distribution, such as [0.935..., 1.211..., 2.430..., 3.668..., 3.874...], the concept is unusable in its raw form, since no two values will be exactly the same, so each value will occur precisely once. In order to estimate the mode of the underlying distribution, the usual practice is to discretize the data by assigning frequency values to intervals of equal distance, as for making a histogram, effectively replacing the values by the midpoints of the intervals they are assigned to. The mode is then the value where the histogram reaches its peak. For small or middle-sized samples the outcome of this procedure is sensitive to the choice of interval width if chosen too narrow or too wide; typically one should have a sizable fraction of the data concentrated in a relatively small number of intervals (5 to 10), while the fraction of the data falling outside these intervals is also sizable. An alternate approach is kernel density estimation, which essentially blurs point samples to produce a continuous estimate of the probability density function which can provide an estimate of the mode.

The following MATLAB (or Octave) code example computes the mode of a sample:

<span id="mwRQ"></span><span class="n" id="mwRg">X</span><span class="w" id="mwRw"> </span><span class="p" id="mwSA">=</span><span class="w" id="mwSQ"> </span><span class="nb" id="mwSg">sort</span><span class="p" id="mwSw">(</span><span class="n" id="mwTA">x</span><span class="p" id="mwTQ">);</span><span class="w" id="mwTg"> </span><span class="c" id="mwTw">% x is a column vector dataset</span> <span class="n" id="mwUA">indices</span><span class="w" id="mwUQ"> </span><span class="p" id="mwUg">=</span><span class="w" id="mwUw"> </span><span class="nb" id="mwVA">find</span><span class="p" id="mwVQ">(</span><span class="nb" id="mwVg">diff</span><span class="p" id="mwVw">([</span><span class="n" id="mwWA">X</span><span class="p" id="mwWQ">,</span><span class="w" id="mwWg"> </span><span class="nb" id="mwWw">realmax</span><span class="p" id="mwXA">])</span><span class="w" id="mwXQ"> </span><span class="o" id="mwXg">></span><span class="w" id="mwXw"> </span><span class="mi" id="mwYA">0</span><span class="p" id="mwYQ">);</span><span class="w" id="mwYg"> </span><span class="c" id="mwYw">% indices where repeated values change</span> <span class="p" id="mwZA">[</span><span class="n" id="mwZQ">modeL</span><span class="p" id="mwZg">,</span><span class="nb" id="mwZw">i</span><span class="p" id="mwaA">]</span><span class="w" id="mwaQ"> </span><span class="p" id="mwag">=</span><span class="w" id="mwaw"> </span><span class="nb" id="mwbA">max</span><span class="w" id="mwbQ"> </span><span class="p" id="mwbg">(</span><span class="nb" id="mwbw">diff</span><span class="p" id="mwcA">([</span><span class="mi" id="mwcQ">0</span><span class="p" id="mwcg">,</span><span class="w" id="mwcw"> </span><span class="n" id="mwdA">indices</span><span class="p" id="mwdQ">]));</span><span class="w" id="mwdg"> </span><span class="c" id="mwdw">% longest persistence length of repeated values</span> <span class="nb" id="mweA">mode</span><span class="w" id="mweQ"> </span><span class="p" id="mweg">=</span><span class="w" id="mwew"> </span><span class="n" id="mwfA">X</span><span class="p" id="mwfQ">(</span><span class="n" id="mwfg">indices</span><span class="p" id="mwfw">(</span><span class="nb" id="mwgA">i</span><span class="p" id="mwgQ">));</span>

The algorithm requires as a first step to sort the sample in ascending order. It then computes the discrete derivative of the sorted list and finds the indices where this derivative is positive. Next it computes the discrete derivative of this set of indices, locating the maximum of this derivative of indices, and finally evaluates the sorted sample at the point where that maximum occurs, which corresponds to the last member of the stretch of repeated values.

3 more chapters are free with a Lably account.

Comparison of mean, median and mode

Use

Unlike mean and median, the concept of mode also makes sense for "nominal data" (i.e., not consisting of numerical values in the case of mean, or even of ordered values in the case of median). For example, taking a sample of Korean family names, one might find that "Kim" occurs more often than any other name. Then "Kim" would be the mode of the sample. In any voting system where a plurality determines victory, a single modal value determines the victor, while a multi-modal outcome would require some tie-breaking procedure to take place.

Unlike median, the concept of mode makes sense for any random variable assuming values from a vector space, including the real numbers (a one-dimensional vector space) and the integers (which can be considered embedded in the reals). For example, a distribution of points in the plane will typically have a mean and a mode, but the concept of median does not apply. The median makes sense when there is a linear order on the possible values. Generalizations of the concept of median to higher-dimensional spaces are the geometric median and the centerpoint.

Uniqueness and definedness

For some probability distributions, the expected value may be infinite or undefined, but if defined, it is unique. The mean of a (finite) sample is always defined. The median is the value such that the fractions not exceeding it and not falling below it are each at least 1/2. It is not necessarily unique, but never infinite or totally undefined. For a data sample it is the "halfway" value when the list of values is ordered in increasing value, where usually for a list of even length the numerical average is taken of the two values closest to "halfway". Finally, as said before, the mode is not necessarily unique. Certain pathological distributions (for example, the Cantor distribution) have no defined mode at all. For a finite data sample, the mode is one (or more) of the values in the sample.

Properties

Assuming definedness, and for simplicity uniqueness, the following are some of the most interesting properties.

All three measures have the following property: If the random variable (or each value from the sample) is subjected to the linear or affine transformation, which replaces X by aX + b, so are the mean, median and mode.
Except for extremely small samples, the mode is insensitive to "outliers" (such as occasional, rare, false experimental readings). The median is also very robust in the presence of outliers, while the mean is rather sensitive.
In continuous unimodal distributions the median often lies between the mean and the mode, about one third of the way going from mean to mode. In a formula, median ≈ (2 × mean + mode)/3. This rule, due to Karl Pearson, often applies to slightly non-symmetric distributions that resemble a normal distribution, but it is not always true and in general the three statistics can appear in any order.
For unimodal distributions, the mode is within √3 standard deviations of the mean, and the root mean square deviation about the mode is between the standard deviation and twice the standard deviation.

Example for a skewed distribution

An example of a skewed distribution is personal wealth: Few people are very rich, but among those some are extremely rich. However, many are rather poor.

A well-known class of distributions that can be arbitrarily skewed is given by the log-normal distribution. It is obtained by transforming a random variable X having a normal distribution into random variable Y = e^X. Then the logarithm of random variable Y is normally distributed, hence the name.

Taking the mean μ of X to be 0, the median of Y will be 1, independent of the standard deviation σ of X. This is so because X has a symmetric distribution, so its median is also 0. The transformation from X to Y is monotonic, and so we find the median e⁰ = 1 for Y.

When X has standard deviation σ = 0.25, the distribution of Y is weakly skewed. Using formulas for the log-normal distribution, we find: $\begin{aligned} mean & = e^{μ + σ^{2} / 2} & = e^{0 + {0.25}^{2} / 2} & \approx 1.032 \\ mode & = e^{μ - σ^{2}} & = e^{0 - {0.25}^{2}} & \approx 0.939 \\ median & = e^{μ} & = e^{0} & = 1 \end{aligned}$ Indeed, the median is about one third on the way from mean to mode.

When X has a larger standard deviation, σ = 1, the distribution of Y is strongly skewed. Now $\begin{aligned} mean & = e^{μ + σ^{2} / 2} & = e^{0 + 1^{2} / 2} & \approx 1.649 \\ mode & = e^{μ - σ^{2}} & = e^{0 - 1^{2}} & \approx 0.368 \\ median & = e^{μ} & = e^{0} & = 1 \end{aligned}$ Here, Pearson's rule of thumb fails.

Van Zwet condition

Van Zwet derived an inequality which provides sufficient conditions for this inequality to hold. The inequality

$mode \leq median \leq mean$

holds if

$F (median - x) + F (median + x) \geq 1$

for all x where F(⋅) is the cumulative distribution function of the distribution.

Unimodal distributions

It can be shown for a unimodal distribution that the median $\tilde{X}$ and the mean $\bar{X}$ lie within (3/5)^1/2 ≈ 0.7746 standard deviations of each other. In symbols,

$\frac{| \tilde{X} - \bar{X} |}{σ} \leq (3 / 5)^{1 / 2}$

where $| \cdot |$ is the absolute value.

A similar relation holds between the median and the mode: they lie within 3^1/2 ≈ 1.732 standard deviations of each other:

$\frac{| \tilde{X} - m o d e |}{σ} \leq 3^{1 / 2} .$

History

The term mode originates with Karl Pearson in 1895.

Pearson uses the term mode interchangeably with maximum-ordinate. In a footnote he says, "I have found it convenient to use the term mode for the abscissa corresponding to the ordinate of maximum frequency."