Ordinal data

Ways to analyse ordinal data

Ordinal data analysis requires a different set of analyses than other qualitative variables. These methods incorporate the natural ordering of the variables in order to avoid loss of power. Computing the mean of a sample of ordinal data is discouraged; other measures of central tendency, including the median or mode, are generally more appropriate.

General

Stevens (1946) argued that, because the assumption of equal distance between categories does not hold for ordinal data, the use of means and standard deviations for description of ordinal distributions and of inferential statistics based on means and standard deviations was not appropriate. Instead, positional measures like the median and percentiles, in addition to descriptive statistics appropriate for nominal data (number of cases, mode, contingency correlation), should be used. Nonparametric methods have been proposed as the most appropriate procedures for inferential statistics involving ordinal data (e.g, Kendall's W, Spearman's rank correlation coefficient, etc.), especially those developed for the analysis of ranked measurements. However, the use of parametric statistics for ordinal data may be permissible with certain caveats to take advantage of the greater range of available statistical procedures.

Univariate statistics

In place of means and standard deviations, univariate statistics appropriate for ordinal data include the median, other percentiles (such as quartiles and deciles), and the quartile deviation. One-sample tests for ordinal data include the Kolmogorov-Smirnov one-sample test, the one-sample runs test, and the change-point test.

Bivariate statistics

In lieu of testing differences in means with t-tests, differences in distributions of ordinal data from two independent samples can be tested with Mann-Whitney, runs, Smirnov, and signed-ranks tests. Test for two related or matched samples include the sign test and the Wilcoxon signed ranks test. Analysis of variance with ranks and the Jonckheere test for ordered alternatives can be conducted with ordinal data in place of independent samples ANOVA. Tests for more than two related samples includes the Friedman two-way analysis of variance by ranks and the Page test for ordered alternatives. Correlation measures appropriate for two ordinal-scaled variables include Kendall's tau, gamma, r_s, and d_yx/d_xy.

Regression applications

Ordinal data can be considered as a quantitative variable. In logistic regression, the equation

${\displaystyle \mathrm{logit}[P(Y=1)]=\alpha +{\beta }_{1}c+{\beta }_{2}x}$

is the model and c takes on the assigned levels of the categorical scale. In regression analysis, outcomes (dependent variables) that are ordinal variables can be predicted using a variant of ordinal regression, such as ordered logit or ordered probit.

In multiple regression/correlation analysis, ordinal data can be accommodated using power polynomials and through normalization of scores and ranks.

Linear trends

Linear trends are also used to find associations between ordinal data and other categorical variables, normally in a contingency tables. A correlation r is found between the variables where r lies between -1 and 1. To test the trend, a test statistic:

${\displaystyle M^2=(n-1)r^2}$

is used where n is the sample size.

R can be found by letting ${\displaystyle u_1\le u_2\le ...\le u_I}$ be the row scores and ${\displaystyle v_1\le v_2\le ...\le v_I}$ be the column scores. Let ${\displaystyle \overline{u}=\sum _i{u}_i{p}_{i+}}$ be the mean of the row scores while ${\displaystyle \overline{v}=\sum _j{v}_j{p}_{j+}}$. Then ${\displaystyle p_{i+}}$ is the marginal row probability and ${\displaystyle p_{+j}}$ is the marginal column probability. R is calculated by:

${\displaystyle r=\frac{\sum _{i,j}\left(u_i-\overline{u}\right)\left(v_j-\overline{v}\right)p_{ij}}{\sqrt{{\left[\sum _i(u_i-\overline{u}\right)}^2{p}_{i+}][\sum _j(v_j-\overline{v}{)}^2{p}_{+j}]}}}$

Classification methods

Classification methods have also been developed for ordinal data. The data are divided into different categories such that each observation is similar to others. Dispersion is measured and minimized in each group to maximize classification results. The dispersion function is used in information theory.

Statistical models for ordinal data

There are several different models that can be used to describe the structure of ordinal data. Four major classes of model are described below, each defined for a random variable ${\displaystyle Y}$, with levels indexed by ${\displaystyle k=1,2,\dots ,q}$.

Note that in the model definitions below, the values of ${\displaystyle {\mu }_k}$ and ${\displaystyle \beta }$ will not be the same for all the models for the same set of data, but the notation is used to compare the structure of the different models.

Proportional odds model

The most commonly used model for ordinal data is the proportional odds model, defined by

${\displaystyle \log \left[\frac{Pr(Y\le k)}{Pr(Y>k)}\right]=\log \left[\frac{Pr(Y\le k)}{1-Pr(Y\le k)}\right]={\mu }_k+{\beta }^T\mathbf{x}}$

where the parameters ${\displaystyle {\mu }_k}$ describe the base distribution of the ordinal data, ${\displaystyle \mathbf{x}}$ are the covariates and ${\displaystyle \beta }$ are the coefficients describing the effects of the covariates.

This model can be generalized by defining the model using ${\displaystyle {\mu }_k+{\beta }_k^T\mathbf{x}}$ instead of ${\displaystyle {\mu }_k+{\beta }^T\mathbf{x}}$, and this would make the model suitable for nominal data (in which the categories have no natural ordering) as well as ordinal data. However, this generalization can make it much more difficult to fit the model to the data.

Baseline category logit model

The baseline category model is defined by

${\displaystyle \log \left[\frac{Pr(Y=k)}{Pr(Y=1)}\right]={\mu }_k+{\beta }_k^T\mathbf{x}}$

This model does not impose an ordering on the categories and so can be applied to nominal data as well as ordinal data.

Ordered stereotype model

The ordered stereotype model is defined by

${\displaystyle \log \left[\frac{Pr(Y=k)}{Pr(Y=1)}\right]={\mu }_k+{\varphi }_k{\beta }^T\mathbf{x}}$

where the score parameters are constrained such that ${\displaystyle 0={\varphi }_1\le {\varphi }_2\le \cdots \le {\varphi }_q=1}$.

This is a more parsimonious, and more specialised, model than the baseline category logit model: ${\displaystyle {\varphi }_k\beta }$ can be thought of as similar to ${\displaystyle {\beta }_k}$.

The non-ordered stereotype model has the same form as the ordered stereotype model, but without the ordering imposed on ${\displaystyle {\varphi }_k}$. This model can be applied to nominal data.

Note that the fitted scores, ${\displaystyle {\hat{\varphi }}_k}$, indicate how easy it is to distinguish between the different levels of ${\displaystyle Y}$. If ${\displaystyle {\hat{\varphi }}_k\approx {\hat{\varphi }}_{k-1}}$ then that indicates that the current set of data for the covariates ${\displaystyle \mathbf{x}}$ do not provide much information to distinguish between levels ${\displaystyle k}$ and ${\displaystyle k-1}$, but that does not necessarily imply that the actual values ${\displaystyle k}$ and ${\displaystyle k-1}$ are far apart. And if the values of the covariates change, then for that new data the fitted scores ${\displaystyle {\hat{\varphi }}_k}$ and ${\displaystyle {\hat{\varphi }}_{k-1}}$ might then be far apart.

Adjacent categories logit model

The adjacent categories model is defined by

${\displaystyle \log \left[\frac{Pr(Y=k)}{Pr(Y=k+1)}\right]={\mu }_k+{\beta }_k^T\mathbf{x}}$

although the most common form, referred to in Agresti (2010) as the "proportional odds form" is defined by

${\displaystyle \log \left[\frac{Pr(Y=k)}{Pr(Y=k+1)}\right]={\mu }_k+{\beta }^T\mathbf{x}}$

This model can only be applied to ordinal data, since modelling the probabilities of shifts from one category to the next category implies that an ordering of those categories exists.

The adjacent categories logit model can be thought of as a special case of the baseline category logit model, where ${\displaystyle {\beta }_k=\beta (k-1)}$. The adjacent categories logit model can also be thought of as a special case of the ordered stereotype model, where ${\displaystyle {\varphi }_k\propto k-1}$, i.e. the distances between the ${\displaystyle {\varphi }_k}$ are defined in advance, rather than being estimated based on the data.

Comparisons between the models

The proportional odds model has a very different structure to the other three models, and also a different underlying meaning. Note that the size of the reference category in the proportional odds model varies with ${\displaystyle k}$, since ${\displaystyle Y\le k}$ is compared to ${\displaystyle Y>k}$, whereas in the other models the size of the reference category remains fixed, as ${\displaystyle Y=k}$ is compared to ${\displaystyle Y=1}$ or ${\displaystyle Y=k+1}$.

Different link functions

There are variants of all the models that use different link functions, such as the probit link or the complementary log-log link.

Statistical tests

Differences in ordinal data can be tested using rank tests.

Visualization and display

Ordinal data can be visualized in several different ways. Common visualizations are the bar chart or a pie chart. Tables can also be useful for displaying ordinal data and frequencies. Mosaic plots can be used to show the relationship between an ordinal variable and a nominal or ordinal variable. A bump chart—a line chart that shows the relative ranking of items from one time point to the next—is also appropriate for ordinal data.

Color or grayscale gradation can be used to represent the ordered nature of the data. A single-direction scale, such as income ranges, can be represented with a bar chart where increasing (or decreasing) saturation or lightness of a single color indicates higher (or lower) income. The ordinal distribution of a variable measured on a dual-direction scale, such as a Likert scale, could also be illustrated with color in a stacked bar chart. A neutral color (white or gray) might be used for the middle (zero or neutral) point, with contrasting colors used in the opposing directions from the midpoint, where increasing saturation or darkness of the colors could indicate categories at increasing distance from the midpoint. Choropleth maps also use color or grayscale shading to display ordinal data.

Applications

The use of ordinal data can be found in most areas of research where categorical data are generated. Settings where ordinal data are often collected include the social and behavioral sciences and governmental and business settings where measurements are collected from persons by observation, testing, or questionnaires. Some common contexts for the collection of ordinal data include survey research; and intelligence, aptitude, personality testing and decision-making.

Calculation of 'Effect Size' (Cliff's Delta d) using ordinal data has been recommended as a measure of statistical dominance.