Lably
Skip to content

Probability axioms

Foundations of probability theory

  • 3 min read
  • 3 chapters

Related on Lably

Through Measure (mathematics), Sample space and Set theory

The probability axioms do not specify or assume any particular interpretation of probability, but may be motivated by starting from a philosophical definition of probability and arguing that the axioms are satisfied by this definition. For example,

  • Cox's theorem derives the laws of probability based on a "logical" definition of probability as the likelihood or credibility of arbitrary logical propositions.
  • The Dutch book arguments show that rational agents must make bets which are in proportion with a subjective measure of the probability of events.

The third axiom, σ-additivity, is relatively modern, and originates with Lebesgue's measure theory. Some authors replace this with the strictly weaker axiom of finite additivity, which is sufficient to deal with some applications.

Kolmogorov axioms

In order to state the Kolmogorov axioms, the following pieces of data must be specified:

  • The sample space, Ω, which is the set whose members comprise all possible outcomes or elementary events.
  • The space of all events, each of which is some set of outcomes (i.e., some subset of Ω). The event space, F, must be a σ-algebra on Ω.
  • The probability measure P which assigns to each event E∈F its probability, P(E).

Taken together, these assumptions mean that (Ω,F,P) is a measure space. It is additionally assumed that P(Ω)=1, making this triple a probability space.

First axiom

The probability of an event is a non-negative real number. This assumption is implied by the fact that P is a measure on F.

P(E)≥0∀E∈F

Theories which assign negative probability relax the first axiom.

Second axiom

This is the assumption of unit measure: that the probability that one of the elementary events in the entire sample space will occur is 1.P(Ω)=1From this axiom it follows that P(E) is always finite, in contrast with more general measure theory.

Third axiom

This is the assumption of σ-additivity: Any countable sequence of disjoint events (synonymous with mutually exclusive events) E1,E2,… satisfies

P(⋃i=1∞Ei)=∑i=1∞P(Ei).

This property again is implied by the fact that P is a measure. Note that, by taking E1=Ω and Ei=∅ for all i>1, one deduces that P(∅)=0. This in turn shows that σ-additivity implies finite additivity.

Some authors consider merely finitely additive probability spaces, in which case one just needs an algebra of sets, rather than a σ-algebra. Quasiprobability distributions in general relax the third axiom.

Sign in to keep reading

2 more chapters are free with a Lably account.

More in Statistics and probability