Intuitionistic type theory

Type theory

A type theory is a kind of mathematical ontology, or foundation, describing the fundamental objects that exist. In the standard foundation, set theory combined with mathematical logic, the fundamental object is the set, which is a container that contains elements. In type theory, the fundamental object is the term, each of which belongs to one and only one type.

Intuitionistic type theory has three finite types, which are then composed using five different type constructors. Unlike set theories, type theories are not built on top of a logic like Frege's. So, each feature of the type theory does double duty as a feature of both math and logic.

0 type, 1 type and 2 type

There are three finite types: The 0 type contains no terms. The 1 type contains one canonical term. The 2 type contains two canonical terms.

Because the 0 type contains no terms, it is also called the empty type. It is used to represent anything that cannot exist. It is also written ${\displaystyle \mathrm{\perp }}$ and represents anything unprovable (that is, a proof of it cannot exist). As a result, negation is defined as a function to it: ${\displaystyle \mathrm{\neg }A:=A\to \mathrm{\perp }}$.

Likewise, the 1 type contains one canonical term and represents existence. It also is called the unit type.

Finally, the 2 type contains two canonical terms. It represents a definite choice between two values. It is used for Boolean values but not propositions.

Propositions are instead represented by particular types. For instance, a true proposition can be represented by the 1 type, while a false proposition can be represented by the 0 type. But we cannot assert that these are the only propositions, i.e. the law of excluded middle does not hold for propositions in intuitionistic type theory.

Σ type constructor

Σ-types contain ordered pairs. As with typical ordered pair (or 2-tuple) types, a Σ-type can describe the Cartesian product, ${\displaystyle A\times B}$, of two other types, ${\displaystyle A}$ and ${\displaystyle B}$. Logically, such an ordered pair would hold a proof of ${\displaystyle A}$ and a proof of ${\displaystyle B}$, so one may see such a type written as ${\displaystyle A\wedge B}$.

Σ-types are more powerful than typical ordered pair types because of dependent typing. In the ordered pair, the type of the second term can depend on the value of the first term. For example, the first term of the pair might be a natural number and the second term's type might be a sequence of reals of length equal to the first term. Such a type would be written:

$${\displaystyle \sum _{n:\mathbb{N}}\mathrm{Vec}(\mathbb{R},n)}$$

Using set-theory terminology, this is similar to an indexed disjoint union of sets. In the case of the usual cartesian product, the type of the second term does not depend on the value of the first term. Thus the type describing the cartesian product ${\displaystyle \mathbb{N}\times \mathbb{R}}$ is written:

$${\displaystyle \sum _{n:\mathbb{N}}\mathbb{R}}$$

The value of the first term, ${\displaystyle n}$, is not dependent on the type of the second term, ${\displaystyle \mathbb{R}}$.

Σ-types can be used to build up longer dependently-typed tuples used in mathematics and the records or structs used in most programming languages. An example of a dependently-typed 3-tuple is two integers and a proof that the first integer is smaller than the second integer, described by the type:

$${\displaystyle \sum _{m:\mathbb{Z}}\sum _{n:\mathbb{Z}}((m<n)=\text{True})}$$

Dependent typing allows Σ-types to serve the role of existential quantifier. The statement "there exists an ${\displaystyle n}$ of type ${\displaystyle \mathbb{N}}$, such that ${\displaystyle P(n)}$ is proven" becomes the type of ordered pairs where the first item is the value ${\displaystyle n}$ of type ${\displaystyle \mathbb{N}}$ and the second item is a proof of ${\displaystyle P(n)}$. Notice that the type of the second item (proofs of ${\displaystyle P(n)}$) depends on the value in the first part of the ordered pair (${\displaystyle n}$). Its type would be:

$${\displaystyle \sum _{n:\mathbb{N}}P(n)}$$

Π type constructor

Π-types contain functions. As with typical function types, they consist of an input type and an output type. They are more powerful than typical function types however, in that the return type can depend on the input value. Functions in type theory are different from set theory. In set theory, you look up the argument's value in a set of ordered pairs. In type theory, the argument is substituted into a term and then computation ("reduction") is applied to the term.

As an example, the type of a function that, given a natural number ${\displaystyle n}$, returns a vector containing ${\displaystyle n}$ real numbers is written:

$${\displaystyle \prod _{n:\mathbb{N}}\mathrm{Vec}(\mathbb{R},n)}$$

When the output type does not depend on the input value, the function type is often simply written with a ${\displaystyle \to }$. Thus, ${\displaystyle \mathbb{N}\to \mathbb{R}}$ is the type of functions from natural numbers to real numbers. Such Π-types correspond to logical implication. The logical proposition ${\displaystyle A⟹B}$ corresponds to the type ${\displaystyle A\to B}$, containing functions that take proofs-of-A and return proofs-of-B. This type could be written more consistently as:

$${\displaystyle \prod _{a:A}B}$$

Π-types are also used in logic for universal quantification. The statement "for every ${\displaystyle n}$ of type ${\displaystyle \mathbb{N}}$, ${\displaystyle P(n)}$ is proven" becomes a function from ${\displaystyle n}$ of type ${\displaystyle \mathbb{N}}$ to proofs of ${\displaystyle P(n)}$. Thus, given the value for ${\displaystyle n}$ the function generates a proof that ${\displaystyle P(\cdot )}$ holds for that value. The type would be

$${\displaystyle \prod _{n:\mathbb{N}}P(n)}$$

= type constructor

=-types are created from two terms. Given two terms like ${\displaystyle 2+2}$ and ${\displaystyle 2\cdot 2}$, you can create a new type ${\displaystyle 2+2=2\cdot 2}$. The terms of that new type represent proofs that the pair reduce to the same canonical term. Thus, since both ${\displaystyle 2+2}$ and ${\displaystyle 2\cdot 2}$ compute to the canonical term ${\displaystyle 4}$, there will be a term of the type ${\displaystyle 2+2=2\cdot 2}$. In intuitionistic type theory, there is a single way to introduce =-types and that is by reflexivity:

$${\displaystyle \mathrm{refl}:\prod _{a:A}(a=a).}$$

It is possible to create =-types such as ${\displaystyle 1=2}$ where the terms do not reduce to the same canonical term, but you will be unable to create terms of that new type. In fact, if you were able to create a term of ${\displaystyle 1=2}$, you could create a term of ${\displaystyle \mathrm{\perp }}$. Putting that into a function would generate a function of type ${\displaystyle 1=2\to \mathrm{\perp }}$. Since ${\displaystyle \dots \to \mathrm{\perp }}$ is how intuitionistic type theory defines negation, you would have ${\displaystyle \mathrm{\neg }(1=2)}$ or, finally, ${\displaystyle 1\ne 2}$.

Equality of proofs is an area of active research in proof theory and has led to the development of homotopy type theory and other type theories.

Inductive types

Inductive types allow the creation of complex, self-referential types. For example, a linked list of natural numbers is either an empty list or a pair of a natural number and another linked list. Inductive types can be used to define unbounded mathematical structures like trees, graphs, etc.. In fact, the natural numbers type may be defined as an inductive type, either being ${\displaystyle 0}$ or the successor of another natural number.

Inductive types define new constants, such as zero ${\displaystyle 0:\mathbb{N}}$ and the successor function ${\displaystyle S:\mathbb{N}\to \mathbb{N}}$. Since ${\displaystyle S}$ does not have a definition and cannot be evaluated using substitution, terms like ${\displaystyle S0}$ and ${\displaystyle SSS0}$ become the canonical terms of the natural numbers.

Proofs on inductive types are made possible by induction. Each new inductive type comes with its own inductive rule. To prove a predicate ${\displaystyle P(\cdot )}$ for every natural number, you use the following rule:

$${\displaystyle \mathbb{N}\text{-}\mathrm{e}\mathrm{l}\mathrm{i}\mathrm{m}:P(0)\to \left(\prod _{n:\mathbb{N}}P(n)\to P(S(n))\right)\to \prod _{n:\mathbb{N}}P(n)}$$

Inductive types in intuitionistic type theory are defined in terms of W-types, the type of well-founded trees. Later work in type theory generated coinductive types, induction-recursion, and induction-induction for working on types with more obscure kinds of self-referentiality. Higher inductive types allow equality to be defined between terms.

Universe types

The universe types allow proofs to be written about all the types created with the other type constructors. Every term in the universe type ${\displaystyle {\mathcal{U}}_0}$ can be mapped to a type created with any combination of ${\displaystyle 0,1,2,\mathrm{\Sigma },\mathrm{\Pi },=,}$ and the inductive type constructor. However, to avoid paradoxes, there is no term in ${\displaystyle {\mathcal{U}}_n}$ that maps to ${\displaystyle {\mathcal{U}}_n}$ for any ${\displaystyle \mathcal{n}\in \mathbb{N}}$.

To write proofs about all "the small types" and ${\displaystyle {\mathcal{U}}_0}$, you must use ${\displaystyle {\mathcal{U}}_1}$, which does contain a term for ${\displaystyle {\mathcal{U}}_0}$, but not for itself ${\displaystyle {\mathcal{U}}_1}$. Similarly, for ${\displaystyle {\mathcal{U}}_2}$. There is a predicative hierarchy of universes, so to quantify a proof over any fixed constant ${\displaystyle k}$ universes, you can use ${\displaystyle {\mathcal{U}}_{k+1}}$.

Universe types are a tricky feature of type theories. Martin-Löf's original type theory had to be changed to account for Girard's paradox. Later research covered topics such as "super universes", "Mahlo universes", and impredicative universes.

Judgements

The formal definition of intuitionistic type theory is written using judgements. For example, in the statement "if ${\displaystyle A}$ is a type and ${\displaystyle B}$ is a type then ${\displaystyle \sum _{a:A}B}$ is a type" there are judgements of "is a type", "and", and "if ... then ...". The expression ${\displaystyle \sum _{a:A}B}$ is not a judgement; it is the type being defined.

This second level of the type theory can be confusing, particularly where it comes to equality. There is a judgement of term equality, which might say ${\displaystyle 4=2+2}$. It is a statement that two terms reduce to the same canonical term. There is also a judgement of type equality, say that ${\displaystyle A=B}$, which means every element of ${\displaystyle A}$ is an element of the type ${\displaystyle B}$ and vice versa. At the type level, there is a type ${\displaystyle 4=2+2}$ and it contains terms if there is a proof that ${\displaystyle 4}$ and ${\displaystyle 2+2}$ reduce to the same value. (Terms of this type are generated using the term-equality judgement.) Lastly, there is an English-language level of equality, because we use the word "four" and symbol "${\displaystyle 4}$" to refer to the canonical term ${\displaystyle SSSS0}$. Synonyms like these are called "definitionally equal" by Martin-Löf.

The description of judgements below is based on the discussion in Nordström, Petersson, and Smith.

The formal theory works with types and objects.

A type is declared by:

• ${\displaystyle A\mathsf{T}\mathsf{y}\mathsf{p}\mathsf{e}}$

An object exists and is in a type if:

• ${\displaystyle a:A}$

Objects can be equal

• ${\displaystyle a=b}$

and types can be equal

• ${\displaystyle A=B}$

A type that depends on an object from another type is declared

• ${\displaystyle (x:A)B}$

and removed by substitution

• ${\displaystyle B[x/a]}$, replacing the variable ${\displaystyle x}$ with the object ${\displaystyle a}$ in ${\displaystyle B}$.

An object that depends on an object from another type can be done two ways. If the object is "abstracted", then it is written

• ${\displaystyle [x]b}$

and removed by substitution

• ${\displaystyle b[x/a]}$, replacing the variable ${\displaystyle x}$ with the object ${\displaystyle a}$ in ${\displaystyle b}$.

The object-depending-on-object can also be declared as a constant as part of a recursive type. An example of a recursive type is:

• ${\displaystyle 0:\mathbb{N}}$
• ${\displaystyle S:\mathbb{N}\to \mathbb{N}}$

Here, ${\displaystyle S}$ is a constant object-depending-on-object. It is not associated with an abstraction. Constants like ${\displaystyle S}$ can be removed by defining equality. Here the relationship with addition is defined using equality and using pattern matching to handle the recursive aspect of ${\displaystyle S}$:

${\displaystyle \begin{array}{cc}\mathrm{add}& :(\mathbb{N}\times \mathbb{N})\to \mathbb{N}\\ \mathrm{add}(0,b)& =b\\ \mathrm{add}(S(a),b)& =S(\mathrm{add}(a,b)))\end{array}}$

${\displaystyle S}$ is manipulated as an opaque constant - it has no internal structure for substitution.

So, objects and types and these relations are used to express formulae in the theory. The following styles of judgements are used to create new objects, types and relations from existing ones:

By convention, there is a type that represents all other types. It is called ${\displaystyle \mathcal{U}}$ (or ${\displaystyle \mathrm{Set}}$). Since ${\displaystyle \mathcal{U}}$ is a type, the members of it are objects. There is a dependent type ${\displaystyle \mathrm{El}}$ that maps each object to its corresponding type. In most texts ${\displaystyle \mathrm{El}}$ is never written. From the context of the statement, a reader can almost always tell whether ${\displaystyle A}$ refers to a type, or whether it refers to the object in ${\displaystyle \mathcal{U}}$ that corresponds to the type.

This is the complete foundation of the theory. Everything else is derived.

To implement logic, each proposition is given its own type. The objects in those types represent the different possible ways to prove the proposition. If there is no proof for the proposition, then the type has no objects in it. Operators like "and" and "or" that work on propositions introduce new types and new objects. So ${\displaystyle A\times B}$ is a type that depends on the type ${\displaystyle A}$ and the type ${\displaystyle B}$. The objects in that dependent type are defined to exist for every pair of objects in ${\displaystyle A}$ and ${\displaystyle B}$. If either ${\displaystyle A}$ or ${\displaystyle B}$ have no proof and is an empty type, then the new type representing ${\displaystyle A\times B}$ is also empty.

This can be done for other types (booleans, natural numbers, etc.) and their operators.

Categorical models of type theory

Using the language of category theory, R. A. G. Seely introduced the notion of a locally cartesian closed category (LCCC) as the basic model of type theory. This has been refined by Hofmann and Dybjer to Categories with Families or Categories with Attributes based on earlier work by Cartmell.

Extensional versus intensional

A fundamental distinction is extensional vs intensional type theory. In extensional type theory, definitional (i.e., computational) equality is not distinguished from propositional equality, which requires proof. As a consequence type checking becomes undecidable in extensional type theory because programs in the theory might not terminate. For example, such a theory allows one to give a type to the Y-combinator; a detailed example of this can be found in Nordstöm and Petersson Programming in Martin-Löf's Type Theory. However, this does not prevent extensional type theory from being a basis for a practical tool; for example, Nuprl is based on extensional type theory.

In contrast, in intensional type theory type checking is decidable, but the representation of standard mathematical concepts is somewhat more cumbersome, since intensional reasoning requires using setoids or similar constructions. There are many common mathematical objects that are hard to work with or cannot be represented without this, for example, integer numbers, rational numbers, and real numbers. Integers and rational numbers can be represented without setoids, but this representation is difficult to work with. Cauchy real numbers cannot be represented without this.

Homotopy type theory works on resolving this problem. It allows one to define higher inductive types, which not only define first-order constructors (values or points), but higher-order constructors, i.e. equalities between elements (paths), equalities between equalities (homotopies), ad infinitum.

Implementations of type theory

Different forms of type theory have been implemented as the formal systems underlying a number of proof assistants. While many are based on Per Martin-Löf's ideas, many have added features, more axioms, or a different philosophical background. For instance, the Nuprl system is based on computational type theory and Rocq is based on the calculus of (co)inductive constructions. Dependent types also feature in the design of programming languages such as ATS, Cayenne, Epigram, Agda, and Idris.

Martin-Löf type theories

Per Martin-Löf constructed several type theories that were published at various times, some of them much later than when the preprints with their description became accessible to specialists (among others Jean-Yves Girard and Giovanni Sambin). The list below attempts to list all the theories that have been described in a printed form and to sketch the key features that distinguished them from each other. All of these theories had dependent products, dependent sums, disjoint unions, finite types and natural numbers. All the theories had the same reduction rules that did not include η-reduction either for dependent products or for dependent sums, except for MLTT79 where the η-reduction for dependent products is added.

MLTT71 was the first type theory created by Per Martin-Löf. It appeared in a preprint in 1971. It had one universe, but this universe had a name in itself, i.e., it was a type theory with, as it is called today, "Type in Type". Jean-Yves Girard has shown that this system was inconsistent, and the preprint was never published.

MLTT72 was presented in a 1972 preprint that has now been published. That theory had one universe V and no identity types (=-types). The universe was "predicative" in the sense that the dependent product of a family of objects from V over an object that was not in V such as, for example, V itself, was not assumed to be in V. The universe was à la Russell's Principia Mathematica, i.e., one would write directly "T∈V" and "t∈T" (Martin-Löf uses the sign "∈" instead of modern ":") without an added constructor such as "El".

MLTT73 was the first definition of a type theory that Per Martin-Löf published (it was presented at the Logic Colloquium '73 and published in 1975). There are identity types, which he describes as "propositions", but since no real distinction between propositions and the rest of the types is introduced the meaning of this is unclear. There is what later acquires the name of J-eliminator but yet without a name (see pp. 94–95). There is in this theory an infinite sequence of universes V₀, ..., V_n, ... . The universes are predicative, à la Russell and non-cumulative. In fact, Corollary 3.10 on p. 115 says that if A∈V_m and B∈V_n are such that A and B are convertible then m = n.

MLTT79 was presented in 1979 and published in 1982. In this paper, Martin-Löf introduced the four basic types of judgement for the dependent type theory that has since become fundamental in the study of the meta-theory of such systems. He also introduced contexts as a separate concept in it (see p. 161). There are identity types with the J-eliminator (which already appeared in MLTT73 but did not have this name there) but also with the rule that makes the theory "extensional" (p. 169). There are W-types. There is an infinite sequence of predicative universes that are cumulative.

Bibliopolis: there is a discussion of a type theory in the Bibliopolis book from 1984, but it is somewhat open-ended and does not seem to represent a particular set of choices and so there is no specific type theory associated with it.