Type theory

{{short description|Concept in mathematical logic}}

{{redirect|Theory of types|an architectural term|Form (architecture)#Theories}}

In mathematics and theoretical computer science, a type theory is the formal presentation of a specific type system.{{efn|name=basics|1= See {{section link||Terms and types}} }} Type theory is the academic study of type systems.

Some type theories serve as alternatives to set theory as a foundation of mathematics. Two influential type theories that have been proposed as foundations are:

Most computerized proof-writing systems use a type theory for their foundation. A common one is Thierry Coquand's Calculus of Inductive Constructions.

History

{{Main|History of type theory}}

Type theory was created to avoid a paradox in a mathematical equation{{efn|name= kleeneRosser |1= The Kleene–Rosser paradox "The Inconsistency of Certain Formal Logics" on page 636 Annals of Mathematics 36 number 3 (July 1935), showed that 1=2 . {{Cite journal |first1=S. C. |last1=Kleene |name-list-style=amp |first2=J. B. |last2=Rosser |title=The inconsistency of certain formal logics |journal=Annals of Mathematics |volume=36 |issue=3 |pages=630–636 |year=1935 |doi=10.2307/1968646 |jstor=1968646 }}}} based on naive set theory and formal logic. Russell's paradox (first described in Gottlob Frege's The Foundations of Arithmetic) is that, without proper axioms, it is possible to define the set of all sets that are not members of themselves; this set both contains itself and does not contain itself. Between 1902 and 1908, Bertrand Russell proposed various solutions to this problem.

By 1908, Russell arrived at a ramified theory of types together with an axiom of reducibility, both of which appeared in Whitehead and Russell's Principia Mathematica published in 1910, 1912, and 1913. This system avoided contradictions suggested in Russell's paradox by creating a hierarchy of types and then assigning each concrete mathematical entity to a specific type. Entities of a given type were built exclusively of subtypes of that type,{{efn|name=JuliaSample|1= In Julia's type system, for example, abstract types have no instances, but can have subtype,Balbaert, Ivo (2015) Getting Started With Julia Programming ISBN 978-1-78328-479-5{{rp|110}} whereas concrete types do not have subtypes but can have instances, for "documentation, optimization, and dispatch".docs.julialang.org [https://docs.julialang.org/en/v1/manual/types/ v.1 Types] {{Webarchive|url=https://web.archive.org/web/20220324054245/https://docs.julialang.org/en/v1/manual/types/|date=2022-03-24}}}} thus preventing an entity from being defined using itself. This resolution of Russell's paradox is similar to approaches taken in other formal systems, such as Zermelo-Fraenkel set theory.Stanford Encyclopedia of Philosophy [https://plato.stanford.edu/entries/russell-paradox/#ERP (rev. Mon Oct 12, 2020) Russell’s Paradox] {{Webarchive|url=https://web.archive.org/web/20211218023900/https://plato.stanford.edu/entries/russell-paradox/#ERP|date=December 18, 2021}} 3. Early Responses to the Paradox

Type theory is particularly popular in conjunction with Alonzo Church's lambda calculus. One notable early example of type theory is Church's simply typed lambda calculus. Church's theory of types{{cite journal|author-link=Alonzo Church|first=Alonzo|last=Church|title=A formulation of the simple theory of types|journal=The Journal of Symbolic Logic|volume=5|issue=2|pages=56–68|year=1940|doi=10.2307/2266170|jstor=2266170|s2cid=15889861}} helped the formal system avoid the Kleene–Rosser paradox that afflicted the original untyped lambda calculus. Church demonstrated{{efn|name=logisticMethod|1= Church demonstrated his logistic method with his simple theory of types, and explained his method in 1956,Alonzo Church (1956) [https://archive.org/details/dli.ernet.449121/page/85/mode/2up?q=logistic Introduction To Mathematical Logic Vol 1] pages 47-68.}} that it could serve as a foundation of mathematics and it was referred to as a higher-order logic.

In the modern literature, "type theory" refers to a typed system based around lambda calculus. One influential system is Per Martin-Löf's intuitionistic type theory, which was proposed as a foundation for constructive mathematics. Another is Thierry Coquand's calculus of constructions, which is used as the foundation by Rocq (previously known as Coq), Lean, and other computer proof assistants. Type theory is an active area of research, one direction being the development of homotopy type theory.

Applications

{{Expand section|date=May 2008}}

=Mathematical foundations=

The first computer proof assistant, called Automath, used type theory to encode mathematics on a computer. Martin-Löf specifically developed intuitionistic type theory to encode all mathematics to serve as a new foundation for mathematics. There is ongoing research into mathematical foundations using homotopy type theory.

Mathematicians working in category theory already had difficulty working with the widely accepted foundation of Zermelo–Fraenkel set theory. This led to proposals such as Lawvere's Elementary Theory of the Category of Sets (ETCS).{{nlab|id=ETCS}} Homotopy type theory continues in this line using type theory. Researchers are exploring connections between dependent types (especially the identity type) and algebraic topology (specifically homotopy).

=Proof assistants=

{{main|Proof assistant}}

Much of the current research into type theory is driven by proof checkers, interactive proof assistants, and automated theorem provers. Most of these systems use a type theory as the mathematical foundation for encoding proofs, which is not surprising, given the close connection between type theory and programming languages:

Many type theories are supported by LEGO and Isabelle. Isabelle also supports foundations besides type theories, such as ZFC. Mizar is an example of a proof system that only supports set theory.

=Programming languages=

Any static program analysis, such as the type checking algorithms in the semantic analysis phase of compiler, has a connection to type theory. A prime example is Agda, a programming language which uses UTT (Luo's Unified Theory of dependent Types) for its type system.

The programming language ML was developed for manipulating type theories (see LCF) and its own type system was heavily influenced by them.

=Linguistics=

Type theory is also widely used in formal theories of semantics of natural languages,{{Cite book|last1=Chatzikyriakidis|first1=Stergios|url=https://books.google.com/books?id=iEEUDgAAQBAJ|title=Modern Perspectives in Type-Theoretical Semantics|last2=Luo|first2=Zhaohui|date=2017-02-07|publisher=Springer|isbn=978-3-319-50422-3|language=en|access-date=2022-07-29|archive-date=2023-08-10|archive-url=https://web.archive.org/web/20230810074711/https://books.google.com/books?id=iEEUDgAAQBAJ|url-status=live}}{{Cite book|last=Winter|first=Yoad|url=https://books.google.com/books?id=aDRWDwAAQBAJ&q=%22formal+semantics%22+%22type+theory%22|title=Elements of Formal Semantics: An Introduction to the Mathematical Theory of Meaning in Natural Language|date=2016-04-08|publisher=Edinburgh University Press|isbn=978-0-7486-7777-1|language=en|access-date=2022-07-29|archive-date=2023-08-10|archive-url=https://web.archive.org/web/20230810074717/https://books.google.com/books?id=aDRWDwAAQBAJ&q=%22formal+semantics%22+%22type+theory%22|url-status=live}} especially Montague grammarCooper, Robin. "[http://lecomte.al.free.fr/ressources/PARIS8_LSL/ddl-final.pdf Type theory and semantics in flux] {{Webarchive|url=https://web.archive.org/web/20220510190635/http://lecomte.al.free.fr/ressources/PARIS8_LSL/ddl-final.pdf|date=2022-05-10}}." Handbook of the Philosophy of Science 14 (2012): 271-323. and its descendants. In particular, categorial grammars and pregroup grammars extensively use type constructors to define the types (noun, verb, etc.) of words.

The most common construction takes the basic types e and t for individuals and truth-values, respectively, and defines the set of types recursively as follows:

  • if a and b are types, then so is \langle a,b\rangle;
  • nothing except the basic types, and what can be constructed from them by means of the previous clause are types.

A complex type \langle a,b\rangle is the type of functions from entities of type a to entities of type b. Thus one has types like \langle e,t\rangle which are interpreted as elements of the set of functions from entities to truth-values, i.e. indicator functions of sets of entities. An expression of type \langle\langle e,t\rangle,t\rangle is a function from sets of entities to truth-values, i.e. a (indicator function of a) set of sets. This latter type is standardly taken to be the type of natural language quantifiers, like everybody or nobody (Montague 1973, Barwise and Cooper 1981).Barwise, Jon; Cooper, Robin (1981) [https://philpapers.org/rec/BARGQA Generalized quantifiers and natural language] Linguistics and Philosophy 4 (2):159--219 (1981)

Type theory with records is a formal semantics representation framework, using records to express type theory types. It has been used in natural language processing, principally computational semantics and dialogue systems.{{cite journal|last = Cooper| first = Robin| year = 2005| title = Records and Record Types in Semantic Theory| journal = Journal of Logic and Computation| volume = 15| issue = 2| pages = 99–112| doi = 10.1093/logcom/exi004}}Cooper, Robin (2010). Type theory and semantics in flux. Handbook of the Philosophy of Science. Volume 14: Philosophy of Linguistics. Elsevier.

=Social sciences=

Gregory Bateson introduced a theory of logical types into the social sciences; his notions of double bind and logical levels are based on Russell's theory of types.

Logic

A type theory is a mathematical logic, which is to say it is a collection of rules of inference that result in judgments. Most logics have judgments asserting "The proposition \varphi is true", or "The formula \varphi is a well-formed formula".{{Cite journal |last=Martin-Löf |first=Per |date=1987-12-01 |title=Truth of a proposition, evidence of a judgement, validity of a proof |url=https://doi.org/10.1007/BF00484985 |journal=Synthese |language=en |volume=73 |issue=3 |pages=407–420 |doi=10.1007/BF00484985 |issn=1573-0964}} A type theory has judgments that define types and assign them to a collection of formal objects, known as terms. A term and its type are often written together as \mathrm{term}:\mathsf{type}.

=Terms=

A term in logic is recursively defined as a constant symbol, variable, or a function application, where a term is applied to another term. Constant symbols could include the natural number 0, the Boolean value \mathrm{true}, and functions such as the successor function \mathrm{S} and conditional operator \mathrm{if}. Thus some terms could be 0, (\mathrm{S}\,0), (\mathrm{S}\,(\mathrm{S}\,0)), and (\mathrm{if}\,\mathrm{true}\,0\,(\mathrm{S}\,0)).

=Judgments=

Most type theories have 4 judgments:

Judgments may follow from assumptions. For example, one might say "assuming x is a term of type \mathsf{bool} and y is a term of type \mathsf{nat}, it follows that (\mathrm{if}\,x\,y\,y) is a term of type \mathsf{nat}". Such judgments are formally written with the turnstile symbol \vdash.

x:\mathsf{bool},y:\mathsf{nat}\vdash(\textrm{if}\,x\,y\,y): \mathsf{nat}

If there are no assumptions, there will be nothing to the left of the turnstile.

\vdash \mathrm{S}:\mathsf{nat}\to\mathsf{nat}

The list of assumptions on the left is the context of the judgment. Capital greek letters, such as \Gamma and \Delta, are common choices to represent some or all of the assumptions. The 4 different judgments are thus usually written as follows.

{| class="wikitable"

! Formal notation for judgments !! Description

|- {{anchor|Gamma,IsaType}}

|\Gamma \vdash T Type||T is a type (under assumptions \Gamma).

|- {{anchor|Gamma,IsaTerm}}

|\Gamma \vdash t : T||t is a term of type T (under assumptions \Gamma).

|- {{anchor|Gamma,IsEq}}

|\Gamma \vdash T_1 = T_2 ||Type T_1 is equal to type T_2 (under assumptions \Gamma).

|- {{anchor|Gamma,BothTsAreEq}}

|\Gamma \vdash t_1 = t_2 : T ||Terms t_1 and t_2 are both of type T and are equal (under assumptions \Gamma).

|}

Some textbooks use a triple equal sign \equiv to stress that this is judgmental equality and thus an extrinsic notion of equality.{{Cite book |last=The Univalent Foundations Program |url=https://homotopytypetheory.org/book/ |title=Homotopy Type Theory: Univalent Foundations of Mathematics |publisher=Homotopy Type Theory |year=2013}} The judgments enforce that every term has a type. The type will restrict which rules can be applied to a term.

=Rules of Inference=

A type theory's inference rules say what judgments can be made, based on the existence of other judgments. Rules are expressed as a Gentzen-style deduction using a horizontal line, with the required input judgments above the line and the resulting judgment below the line.{{cite web |last1=Smith |first1=Peter |title=Types of proof system |url=https://www.logicmatters.net/resources/pdfs/ProofSystems.pdf |url-status=live |archive-url=https://ghostarchive.org/archive/20221009/https://www.logicmatters.net/resources/pdfs/ProofSystems.pdf |archive-date=2022-10-09 |access-date=29 December 2021 |website=logicmatters.net}} For example, the following inference rule states a substitution rule for judgmental equality.

\begin{array}{c}

\Gamma\vdash t:T_1 \qquad \Delta\vdash T_1 = T_2 \\

\hline

\Gamma,\Delta\vdash t:T_2

\end{array}

The rules are syntactic and work by rewriting. The metavariables \Gamma, \Delta, t, T_1, and T_2 may actually consist of complex terms and types that contain many function applications, not just single symbols.

To generate a particular judgment in type theory, there must be a rule to generate it, as well as rules to generate all of that rule's required inputs, and so on. The applied rules form a proof tree, where the top-most rules need no assumptions. One example of a rule that does not require any inputs is one that states the type of a constant term. For example, to assert that there is a term 0 of type \mathsf{nat}, one would write the following.

\begin{array}{c}

\hline

\vdash 0 : nat \\

\end{array}

== Type inhabitation ==

{{Main|Type inhabitation}}

Generally, the desired conclusion of a proof in type theory is one of type inhabitation.{{cite book |author1=Henk Barendregt |url=https://books.google.com/books?id=2UVasvrhXl8C |title=Lambda Calculus with Types |author2=Wil Dekkers |author3=Richard Statman |date=20 June 2013 |publisher=Cambridge University Press |isbn=978-0-521-76614-2 |pages=1–66}} The decision problem of type inhabitation (abbreviated by \exists t.\Gamma \vdash t : \tau?) is:

:Given a context \Gamma and a type \tau, decide whether there exists a term t that can be assigned the type \tau in the type environment \Gamma.

Girard's paradox shows that type inhabitation is strongly related to the consistency of a type system with Curry–Howard correspondence. To be sound, such a system must have uninhabited types.

A type theory usually has several rules, including ones to:

  • create a judgment (known as a context in this case)
  • add an assumption to the context (context weakening)
  • rearrange the assumptions
  • use an assumption to create a variable
  • define reflexivity, symmetry and transitivity for judgmental equality
  • define substitution for application of lambda terms
  • list all the interactions of equality, such as substitution
  • define a hierarchy of type universes
  • assert the existence of new types

Also, for each "by rule" type, there are 4 different kinds of rules

  • "type formation" rules say how to create the type
  • "term introduction" rules define the canonical terms and constructor functions, like "pair" and "S".
  • "term elimination" rules define the other functions like "first", "second", and "R".
  • "computation" rules specify how computation is performed with the type-specific functions.

For examples of rules, an interested reader may follow Appendix A.2 of the Homotopy Type Theory book, or read Martin-Löf's Intuitionistic Type Theory.{{Cite web|url=https://hott.github.io/HoTT-2019/images/mltt-rules.pdf|title=Rules to Martin-Löf's Intuitionistic Type Theory|access-date=2022-01-22|archive-date=2021-10-21|archive-url=https://web.archive.org/web/20211021231427/https://hott.github.io/HoTT-2019/images/mltt-rules.pdf|url-status=live}}

Connections to foundations

The logical framework of a type theory bears a resemblance to intuitionistic, or constructive, logic. Formally, type theory is often cited as an implementation of the Brouwer–Heyting–Kolmogorov interpretation of intuitionistic logic. Additionally, connections can be made to category theory and computer programs.

=Intuitionistic logic=

When used as a foundation, certain types are interpreted to be propositions (statements that can be proven), and terms inhabiting the type are interpreted to be proofs of that proposition. When some types are interpreted as propositions, there is a set of common types that can be used to connect them to make a Boolean algebra out of types. However, the logic is not classical logic but intuitionistic logic, which is to say it does not have the law of excluded middle nor double negation.

Under this intuitionistic interpretation, there are common types that act as the logical operators:

{|class="wikitable"

! Logic Name !! Logic Notation !! Type Notation !! Type Name

|-

|True||\top||\top||Unit Type

|-

|False||\bot||\bot||Empty Type

|-

|Implication||A \to B||A \to B||Function

|-

|Not||\neg A||A \to \bot||Function to Empty Type

|-

|And||A \land B||A \times B||Product Type

|-

|Or||A \lor B||A + B||Sum Type

|-

|For All||\forall a \in A, P(a)||\Pi a:A.P(a)||Dependent Product

|-

|Exists||\exists a \in A, P(a)||\Sigma a: A.P(a)||Dependent Sum

|}

Because the law of excluded middle does not hold, there is no term of type \Pi a.A+ (A\to\bot). Likewise, double negation does not hold, so there is no term of type \Pi A.((A\to\bot)\to\bot)\to A.

It is possible to include the law of excluded middle and double negation into a type theory, by rule or assumption. However, terms may not compute down to canonical terms and it will interfere with the ability to determine if two terms are judgementally equal to each other.{{Cn|date=January 2024}}

== Constructive mathematics ==

Per Martin-Löf proposed his intuitionistic type theory as a foundation for constructive mathematics. Constructive mathematics requires when proving "there exists an x with property P(x)", one must construct a particular x and a proof that it has property P. In type theory, existence is accomplished using the dependent product type, and its proof requires a term of that type.

An example of a non-constructive proof is proof by contradiction. The first step is assuming that x does not exist and refuting it by contradiction. The conclusion from that step is "it is not the case that x does not exist". The last step is, by double negation, concluding that x exists. Constructive mathematics does not allow the last step of removing the double negation to conclude that x exists.{{cite web|title=proof by contradiction|url=https://ncatlab.org/nlab/show/proof+by+contradiction|website=nlab|access-date=29 December 2021|archive-date=13 August 2023|archive-url=https://web.archive.org/web/20230813170132/https://ncatlab.org/nlab/show/proof+by+contradiction|url-status=live}}

Most of the type theories proposed as foundations are constructive, and this includes most of the ones used by proof assistants.{{Cn|date=January 2024}} It is possible to add non-constructive features to a type theory, by rule or assumption. These include operators on continuations such as call with current continuation. However, these operators tend to break desirable properties such as canonicity and parametricity.

=Curry-Howard correspondence=

The Curry–Howard correspondence is the observed similarity between logics and programming languages. The implication in logic, "A \to B" resembles a function from type "A" to type "B". For a variety of logics, the rules are similar to expressions in a programming language's types. The similarity goes farther, as applications of the rules resemble programs in the programming languages. Thus, the correspondence is often summarized as "proofs as programs".

The opposition of terms and types can also be viewed as one of implementation and specification. By program synthesis, (the computational counterpart of) type inhabitation can be used to construct (all or parts of) programs from the specification given in the form of type information.

{{cite conference |last1=Heineman |first1=George T. |last2=Bessai |first2=Jan |last3=Düdder |first3=Boris |last4=Rehof |first4=Jakob |year=2016 |title=A long and winding road towards modular synthesis |conference=ISoLA 2016 |series=Lecture Notes in Computer Science |publisher=Springer |volume=9952 |pages=303–317 |doi=10.1007/978-3-319-47166-2_21 |isbn=978-3-319-47165-5 |book-title=Leveraging Applications of Formal Methods, Verification and Validation: Foundational Techniques}}

==Type inference==

{{Main|Type inference}}

Many programs that work with type theory (e.g., interactive theorem provers) also do type inferencing. It lets them select the rules that the user intends, with fewer actions by the user.

=Research areas=

== Category theory ==

Although the initial motivation for category theory was far removed from foundationalism, the two fields turned out to have deep connections. As John Lane Bell writes: "In fact categories can themselves be viewed as type theories of a certain kind; this fact alone indicates that type theory is much more closely related to category theory than it is to set theory." In brief, a category can be viewed as a type theory by regarding its objects as types (or sorts {{Cite journal|last=Barendregt|first=Henk|date=1991|title=Introduction to generalized type systems|journal=Journal of Functional Programming|volume=1|issue=2|pages=125–154|doi=10.1017/s0956796800020025|issn=0956-7968|hdl=2066/17240|s2cid=44757552 |hdl-access=free}}), i.e. "Roughly speaking, a category may be thought of as a type theory shorn of its syntax." A number of significant results follow in this way:{{cite book|series=Handbook of the History of Logic|volume=6|title=Sets and Extensions in the Twentieth Century|year=2012|publisher=Elsevier|isbn=978-0-08-093066-4|first=John L.|last=Bell|chapter=Types, Sets and Categories|chapter-url=http://publish.uwo.ca/~jbell/types.pdf|editor-first=Akihiro|editor-last=Kanamory|access-date=2012-11-03|archive-date=2018-04-17|archive-url=https://web.archive.org/web/20180417105624/http://publish.uwo.ca/~jbell/types.pdf|url-status=live}}

The interplay, known as categorical logic, has been a subject of active research since then; see the monograph of Jacobs (1999) for instance.

== Homotopy type theory ==

Homotopy type theory attempts to combine type theory and category theory. It focuses on equalities, especially equalities between types. Homotopy type theory differs from intuitionistic type theory mostly by its handling of the equality type. In 2016, cubical type theory was proposed, which is a homotopy type theory with normalization.{{Cite book |last1=Sterling |first1=Jonathan |title=2021 36th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS) |last2=Angiuli |first2=Carlo |date=2021-06-29 |publisher=IEEE |isbn=978-1-6654-4895-6 |location=Rome, Italy |pages=1–15 |chapter=Normalization for Cubical Type Theory |doi=10.1109/LICS52264.2021.9470719 |access-date=2022-06-21 |chapter-url=https://ieeexplore.ieee.org/document/9470719 |archive-url=https://web.archive.org/web/20230813170127/https://ieeexplore.ieee.org/document/9470719 |archive-date=2023-08-13 |url-status=live |arxiv=2101.11479 |s2cid=231719089}}

Definitions

= Terms and types =

== Atomic terms ==

The most basic types are called atoms, and a term whose type is an atom is known as an atomic term. Common atomic terms included in type theories are natural numbers, often notated with the type \mathsf{nat}, Boolean logic values (\mathrm{true}/\mathrm{false}), notated with the type \mathsf{bool}, and formal variables, whose type may vary. For example, the following may be atomic terms.

  • 42:\mathsf{nat}
  • \mathrm{true}:\mathsf{bool}
  • x:\mathsf{nat}
  • y:\mathsf{bool}

==Function terms==

In addition to atomic terms, most modern type theories also allow for functions. Function types introduce an arrow symbol, and are defined inductively: If \sigma and \tau are types, then the notation \sigma\to\tau is the type of a function which takes a parameter of type \sigma and returns a term of type \tau. Types of this form are known as simple types.

Some terms may be declared directly as having a simple type, such as the following term, \mathrm{add}, which takes in two natural numbers in sequence and returns one natural number.

\mathrm{add}:\mathsf{nat}\to (\mathsf{nat}\to\mathsf{nat})

Strictly speaking, a simple type only allows for one input and one output, so a more faithful reading of the above type is that \mathrm{add} is a function which takes in a natural number and returns a function of the form \mathsf{nat}\to\mathsf{nat}. The parentheses clarify that \mathrm{add} does not have the type (\mathsf{nat}\to \mathsf{nat})\to\mathsf{nat}, which would be a function which takes in a function of natural numbers and returns a natural number. The convention is that the arrow is right associative, so the parentheses may be dropped from \mathrm{add}'s type.

== Lambda terms ==

New function terms may be constructed using lambda expressions, and are called lambda terms. These terms are also defined inductively: a lambda term has the form (\lambda v .t), where v is a formal variable and t is a term, and its type is notated \sigma\to\tau, where \sigma is the type of v, and \tau is the type of t. The following lambda term represents a function which doubles an input natural number.

(\lambda x.\mathrm{add}\,x\,x): \mathsf{nat}\to\mathsf{nat}

The variable is x and (implicit from the lambda term's type) must have type \mathsf{nat} . The term \mathrm{add}\,x\,x has type \mathsf{nat} , which is seen by applying the function application inference rule twice. Thus, the lambda term has type \mathsf{nat}\to\mathsf{nat}, which means it is a function taking a natural number as an argument and returning a natural number.

A lambda term is often referred to{{efn|name= anon|1= In Julia, for example, a function with no name, but with two parameters in some tuple (x,y) can be denoted by say, (x,y) -> x^5+y, as an anonymous function. Balbaert,Ivo [https://www.oreilly.com/library/view/getting-started-with/9781783284795/ch03s03.html (2015) Getting Started with Julia]}} as an anonymous function because it lacks a name. The concept of anonymous functions appears in many programming languages.

= Inference Rules =

== Function application ==

The power of type theories is in specifying how terms may be combined by way of inference rules. Type theories which have functions also have the inference rule of function application: if t is a term of type \sigma\to\tau, and s is a term of type \sigma, then the application of t to s, often written (t\,s), has type \tau. For example, if one knows the type notations 0:\textsf{nat}, 1:\textsf{nat}, and 2:\textsf{nat}, then the following type notations can be deduced from function application.

  • (\mathrm{add}\,1): \textsf{nat}\to\textsf{nat}
  • ((\mathrm{add}\,2)\,0): \textsf{nat}
  • ((\mathrm{add}\,1)((\mathrm{add}\,2)\,0)): \textsf{nat}

Parentheses indicate the order of operations; however, by convention, function application is left associative, so parentheses can be dropped where appropriate. In the case of the three examples above, all parentheses could be omitted from the first two, and the third may simplified to \mathrm{add}\,1\, (\mathrm{add}\,2\,0): \textsf{nat}.

== Reductions ==

Type theories that allow for lambda terms also include inference rules known as \beta-reduction and \eta-reduction. They generalize the notion of function application to lambda terms. Symbolically, they are written

  • (\lambda v. t)\,s\rightarrow t[v \colon= s] (\beta-reduction).
  • (\lambda v. t\, v)\rightarrow t, if v is not a free variable in t (\eta-reduction).

The first reduction describes how to evaluate a lambda term: if a lambda expression (\lambda v .t) is applied to a term s, one replaces every occurrence of v in t with s. The second reduction makes explicit the relationship between lambda expressions and function types: if (\lambda v. t\, v) is a lambda term, then it must be that t is a function term because it is being applied to v. Therefore, the lambda expression is equivalent to just t, as both take in one argument and apply t to it.

For example, the following term may be \beta-reduced.

(\lambda x.\mathrm{add}\,x\,x)\,2\rightarrow \mathrm{add}\,2\,2

In type theories that also establish notions of equality for types and terms, there are corresponding inference rules of \beta-equality and \eta-equality.

=Common terms and types=

==Empty type==

The empty type has no terms. The type is usually written \bot or \mathbb 0. One use for the empty type is proofs of type inhabitation. If for a type a, it is consistent to derive a function of type a\to\bot, then a is uninhabited, which is to say it has no terms.

==Unit type==

The unit type has exactly 1 canonical term. The type is written \top or \mathbb 1 and the single canonical term is written \ast. The unit type is also used in proofs of type inhabitation. If for a type a, it is consistent to derive a function of type \top\to a, then a is inhabited, which is to say it must have one or more terms.

==Boolean type==

The Boolean type has exactly 2 canonical terms. The type is usually written \textsf{bool} or \mathbb B or \mathbb 2. The canonical terms are usually \mathrm{true} and \mathrm{false}.

==Natural numbers==

Natural numbers are usually implemented in the style of Peano Arithmetic. There is a canonical term 0:\mathsf{nat} for zero. Canonical values larger than zero use iterated applications of a successor function \mathrm{S}:\mathsf{nat}\to\mathsf{nat}.

= Type constructors =

Some type theories allow for types of complex terms, such as functions or lists, to depend on the types of its arguments; these are called type constructors. For example, a type theory could have the dependent type \mathsf{list}\,a, which should correspond to lists of terms, where each term must have type a. In this case, \mathsf{list} has the kind U\to U, where U denotes the universe of all types in the theory.

==Product type==

The product type, \times, depends on two types, and its terms are commonly written as ordered pairs (s,t). The pair (s,t) has the product type \sigma\times\tau, where \sigma is the type of s and \tau is the type of t. Each product type is then usually defined with eliminator functions \mathrm{first}:\sigma\times\tau\to\sigma and \mathrm{second}:\sigma\times\tau\to\tau.

  • \mathrm{first}\,(s,t) returns s, and
  • \mathrm{second}\,(s,t) returns t.

Besides ordered pairs, this type is used for the concepts of logical conjunction and intersection.

==Sum type==

The sum type is written as either + or \sqcup. In programming languages, sum types may be referred to as tagged unions. Each type \sigma\sqcup\tau is usually defined with constructors \mathrm{left}:\sigma\to(\sigma\sqcup\tau) and \mathrm{right}:\tau\to(\sigma\sqcup\tau), which are injective, and an eliminator function \mathrm{match}:(\sigma\to\rho)\to(\tau\to\rho)\to(\sigma\sqcup\tau)\to\rho such that

  • \mathrm{match}\,f\,g\,(\mathrm{left}\,x) returns f\,x, and
  • \mathrm{match}\,f\,g\,(\mathrm{right}\,y) returns g\,y.

The sum type is used for the concepts of logical disjunction and union.

= Polymorphic types =

Some theories also allow terms to have their definitions depend on types. For instance, an identity function of any type could be written as \lambda x.x:\forall\alpha. \alpha\to\alpha. The function is said to be polymorphic in \alpha, or generic in x.

As another example, consider a function \mathrm{append}, which takes in a \mathsf{list}\,a and a term of type a, and returns the list with the element at the end. The type annotation of such a function would be \mathrm{append}:\forall\,a.\mathsf{list}\,a\to a\to\mathsf{list}\,a, which can be read as "for any type a, pass in a \mathsf{list}\,a and an a, and return a \mathsf{list}\,a". Here \mathrm{append} is polymorphic in a.

==Products and sums==

With polymorphism, the eliminator functions can be defined generically for all product types as \mathrm{first}:\forall\,\sigma\,\tau.\sigma\times\tau\to\sigma and \mathrm{second}:\forall\,\sigma\,\tau.\sigma\times\tau\to\tau.

  • \mathrm{first}\,(s,t) returns s, and
  • \mathrm{second}\,(s,t) returns t.

Likewise, the sum type constructors can be defined for all valid types of sum members as \mathrm{left}:\forall\,\sigma\,\tau.\sigma\to(\sigma\sqcup\tau) and \mathrm{right}:\forall\,\sigma\,\tau.\tau\to(\sigma\sqcup\tau), which are injective, and the eliminator function can be given as \mathrm{match}:\forall\,\sigma\,\tau\,\rho.(\sigma\to\rho)\to(\tau\to\rho)\to(\sigma\sqcup\tau)\to\rho such that

  • \mathrm{match}\,f\,g\,(\mathrm{left}\,x) returns f\,x, and
  • \mathrm{match}\,f\,g\,(\mathrm{right}\,y) returns g\,y.

= Dependent typing =

Some theories also permit types to be dependent on terms instead of types. For example, a theory could have the type \mathsf{vector}\,n, where n is a term of type \mathsf{nat} encoding the length of the vector. This allows for greater specificity and type safety: functions with vector length restrictions or length matching requirements, such as the dot product, can encode this requirement as part of the type.{{Citation |last1=Bove |first1=Ana |title=Dependent Types at Work |date=2009 |url=https://doi.org/10.1007/978-3-642-03153-3_2 |work=Language Engineering and Rigorous Software Development: International LerNet ALFA Summer School 2008, Piriapolis, Uruguay, February 24 - March 1, 2008, Revised Tutorial Lectures |pages=57–99 |editor-last=Bove |editor-first=Ana |access-date=2024-01-18 |series=Lecture Notes in Computer Science |place=Berlin, Heidelberg |publisher=Springer |language=en |doi=10.1007/978-3-642-03153-3_2 |isbn=978-3-642-03153-3 |last2=Dybjer |first2=Peter |editor2-last=Barbosa |editor2-first=Luís Soares |editor3-last=Pardo |editor3-first=Alberto |editor4-last=Pinto |editor4-first=Jorge Sousa}}

There are foundational issues that can arise from dependent types if a theory is not careful about what dependencies are allowed, such as Girard's Paradox. The logician Henk Barendegt introduced the lambda cube as a framework for studying various restrictions and levels of dependent typing.{{Cite journal |last=Barendegt |first=Henk |date=April 1991 |title=Introduction to generalized type systems |url=https://doi.org/10.1017/S0956796800020025 |journal=Journal of Functional Programming |volume=1 |issue=2 |pages=125–154 |doi=10.1017/S0956796800020025 |via=Cambridge Core|hdl=2066/17240 |hdl-access=free }}

== Dependent products and sums ==

Two common type dependencies, dependent product and dependent sum types, allow for the theory to encode BHK intuitionistic logic by acting as equivalents to universal and existential quantification; this is formalized by Curry–Howard Correspondence. As they also connect to products and sums in set theory, they are often written with the symbols \Pi and \Sigma, respectively.

Sum types are seen in dependent pairs, where the second type depends on the value of the first term. This arises naturally in computer science where functions may return different types of outputs based on the input. For example, the Boolean type is usually defined with an eliminator function \mathrm{if}, which takes three arguments and behaves as follows.

  • \mathrm{if}\,\mathrm{true}\,x\,y returns x, and
  • \mathrm{if}\,\mathrm{false}\,x\,y returns y.

Ordinary definitions of \mathrm{if} require x and y to have the same type. If the type theory allows for dependent types, then it is possible to define a dependent type x:\mathsf{bool}\,\vdash\,\mathrm{TF}\,x:U\to U\to U such that

  • \mathrm{TF}\,\mathrm{true}\,\sigma\,\tau returns \sigma, and
  • \mathrm{TF}\,\mathrm{false}\,\sigma\,\tau returns \tau.

The type of \mathrm{if} may then be written as \forall\,\sigma\,\tau.\Pi_{x:\mathsf{bool}}.\sigma\to\tau\to\mathrm{TF}\,x\,\sigma\,\tau.

{{anchor|Equality types}}

==Identity type==

Following the notion of Curry-Howard Correspondence, the identity type is a type introduced to mirror propositional equivalence, as opposed to the judgmental (syntactic) equivalence that type theory already provides.

An identity type requires two terms of the same type and is written with the symbol =. For example, if x+1 and 1+x are terms, then x+1=1+x is a possible type. Canonical terms are created with a reflexivity function, \mathrm{refl}. For a term t, the call \mathrm{refl}\,t returns the canonical term inhabiting the type t=t.

The complexities of equality in type theory make it an active research topic; homotopy type theory is a notable area of research that mainly deals with equality in type theory.

==Inductive types==

Inductive types are a general template for creating a large variety of types. In fact, all the types described above and more can be defined using the rules of inductive types. Two methods of generating inductive types are induction-recursion and induction-induction. A method that only uses lambda terms is Scott encoding.

Some proof assistants, such as Rocq (previously known as Coq) and Lean, are based on the calculus for inductive constructions, which is a calculus of constructions with inductive types.

Differences from set theory

The most commonly accepted foundation for mathematics is first-order logic with the language and axioms of Zermelo–Fraenkel set theory with the axiom of choice, abbreviated ZFC. Type theories having sufficient expressibility may also act as a foundation of mathematics. There are a number of differences between these two approaches.

  • Set theory has both rules and axioms, while type theories only have rules. Type theories, in general, do not have axioms and are defined by their rules of inference.
  • Classical set theory and logic have the law of excluded middle. When a type theory encodes the concepts of "and" and "or" as types, it leads to intuitionistic logic, and does not necessarily have the law of excluded middle.
  • In set theory, an element is not restricted to one set. The element can appear in subsets and unions with other sets. In type theory, terms (generally) belong to only one type. Where a subset would be used, type theory can use a predicate function or use a dependently-typed product type, where each element x is paired with a proof that the subset's property holds for x. Where a union would be used, type theory uses the sum type, which contains new canonical terms.
  • Type theory has a built-in notion of computation. Thus, "1+1" and "2" are different terms in type theory, but they compute to the same value. Moreover, functions are defined computationally as lambda terms. In set theory, "1+1=2" means that "1+1" is just another way to refer the value "2". Type theory's computation does require a complicated concept of equality.
  • Set theory encodes numbers as sets. Type theory can encode numbers as functions using Church encoding, or more naturally as inductive types, and the construction closely resembles Peano's axioms.
  • In type theory, proofs are types whereas in set theory, proofs are part of the underlying first-order logic.

Proponents of type theory will also point out its connection to constructive mathematics through the BHK interpretation, its connection to logic by the Curry–Howard isomorphism, and its connections to Category theory.

=Properties of type theories=

Terms usually belong to a single type. However, there are set theories that define "subtyping".

Computation takes place by repeated application of rules. Many types of theories are strongly normalizing, which means that any order of applying the rules will always end in the same result. However, some are not. In a normalizing type theory, the one-directional computation rules are called "reduction rules", and applying the rules "reduces" the term. If a rule is not one-directional, it is called a "conversion rule".

Some combinations of types are equivalent to other combinations of types. When functions are considered "exponentiation", the combinations of types can be written similarly to algebraic identities.{{cite web|last1=Milewski|first1=Bartosz|title=Programming with Math (Exploring Type Theory)|url=https://www.youtube.com/watch?v=8AGWTWVOJ74|website=YouTube|access-date=2022-01-22|archive-date=2022-01-22|archive-url=https://web.archive.org/web/20220122213434/https://www.youtube.com/watch?v=8AGWTWVOJ74|url-status=live}} Thus, {\mathbb 0} + A \cong A, {\mathbb 1} \times A \cong A, {\mathbb 1} + {\mathbb 1} \cong {\mathbb 2}, A^{B+C} \cong A^B \times A^C, A^{B\times C} \cong (A^B)^C.

=Axioms=

Most type theories do not have axioms. This is because a type theory is defined by its rules of inference. This is a source of confusion for people familiar with Set Theory, where a theory is defined by both the rules of inference for a logic (such as first-order logic) and axioms about sets.

Sometimes, a type theory will add a few axioms. An axiom is a judgment that is accepted without a derivation using the rules of inference. They are often added to ensure properties that cannot be added cleanly through the rules.

Axioms can cause problems if they introduce terms without a way to compute on those terms. That is, axioms can interfere with the normalizing property of the type theory.{{cite web|title=Axioms and Computation|url=https://leanprover.github.io/theorem_proving_in_lean/axioms_and_computation.html|website=Theorem Proving in Lean|access-date=21 January 2022|archive-date=22 December 2021|archive-url=https://web.archive.org/web/20211222130219/https://leanprover.github.io/theorem_proving_in_lean/axioms_and_computation.html|url-status=live}}

Some commonly encountered axioms are:

  • "Axiom K" ensures "uniqueness of identity proofs". That is, that every term of an identity type is equal to reflexivity.{{cite web|title=Axiom K|url=http://nlab-pages.s3.us-east-2.amazonaws.com/nlab/show/axiom+K+(type+theory)|website=nLab|access-date=2022-01-21|archive-date=2022-01-19|archive-url=https://web.archive.org/web/20220119172036/http://nlab-pages.s3.us-east-2.amazonaws.com/nlab/show/axiom+K+(type+theory)|url-status=live}}
  • "Univalence Axiom" holds that equivalence of types is equality of types. The research into this property led to cubical type theory, where the property holds without needing an axiom.{{cite journal|last1=Cohen|first1=Cyril|last2=Coquand|first2=Thierry|last3=Huber|first3=Simon|last4=Mörtberg|first4=Anders|title=Cubical Type Theory: A constructive interpretation of the univalence axiom|journal=21st International Conference on Types for Proofs and Programs (TYPES 2015)|date=2016|doi=10.4230/LIPIcs.CVIT.2016.23|doi-broken-date=1 November 2024|doi-access=free |arxiv=1611.02108|url=https://www.cse.chalmers.se/~simonhu/papers/cubicaltt.pdf|archive-url=https://ghostarchive.org/archive/20221009/https://www.cse.chalmers.se/~simonhu/papers/cubicaltt.pdf|archive-date=2022-10-09|url-status=live}}
  • "Law of Excluded Middle" is often added to satisfy users who want classical logic, instead of intuitionistic logic.

The Axiom of Choice does not need to be added to type theory, because in most type theories it can be derived from the rules of inference. This is because of the constructive nature of type theory, where proving that a value exists requires a method to compute the value. The Axiom of Choice is less powerful in type theory than most set theories, because type theory's functions must be computable and, being syntax-driven, the number of terms in a type must be countable. (See {{Section link|Axiom of choice#In constructive mathematics}}.)

List of type theories

=Major=

=Minor=

=Active research=

See also

Further reading

{{refbegin}}

  • {{cite web|first1=C.|last1=Aarts|first2=R.|last2=Backhouse|first3=P.|last3=Hoogendijk|first4=E.|last4=Voermans|first5=J.|last5=van der Woude|title=A Relational Theory of Datatypes|date=December 1992|publisher=Technische Universiteit Eindhoven|url=https://www.researchgate.net/publication/277287583}}
  • {{cite book|first=Peter|last=Andrews B.|year=2002|isbn=978-1-4020-0763-7|title=An Introduction to Mathematical Logic and Type Theory: To Truth Through Proof|edition=2nd|publisher=Kluwer}}
  • {{cite book|first=Bart|last=Jacobs|title=Categorical Logic and Type Theory|year=1999|publisher=Elsevier|isbn=978-0-444-50170-7|series=Studies in Logic and the Foundations of Mathematics|volume=141|url=https://www.cs.ru.nl/B.Jacobs/CLT/bookinfo.html|access-date=2020-07-19|archive-date=2023-08-10|archive-url=https://web.archive.org/web/20230810075226/https://www.cs.ru.nl/B.Jacobs/CLT/bookinfo.html|url-status=live}} Covers type theory in depth, including polymorphic and dependent type extensions. Gives categorical semantics.
  • {{cite book|first=Luca|last=Cardelli|chapter=Type Systems|chapter-url=http://citeseer.ist.psu.edu/cardelli97type.html|editor-first=Allen B.|editor-last=Tucker|title=The Computer Science and Engineering Handbook|publisher=CRC Press|year=1996|isbn=9780849329098|pages=2208–36|access-date=2004-06-26|archive-date=2008-04-10|archive-url=https://web.archive.org/web/20080410185229/http://citeseer.ist.psu.edu/cardelli97type.html|url-status=live}}
  • {{cite book|first=Jordan E.|last=Collins|year=2012|isbn=978-3-8473-2963-3|title=A History of the Theory of Types: Developments After the Second Edition of 'Principia Mathematica'|publisher=Lambert Academic Publishing|hdl=11375/12315}} Provides a historical survey of the developments of the theory of types with a focus on the decline of the theory as a foundation of mathematics over the four decades following the publication of the second edition of 'Principia Mathematica'.
  • {{cite book|author-link=Robert Lee Constable|last=Constable|first=Robert L.|chapter=Naïve Computational Type Theory|chapter-url=http://www.nuprl.org/documents/Constable/naive.pdf|archive-url=https://ghostarchive.org/archive/20221009/http://www.nuprl.org/documents/Constable/naive.pdf|archive-date=2022-10-09|url-status=live|editor-first=H.|editor-last=Schwichtenberg|editor-first2=R.|editor-last2=Steinbruggen|title=Proof and System-Reliability|publisher=Springer|series=Nato Science Series II|volume=62|year=2012|orig-year=2002|isbn=9789401004138|pages=213–259}} Intended as a type theory counterpart of Paul Halmos's (1960) Naïve Set Theory
  • {{cite encyclopedia|author-link=Thierry Coquand|first=Thierry|last=Coquand|title=Type Theory|date=2018|orig-year=2006|encyclopedia=Stanford Encyclopedia of Philosophy|url=http://plato.stanford.edu/entries/type-theory/}}
  • {{cite book|first=Simon|last=Thompson|title=Type Theory and Functional Programming|publisher=Addison–Wesley|year=1991|isbn=0-201-41667-0|url=http://www.cs.kent.ac.uk/people/staff/sjt/TTFP/|access-date=2006-04-03|archive-date=2021-03-23|archive-url=https://web.archive.org/web/20210323203228/http://www.cs.kent.ac.uk/people/staff/sjt/TTFP/|url-status=live}}
  • {{cite book|author-link=J. Roger Hindley|first=J. Roger|last=Hindley|title=Basic Simple Type Theory|publisher=Cambridge University Press|year=2008|orig-year=1995|isbn=978-0-521-05422-5}} A good introduction to simple type theory for computer scientists; the system described is not exactly Church's STT though. [http://www.iwu.edu/~htiede/papers/pdf/jolli-review.pdf Book review] {{Webarchive|url=https://web.archive.org/web/20110607234927/http://www.iwu.edu/~htiede/papers/pdf/jolli-review.pdf|date=2011-06-07}}
  • {{cite book|first1=Fairouz D.|last1=Kamareddine|first2=Twan|last2=Laan|first3=Rob P.|last3=Nederpelt|title=A modern perspective on type theory: from its origins until today|publisher=Springer|year=2004|isbn=1-4020-2334-0}}
  • {{cite book|first1=José|last1=Ferreirós|first2=José Ferreirós|last2=Domínguez|title=Labyrinth of thought: a history of set theory and its role in modern mathematics|publisher=Springer|year=2007|isbn=978-3-7643-8349-7|edition=2nd|chapter=X. Logic and Type Theory in the Interwar Period}}
  • {{cite thesis|first=T.D.L.|last=Laan|title=The evolution of type theory in logic and mathematics|date=1997|type=PhD|publisher=Eindhoven University of Technology|url=https://pure.tue.nl/ws/files/1383309/498552.pdf|archive-url=https://ghostarchive.org/archive/20221009/https://pure.tue.nl/ws/files/1383309/498552.pdf|archive-date=2022-10-09|url-status=live|doi=10.6100/IR498552|isbn=90-386-0531-5}}
  • Montague, R. (1973) "The proper treatment of quantification in ordinary English". In K. J. J. Hintikka, J. M. E. Moravcsik, and P. Suppes (eds.), Approaches to Natural Language (Synthese Library, 49), Dordrecht: Reidel, 221–242; reprinted in Portner and Partee (eds.) 2002, pp. 17–35. See: [https://plato.stanford.edu/entries/montague-semantics/#Bib Montague Semantics], Stanford Encyclopedia of Philosophy.''

{{refend}}

Notes

{{Notelist}}

References

{{Reflist|30em}}

External links

=Introductory material=

  • [https://ncatlab.org/nlab/show/type+theory Type Theory at nLab], which has articles on many topics.
  • [https://plato.stanford.edu/entries/type-theory-intuitionistic/ Intuitionistic Type Theory] article at the Stanford Encyclopedia of Philosophy
  • [https://home.ttic.edu/~dreyer/course/papers/barendregt.pdf Lambda Calculi with Types] book by Henk Barendregt
  • [https://hbr.github.io/Lambda-Calculus/cc-tex Calculus of Constructions / Typed Lambda Calculus] textbook style paper by Helmut Brandl
  • [https://archive-pml.github.io/martin-lof/pdfs/Bibliopolis-Book-retypeset-1984.pdf Intuitionistic Type Theory] notes by Per Martin-Löf
  • [https://www.cse.chalmers.se/research/group/logic/book/book.pdf Programming in Martin-Löf's Type Theory] book
  • [https://homotopytypetheory.org/book/ Homotopy Type Theory] book, which proposed homotopy type theory as a mathematical foundation.

=Advanced material=

  • {{scholarpedia|title=Computational type theory|urlname=Computational_type_theory|curator=Robert L. Constable}}
  • [http://lists.seas.upenn.edu/mailman/listinfo/types-list The TYPES Forum] — moderated e-mail forum focusing on type theory in computer science, operating since 1987.
  • [ftp://ftp.cs.cornell.edu/pub/nuprl/doc/book.ps.gz The Nuprl Book]: "Introduction to Type Theory."
  • [http://www.cs.chalmers.se/Cs/Research/Logic/Types/tutorials.html Types Project lecture notes] of summer schools 2005–2008
  • The [http://www.cs.chalmers.se/Cs/Research/Logic/TypesSS05/program.html 2005 summer school] has introductory lectures
  • [https://www.cs.uoregon.edu/research/summerschool/archives.html Oregon Programming Languages Summer School], many lectures and some notes.
  • [https://www.cs.uoregon.edu/research/summerschool/summer12/curriculum.html Summer 2013 lectures] including [https://www.youtube.com/watch?v=9SnefrwBIDc&list=PLGCr8P_YncjXRzdGq2SjKv5F2J8HUFeqN Robert Harper's talks on YouTube]
  • [https://www.cs.uoregon.edu/research/summerschool/summer15/curriculum.html Summer 2015 Types, Logic, Semantics, and Verification]
  • [http://math.andrej.com/category/type-theory/ Andrej Bauer's blog]

{{Computer science}}

{{Mathematical logic}}

{{Formal semantics}}

{{DEFAULTSORT:Type Theory}}

Category:Systems of formal logic

Category:Hierarchy