Dirichlet process

Dirichlet processes are usually used when modelling data that tends to repeat previous values in a so-called "rich get richer" fashion. Specifically, suppose that the generation of values $X\_1,X\_2,\backslash dots$ can be simulated by the following algorithm.

:Input: $H$ (a probability distribution called base distribution), $\backslash alpha$ (a positive real number called scaling parameter)

:For $n\backslash ge\; 1$:

:::: a) With probability $\backslash frac\{\backslash alpha\}\{\backslash alpha+n-1\}$ draw $X\_n$ from $H$.

:::: b) With probability $\backslash frac\{n\_x\}\{\backslash alpha+n-1\}$ set $X\_n=x$, where $n\_x$ is the number of previous observations of $x$.

::::: (Formally,

At the same time, another common model for data is that the observations $X\_1,X\_2,\backslash dots$ are assumed to be independent and identically distributed (i.i.d.) according to some (random) distribution $P$. The goal of introducing Dirichlet processes is to be able to describe the procedure outlined above in this i.i.d. model.

The $X\_1,X\_2,\backslash dots$ observations in the algorithm are not independent, since we have to consider the previous results when generating the next value. They are, however, exchangeable. This fact can be shown by calculating the joint probability distribution of the observations and noticing that the resulting formula only depends on which $x$ values occur among the observations and how many repetitions they each have. Because of this exchangeability, de Finetti's representation theorem applies and it implies that the observations $X\_1,X\_2,\backslash dots$ are conditionally independent given a (latent) distribution $P$. This $P$ is a random variable itself and has a distribution. This distribution (over distributions) is called a Dirichlet process ($\backslash operatorname\{DP\}$). In summary, this means that we get an equivalent procedure to the above algorithm:

1. Draw a distribution $P$ from $\backslash operatorname\{DP\}\backslash left(H,\backslash alpha\backslash right)$
2. Draw observations $X\_1,X\_2,\backslash dots$ independently from $P$.

In practice, however, drawing a concrete distribution $P$ is impossible, since its specification requires an infinite amount of information. This is a common phenomenon in the context of Bayesian non-parametric statistics where a typical task is to learn distributions on function spaces, which involve effectively infinitely many parameters. The key insight is that in many applications the infinite-dimensional distributions appear only as an intermediary computational device and are not required for either the initial specification of prior beliefs or for the statement of the final inference.

Given a measurable set S, a base probability distribution H and a positive real number $\backslash alpha$, the Dirichlet process $\backslash operatorname\{DP\}(H,\; \backslash alpha)$ is a stochastic process whose sample path (or realization, i.e. an infinite sequence of random variates drawn from the process) is a probability distribution over S, such that the following holds. For any measurable finite partition of S, denoted $\backslash \{B\_i\backslash \}\_\{i=1\}^n$,

:$\backslash text\{if\; \}\; X\; \backslash sim\; \backslash operatorname\{DP\}(H,\backslash alpha)$

:$\backslash text\{then\; \}(X(B\_1),\backslash dots,X(B\_n))\; \backslash sim\; \backslash operatorname\{Dir\}(\backslash alpha\; H(B\_1),\backslash dots,\; \backslash alpha\; H(B\_n)),$

where $\backslash operatorname\{Dir\}$ denotes the Dirichlet distribution and the notation $X\; \backslash sim\; D$ means that the random variable $X$ has the distribution $D$.

There are several equivalent views of the Dirichlet process. Besides the formal definition above, the Dirichlet process can be defined implicitly through de Finetti's theorem as described in the first section; this is often called the Chinese restaurant process. A third alternative is the stick-breaking process, which defines the Dirichlet process constructively by writing a distribution sampled from the process as $f(x)=\backslash sum\_\{k=1\}^\backslash infty\backslash beta\_k\backslash delta\_\{x\_k\}(x)$, where $\backslash \{x\_k\backslash \}\_\{k=1\}^\backslash infty$ are samples from the base distribution $H$, $\backslash delta\_\{x\_k\}$ is an indicator function centered on $x\_k$ (zero everywhere except for $\backslash delta\_\{x\_k\}(x\_k)=1$) and the $\backslash beta\_k$ are defined by a recursive scheme that repeatedly samples from the beta distribution $\backslash operatorname\{Beta\}(1,\backslash alpha)$.

{{main|Chinese restaurant process}}

File:Chinese Restaurant Process for DP(0.5,H).webm

A widely employed metaphor for the Dirichlet process is based on the so-called Chinese restaurant process. The metaphor is as follows:

Imagine a Chinese restaurant in which customers enter. A new customer sits down at a table with a probability proportional to the number of customers already sitting there. Additionally, a customer opens a new table with a probability proportional to the scaling parameter $\backslash alpha$. After infinitely many customers entered, one obtains a probability distribution over infinitely many tables to be chosen.

This probability distribution over the tables is a random sample of the probabilities of observations drawn from a Dirichlet process with scaling parameter $\backslash alpha$.

If one associates draws from the base measure $H$ with every table, the resulting distribution over the sample space $S$ is a random sample of a Dirichlet process.

The Chinese restaurant process is related to the Pólya urn sampling scheme which yields samples from finite Dirichlet distributions.

Because customers sit at a table with a probability proportional to the number of customers already sitting at the table, two properties of the DP can be deduced:

1. The Dirichlet process exhibits a self-reinforcing property: The more often a given value has been sampled in the past, the more likely it is to be sampled again.
2. Even if $H$ is a distribution over an uncountable set, there is a nonzero probability that two samples will have exactly the same value because the probability mass will concentrate on a small number of tables.

A third approach to the Dirichlet process is the so-called stick-breaking process view. Conceptually, this involves repeatedly breaking off and discarding a random fraction (sampled from a Beta distribution) of a "stick" that is initially of length 1. Remember that draws from a Dirichlet process are distributions over a set $S$. As noted previously, the distribution drawn is discrete with probability 1. In the stick-breaking process view, we explicitly use the discreteness and give the probability mass function of this (random) discrete distribution as:

: $f(\backslash theta)\; =\; \backslash sum\_\{k=1\}^\backslash infty\; \backslash beta\_k\; \backslash cdot\; \backslash delta\_\{\backslash theta\_k\}(\backslash theta)$

where $\backslash delta\_\{\backslash theta\_k\}$ is the indicator function which evaluates to zero everywhere, except for $\backslash delta\_\{\backslash theta\_k\}(\backslash theta\_k)=1$. Since this distribution is random itself, its mass function is parameterized by two sets of random variables: the locations $\backslash left\backslash \{\backslash theta\_k\backslash right\backslash \}\_\{k=1\}^\backslash infty$ and the corresponding probabilities $\backslash left\backslash \{\backslash beta\_k\backslash right\backslash \}\_\{k=1\}^\backslash infty$. In the following, we present without proof what these random variables are.

The locations $\backslash theta\_k$ are independent and identically distributed according to $H$, the base distribution of the Dirichlet process. The probabilities $\backslash beta\_k$ are given by a procedure resembling the breaking of a unit-length stick (hence the name):

:$\backslash beta\_k\; =\; \backslash beta\text{'}\_k\backslash cdot\backslash prod\_\{i=1\}^\{k-1\}\backslash left(1-\backslash beta\text{'}\_i\backslash right)$

where $\backslash beta\text{'}\_k$ are independent random variables with the beta distribution $\backslash operatorname\{Beta\}(1,\backslash alpha)$. The resemblance to 'stick-breaking' can be seen by considering $\backslash beta\_k$ as the length of a piece of a stick. We start with a unit-length stick and in each step we break off a portion of the remaining stick according to $\backslash beta\text{'}\_k$ and assign this broken-off piece to $\backslash beta\_k$. The formula can be understood by noting that after the first k − 1 values have their portions assigned, the length of the remainder of the stick is $\backslash prod\_\{i=1\}^\{k-1\}\backslash left(1-\backslash beta\text{'}\_i\backslash right)$ and this piece is broken according to $\backslash beta\text{'}\_k$ and gets assigned to $\backslash beta\_k$.

The smaller $\backslash alpha$ is, the less of the stick will be left for subsequent values (on average), yielding more concentrated distributions.

The stick-breaking process is similar to the construction where one samples sequentially from marginal beta distributions in order to generate a sample from a Dirichlet distribution.For the proof, see {{cite web |last=Paisley |first=John |title=A simple proof of the stick-breaking construction of the Dirichlet Process |website=Columbia University |date=August 2010 |url=http://www.columbia.edu/~jwp2128/Teaching/E6892/papers/SimpleProof.pdf |archive-date=January 22, 2015 |archive-url=https://web.archive.org/web/20150122033202/http://www.columbia.edu/~jwp2128/Teaching/E6892/papers/SimpleProof.pdf }}

Yet another way to visualize the Dirichlet process and Chinese restaurant process is as a modified Pólya urn scheme sometimes called the Blackwell–MacQueen sampling scheme. Imagine that we start with an urn filled with $\backslash alpha$ black balls. Then we proceed as follows:

1. Each time we need an observation, we draw a ball from the urn.
2. If the ball is black, we generate a new (non-black) colour uniformly, label a new ball this colour, drop the new ball into the urn along with the ball we drew, and return the colour we generated.
3. Otherwise, label a new ball with the colour of the ball we drew, drop the new ball into the urn along with the ball we drew, and return the colour we observed.

The resulting distribution over colours is the same as the distribution over tables in the Chinese restaurant process. Furthermore, when we draw a black ball, if rather than generating a new colour, we instead pick a random value from a base distribution $H$ and use that value to label the new ball, the resulting distribution over labels will be the same as the distribution over the values in a Dirichlet process.

The Dirichlet Process can be used as a prior distribution to estimate the probability distribution that generates the data. In this section, we consider the model

:$$

\begin{align}

P & \sim \textrm{DP}(H, \alpha )\\

X_1, \ldots, X_n \mid P & \, \overset{\textrm{i.i.d.}}{\sim} \, P.

\end{align}

The Dirichlet Process distribution satisfies prior conjugacy, posterior consistency, and the Bernstein–von Mises theorem.{{cite book

| title = Fundamentals of Bayesian Nonparametric Inference

| isbn = 978-0-521-87826-5

| publisher = Cambridge University Press

| author = Aad van der Vaart, Subhashis Ghosal

| year = 2017

}}

In this model, the posterior distribution is again a Dirichlet process. This means that the Dirichlet process is a conjugate prior for this model. The posterior distribution is given by

:$$

\begin{align}

P \mid X_1, \ldots, X_n

&\sim \textrm{DP}\left(\frac{\alpha}{\alpha + n} H + \frac{1}{\alpha + n} \sum_{i = 1}^n \delta_{X_i}, \; \alpha + n \right) \\

&= \textrm{DP}\left(\frac{\alpha}{\alpha + n} H + \frac{n}{\alpha + n} \mathbb{P}_n, \; \alpha + n \right)

\end{align}

where $\backslash mathbb\{P\}\_n$ is defined below.

If we take the frequentist view of probability, we believe there is a true probability distribution $P\_0$ that generated the data. Then it turns out that the Dirichlet process is consistent in the weak topology, which means that for every weak neighbourhood $U$ of $P\_0$, the posterior probability of $U$ converges to $1$.

In order to interpret the credible sets as confidence sets, a Bernstein–von Mises theorem is needed. In case of the Dirichlet process we compare the posterior distribution with the empirical process $\backslash mathbb\{P\}\_n\; =\; \backslash frac\{1\}\{n\}\; \backslash sum\_\{i\; =\; 1\}^n\; \backslash delta\_\{X\_i\}$. Suppose $\backslash mathcal\{F\}$ is a $P\_0$-Donsker class, i.e.

: $$

\sqrt n \left( \mathbb{P}_n - P_0 \right) \rightsquigarrow G_{P_0}

for some Brownian Bridge $G\_\{P\_0\}$. Suppose also that there exists a function $F$ such that $F(x)\; \backslash geq\; \backslash sup\_\{f\; \backslash in\; \backslash mathcal\{F\}\}\; f(x)$ such that , then, $P\_0$ almost surely

:$$

\sqrt{n} \left( P - \mathbb{P}_n \right) \mid X_1, \cdots, X_n \rightsquigarrow G_{P_0}.

This implies that credible sets you construct are asymptotic confidence sets, and the Bayesian inference based on the Dirichlet process is asymptotically also valid frequentist inference.

File:DP clustering simulation.png $N(\backslash mu\_k,1/4)$. The cluster means $\backslash mu\_k$ are drawn from a distribution G which itself is drawn from a Dirichlet process with concentration parameter $\backslash alpha=0.5$ and base distribution $H=N(2,16)$. Each row is a new simulation.]]

To understand what Dirichlet processes are and the problem they solve we consider the example of data clustering. It is a common situation that data points are assumed to be distributed in a hierarchical fashion where each data point belongs to a (randomly chosen) cluster and the members of a cluster are further distributed randomly within that cluster.

For example, we might be interested in how people will vote on a number of questions in an upcoming election. A reasonable model for this situation might be to classify each voter as a liberal, a conservative or a moderate and then model the event that a voter says "Yes" to any particular question as a Bernoulli random variable with the probability dependent on which political cluster they belong to. By looking at how votes were cast in previous years on similar pieces of legislation one could fit a predictive model using a simple clustering algorithm such as k-means. That algorithm, however, requires knowing in advance the number of clusters that generated the data. In many situations, it is not possible to determine this ahead of time, and even when we can reasonably assume a number of clusters we would still like to be able to check this assumption. For example, in the voting example above the division into liberal, conservative and moderate might not be finely tuned enough; attributes such as a religion, class or race could also be critical for modelling voter behaviour, resulting in more clusters in the model.

As another example, we might be interested in modelling the velocities of galaxies using a simple model assuming that the velocities are clustered, for instance by assuming each velocity is distributed according to the normal distribution $v\_i\backslash sim\; N(\backslash mu\_k,\backslash sigma^2)$, where the $i$th observation belongs to the $k$th cluster of galaxies with common expected velocity. In this case it is far from obvious how to determine a priori how many clusters (of common velocities) there should be and any model for this would be highly suspect and should be checked against the data. By using a Dirichlet process prior for the distribution of cluster means we circumvent the need to explicitly specify ahead of time how many clusters there are, although the concentration parameter still controls it implicitly.

We consider this example in more detail. A first naive model is to presuppose that there are $K$ clusters of normally distributed velocities with common known fixed variance $\backslash sigma^2$. Denoting the event that the $i$th observation is in the $k$th cluster as $z\_i=k$ we can write this model as:

:$$

\begin{align}

(v_i \mid z_i=k, \mu_k) & \sim N(\mu_k,\sigma^2) \\

\operatorname{P} (z_i=k) & = \pi_k \\

(\boldsymbol{\pi}\mid \alpha) & \sim \operatorname{Dir}\left(\frac{\alpha}{K} \cdot \mathbf{1}_K\right) \\

\mu_k & \sim H(\lambda)

\end{align}

That is, we assume that the data belongs to $K$ distinct clusters with means $\backslash mu\_k$ and that $\backslash pi\_k$ is the (unknown) prior probability of a data point belonging to the $k$th cluster. We assume that we have no initial information distinguishing the clusters, which is captured by the symmetric prior $\backslash operatorname\{Dir\}\backslash left(\backslash alpha/K\backslash cdot\backslash mathbf\{1\}\_K\backslash right)$. Here $\backslash operatorname\{Dir\}$ denotes the Dirichlet distribution and $\backslash mathbf\{1\}\_K$ denotes a vector of length $K$ where each element is 1. We further assign independent and identical prior distributions $H(\backslash lambda)$ to each of the cluster means, where $H$ may be any parametric distribution with parameters denoted as $\backslash lambda$. The hyper-parameters $\backslash alpha$ and $\backslash lambda$ are taken to be known fixed constants, chosen to reflect our prior beliefs about the system. To understand the connection to Dirichlet process priors we rewrite this model in an equivalent but more suggestive form:

: $$

\begin{align}

(v_i \mid \tilde{\mu}_i) & \sim N(\tilde{\mu}_i,\sigma^2) \\

\tilde{\mu}_i & \sim G=\sum_{k=1}^K \pi_k \delta_{\mu_k} (\tilde{\mu}_i) \\

(\boldsymbol{\pi}\mid \alpha) & \sim \operatorname{Dir}\left(\frac{\alpha}{K} \cdot \mathbf{1}_K \right) \\

\mu_k & \sim H(\lambda)

\end{align}

Instead of imagining that each data point is first assigned a cluster and then drawn from the distribution associated to that cluster we now think of each observation being associated with parameter $\backslash tilde\{\backslash mu\}\_i$ drawn from some discrete distribution $G$ with support on the $K$ means. That is, we are now treating the $\backslash tilde\{\backslash mu\}\_i$ as being drawn from the random distribution $G$ and our prior information is incorporated into the model by the distribution over distributions $G$.

File:Parameter estimation process infinite Gaussian mixture model.webm

We would now like to extend this model to work without pre-specifying a fixed number of clusters $K$. Mathematically, this means we would like to select a random prior distribution $G(\backslash tilde\{\backslash mu\}\_i)=\backslash sum\_\{k=1\}^\backslash infty\backslash pi\_k\; \backslash delta\_\{\backslash mu\_k\}(\backslash tilde\{\backslash mu\}\_i)$ where the values of the clusters means $\backslash mu\_k$ are again independently distributed according to $H\backslash left(\backslash lambda\backslash right)$ and the distribution over $\backslash pi\_k$ is symmetric over the infinite set of clusters. This is exactly what is accomplished by the model:

: $$

\begin{align}

(v_i \mid \tilde{\mu}_i) & \sim N(\tilde{\mu}_i,\sigma^2)\\

\tilde{\mu}_i & \sim G \\

G & \sim \operatorname{DP}(H(\lambda),\alpha)

\end{align}

With this in hand we can better understand the computational merits of the Dirichlet process. Suppose that we wanted to draw $n$ observations from the naive model with exactly $K$ clusters. A simple algorithm for doing this would be to draw $K$ values of $\backslash mu\_k$ from $H(\backslash lambda)$, a distribution $\backslash pi$ from $\backslash operatorname\{Dir\}\backslash left(\backslash alpha/K\backslash cdot\backslash mathbf\{1\}\_K\backslash right)$ and then for each observation independently sample the cluster $k$ with probability $\backslash pi\_k$ and the value of the observation according to $N\backslash left(\backslash mu\_k,\backslash sigma^2\backslash right)$. It is easy to see that this algorithm does not work in case where we allow infinite clusters because this would require sampling an infinite dimensional parameter $\backslash boldsymbol\{\backslash pi\}$. However, it is still possible to sample observations $v\_i$. One can e.g. use the Chinese restaurant representation described below and calculate the probability for used clusters and a new cluster to be created. This avoids having to explicitly specify $\backslash boldsymbol\{\backslash pi\}$. Other solutions are based on a truncation of clusters: A (high) upper bound to the true number of clusters is introduced and cluster numbers higher than the lower bound are treated as one cluster.

Fitting the model described above based on observed data $D$ means finding the posterior distribution $p\backslash left(\backslash boldsymbol\{\backslash pi\},\backslash boldsymbol\{\backslash mu\}\backslash mid\; D\backslash right)$ over cluster probabilities and their associated means. In the infinite dimensional case it is obviously impossible to write down the posterior explicitly. It is, however, possible to draw samples from this posterior using a modified Gibbs sampler.{{cite thesis |type=Ph.D. |first=Erik |last=Sudderth |title=Graphical Models for Visual Object Recognition and Tracking |publisher=MIT Press |year=2006 |url=http://cs.brown.edu/~sudderth/papers/sudderthPhD.pdf}} This is the critical fact that makes the Dirichlet process prior useful for inference.

Dirichlet processes are frequently used in Bayesian nonparametric statistics. "Nonparametric" here does not mean a parameter-less model, rather a model in which representations grow as more data are observed. Bayesian nonparametric models have gained considerable popularity in the field of machine learning because of the above-mentioned flexibility, especially in unsupervised learning. In a Bayesian nonparametric model, the prior and posterior distributions are not parametric distributions, but stochastic processes.{{cite book

| title = Bayesian Nonparametrics

| isbn = 978-0-521-51346-3

| publisher = Cambridge University Press

|author=Nils Lid Hjort |author2=Chris Holmes, Peter Müller |author3=Stephen G. Walker

| year = 2010

}} The fact that the Dirichlet distribution is a probability distribution on the simplex of sets of non-negative numbers that sum to one makes it a good candidate to model distributions over distributions or distributions over functions. Additionally, the nonparametric nature of this model makes it an ideal candidate for clustering problems where the distinct number of clusters is unknown beforehand. In addition, the Dirichlet process has also been used for developing a mixture of expert models, in the context of supervised learning algorithms (regression or classification settings). For instance, mixtures of Gaussian process experts, where the number of required experts must be inferred from the data.Sotirios P. Chatzis, "A Latent Variable Gaussian Process Model with Pitman-Yor Process Priors for Multiclass Classification," Neurocomputing, vol. 120, pp. 482–489, Nov. 2013. {{doi|10.1016/j.neucom.2013.04.029}}Sotirios P. Chatzis, Yiannis Demiris, "Nonparametric mixtures of Gaussian processes with power-law behaviour," IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 12, pp. 1862–1871, Dec. 2012. {{doi|10.1109/TNNLS.2012.2217986}}

As draws from a Dirichlet process are discrete, an important use is as a prior probability in infinite mixture models. In this case, $S$ is the parametric set of component distributions. The generative process is therefore that a sample is drawn from a Dirichlet process, and for each data point, in turn, a value is drawn from this sample distribution and used as the component distribution for that data point. The fact that there is no limit to the number of distinct components which may be generated makes this kind of model appropriate for the case when the number of mixture components is not well-defined in advance. For example, the infinite mixture of Gaussians model,{{cite journal

| last = Rasmussen

| first = Carl

| title = The Infinite Gaussian Mixture Model

| journal = Advances in Neural Information Processing Systems

| volume = 12

| pages = 554–560

| year = 2000

| url = http://www.gatsby.ucl.ac.uk/~edward/pub/inf.mix.nips.99.pdf

}} as well as associated mixture regression models, e.g.Sotirios P. Chatzis, Dimitrios Korkinof, and Yiannis Demiris, "A nonparametric Bayesian approach toward robot learning by demonstration," Robotics and Autonomous Systems, vol. 60, no. 6, pp. 789–802, June 2012. {{doi|10.1016/j.robot.2012.02.005}}

The infinite nature of these models also lends them to natural language processing applications, where it is often desirable to treat the vocabulary as an infinite, discrete set.

The Dirichlet Process can also be used for nonparametric hypothesis testing, i.e. to develop Bayesian nonparametric versions of the classical nonparametric hypothesis tests, e.g. sign test, Wilcoxon rank-sum test, Wilcoxon signed-rank test, etc.

For instance, Bayesian nonparametric versions of the Wilcoxon rank-sum test and the Wilcoxon signed-rank test have been developed by using the imprecise Dirichlet process, a prior ignorance Dirichlet process. {{Citation needed|date=June 2020}}

• The Pitman–Yor process is a generalization of the Dirichlet process to accommodate power-law tails
• The hierarchical Dirichlet process extends the ordinary Dirichlet process for modelling grouped data.

• [https://web.archive.org/web/20150219021331/https://www.ee.washington.edu/techsite/papers/documents/UWEETR-2010-0006.pdf Introduction to the Dirichlet Distribution and Related Processes by Frigyik, Kapila and Gupta]
• [http://www.gatsby.ucl.ac.uk/~ywteh/research/npbayes/Teh2010a.pdf Yee Whye Teh's overview of Dirichlet processes]
• [https://web.archive.org/web/20070524045420/http://www.cs.toronto.edu/~beal/npbayes/ Webpage for the NIPS 2003 workshop on non-parametric Bayesian methods]
• [http://www.cs.berkeley.edu/~jordan/nips-tutorial05.ps Michael Jordan's NIPS 2005 tutorial: Nonparametric Bayesian Methods: Dirichlet Processes, Chinese Restaurant Processes and All That]
• [http://www.maths.bris.ac.uk/~maxvd/cribsheet.pdf Peter Green's summary of construction of Dirichlet Processes]
• [http://www.stats.bris.ac.uk/~peter/papers/GreenCDP.pdf Peter Green's paper on probabilistic models of Dirichlet Processes with implications for statistical modelling and analysis]
• [http://learning.eng.cam.ac.uk/zoubin/talks/uai05tutorial-b.pdf Zoubin Ghahramani's UAI 2005 tutorial on Nonparametric Bayesian methods]
• [http://ClusterAnalysis.org GIMM software for performing cluster analysis using Infinite Mixture Models]
• [https://archive.today/20121215093339/http://www.ece.sunysb.edu/~zyweng/dpcluster.html A Toy Example of Clustering using Dirichlet Process.] by Zhiyuan Weng

{{Stochastic processes}}

{{Peter Gustav Lejeune Dirichlet}}

{{DEFAULTSORT:Dirichlet Process}}

Category:Stochastic processes

Category:Nonparametric Bayesian statistics