Dynkin's formula

{{Short description|Theorem in stochastic analysis}}

In mathematics — specifically, in stochastic analysisDynkin's formula is a theorem giving the expected value of any suitably smooth function applied to a Feller process at a stopping time. It may be seen as a stochastic generalization of the (second) fundamental theorem of calculus. It is named after the Russian mathematician Eugene Dynkin.

Statement of the theorem

Let X be a Feller process with infinitesimal generator A.

For a point x in the state-space of X, let \mathbf P^x denote the law of X given initial datum X_0=x, and let \mathbf E^x denote expectation with respect to \mathbf P^x.

Then for any function f in the domain of A, and any stopping time \tau with \mathbf E[\tau]<+\infty, Dynkin's formula holds:Kallenberg (2021), Lemma 17.21, p383.

:

\mathbf{E}^{x} [f(X_{\tau})] = f(x) + \mathbf{E}^{x} \left[ \int_{0}^{\tau} A f (X_{s}) \, \mathrm{d} s \right].

Example: Itô diffusions

Let X be the \mathbf R^n-valued Itô diffusion solving the stochastic differential equation

:\mathrm{d} X_{t} = b(X_{t}) \, \mathrm{d} t + \sigma (X_{t}) \, \mathrm{d} B_{t}.

The infinitesimal generator A of X is defined by its action on compactly-supported C^2 (twice differentiable with continuous second derivative) functions f:\mathbf R^n \to \mathbf R asØksendal (2003), Definition 7.3.1, p124.

:A f (x) = \lim_{t \downarrow 0} \frac{\mathbf{E}^{x} [f(X_{t})] - f(x)}{t}

or, equivalently,Øksendal (2003), Theorem 7.3.3, p126.

:A f (x) = \sum_{i} b_{i} (x) \frac{\partial f}{\partial x_{i}} (x) + \frac1{2} \sum_{i, j} \big( \sigma \sigma^{\top} \big)_{i, j} (x) \frac{\partial^{2} f}{\partial x_{i}\, \partial x_{j}} (x).

Since this X is a Feller process, Dynkin's formula holds.Øksendal (2003), Theorem 7.4.1, p127.

In fact, if \tau is the first exit time of a bounded set B\subset\mathbf R^n with \mathbf E[\tau]<+\infty, then Dynkin's formula holds for all C^2 functions f, without the assumption of compact support.{{r|oksendal}}

Application: Brownian motion exiting the ball

Dynkin's formula can be used to find the expected first exit time \tau_K of a Brownian motion B from the closed ball

K= \{ x \in \mathbf{R}^{n} : \, | x | \leq R \},

which, when B starts at a point a in the interior of K, is given by

:\mathbf{E}^{a} [\tau_{K}] = \frac1{n} \big( R^{2} - | a |^{2} \big).

This is shown as follows.Øksendal (2003), Example 7.4.2, p127. Fix an integer j. The strategy is to apply Dynkin's formula with X=B, \tau=\sigma_j=\min\{j,\tau_K\}, and a compactly-supported f\in C^2 with f(x)=|x|^2 on K. The generator of Brownian motion is \Delta/2, where \Delta denotes the Laplacian operator. Therefore, by Dynkin's formula,

:\begin{align}

\mathbf{E}^{a} \left[ f \big( B_{\sigma_{j}} \big) \right]

&= f(a) + \mathbf{E}^{a} \left[ \int_{0}^{\sigma_{j}} \frac1{2} \Delta f (B_{s}) \, \mathrm{d} s \right] \\

&= | a |^{2} + \mathbf{E}^{a} \left[ \int_{0}^{\sigma_{j}} n \, \mathrm{d} s \right]

= | a |^{2} + n \mathbf{E}^{a} [\sigma_{j}].

\end{align}

Hence, for any j,

:\mathbf{E}^{a} [\sigma_{j}] \leq \frac1{n} \big( R^{2} - | a |^{2} \big).

Now let j\to+\infty to conclude that \tau_K=\lim_{j\to+\infty}\sigma_j<+\infty almost surely, and so

\mathbf{E}^{a} [\tau_{K}] =( R^{2} - | a |^{2})/n

as claimed.

References

{{reflist}}

Sources

  • {{cite book

| last = Dynkin

| first = Eugene B.

|authorlink= Eugene Dynkin

|author2=trans. J. Fabius |author3=V. Greenberg |author4=A. Maitra |author5=G. Majone

| title = Markov processes. Vols. I, II

| series = Die Grundlehren der Mathematischen Wissenschaften, Bände 121

|publisher = Academic Press Inc.

| location = New York

| year = 1965

}} (See Vol. I, p. 133)

  • {{cite book

| last = Kallenberg

| first = Olav

| authorlink = Olav Kallenberg

| title = Foundations of Modern Probability

| edition = third

| publisher = Springer

| year = 2021

| isbn = 978-3-030-61870-4

}}

  • {{cite book

| last = Øksendal

| first = Bernt K.

| authorlink = Bernt Øksendal

| title = Stochastic Differential Equations: An Introduction with Applications

| edition = Sixth

| publisher=Springer

| location = Berlin

| year = 2003

| isbn = 3-540-04758-1

}} (See Section 7.4)

Category:Stochastic differential equations

Category:Theorems about stochastic processes