Dynkin's formula
{{Short description|Theorem in stochastic analysis}}
In mathematics — specifically, in stochastic analysis — Dynkin's formula is a theorem giving the expected value of any suitably smooth function applied to a Feller process at a stopping time. It may be seen as a stochastic generalization of the (second) fundamental theorem of calculus. It is named after the Russian mathematician Eugene Dynkin.
Statement of the theorem
Let be a Feller process with infinitesimal generator .
For a point in the state-space of , let denote the law of given initial datum , and let denote expectation with respect to .
Then for any function in the domain of , and any stopping time with , Dynkin's formula holds:Kallenberg (2021), Lemma 17.21, p383.
:
\mathbf{E}^{x} [f(X_{\tau})] = f(x) + \mathbf{E}^{x} \left[ \int_{0}^{\tau} A f (X_{s}) \, \mathrm{d} s \right].
Example: Itô diffusions
Let be the -valued Itô diffusion solving the stochastic differential equation
:
The infinitesimal generator of is defined by its action on compactly-supported (twice differentiable with continuous second derivative) functions asØksendal (2003), Definition 7.3.1, p124.
:
or, equivalently,Øksendal (2003), Theorem 7.3.3, p126.
:
Since this is a Feller process, Dynkin's formula holds.Øksendal (2003), Theorem 7.4.1, p127.
In fact, if is the first exit time of a bounded set with , then Dynkin's formula holds for all functions , without the assumption of compact support.{{r|oksendal}}
Application: Brownian motion exiting the ball
Dynkin's formula can be used to find the expected first exit time of a Brownian motion from the closed ball
which, when starts at a point in the interior of , is given by
:
This is shown as follows.Øksendal (2003), Example 7.4.2, p127. Fix an integer j. The strategy is to apply Dynkin's formula with , , and a compactly-supported with on . The generator of Brownian motion is , where denotes the Laplacian operator. Therefore, by Dynkin's formula,
:
\mathbf{E}^{a} \left[ f \big( B_{\sigma_{j}} \big) \right]
&= f(a) + \mathbf{E}^{a} \left[ \int_{0}^{\sigma_{j}} \frac1{2} \Delta f (B_{s}) \, \mathrm{d} s \right] \\
&= | a |^{2} + \mathbf{E}^{a} \left[ \int_{0}^{\sigma_{j}} n \, \mathrm{d} s \right]
= | a |^{2} + n \mathbf{E}^{a} [\sigma_{j}].
\end{align}
Hence, for any ,
:
Now let to conclude that almost surely, and so
as claimed.
References
{{reflist}}
Sources
- {{cite book
| last = Dynkin
| first = Eugene B.
|authorlink= Eugene Dynkin
|author2=trans. J. Fabius |author3=V. Greenberg |author4=A. Maitra |author5=G. Majone
| title = Markov processes. Vols. I, II
| series = Die Grundlehren der Mathematischen Wissenschaften, Bände 121
|publisher = Academic Press Inc.
| location = New York
| year = 1965
}} (See Vol. I, p. 133)
- {{cite book
| last = Kallenberg
| first = Olav
| authorlink = Olav Kallenberg
| title = Foundations of Modern Probability
| edition = third
| publisher = Springer
| year = 2021
| isbn = 978-3-030-61870-4
}}
- {{cite book
| last = Øksendal
| first = Bernt K.
| authorlink = Bernt Øksendal
| title = Stochastic Differential Equations: An Introduction with Applications
| edition = Sixth
| publisher=Springer
| location = Berlin
| year = 2003
| isbn = 3-540-04758-1
}} (See Section 7.4)