moment problem

{{Use American English|date = March 2019}}

{{Short description|Trying to map moments to a measure that generates them}}

File:Standard_deviation_diagram.svgs equal 0) the normal distribution is the distribution solving the moment problem.]]

In mathematics, a moment problem arises as the result of trying to invert the mapping that takes a measure \mu to the sequence of moments

:m_n = \int_{-\infty}^\infty x^n \,d\mu(x)\,.

More generally, one may consider

:m_n = \int_{-\infty}^\infty M_n(x) \,d\mu(x)\,.

for an arbitrary sequence of functions M_n.

Introduction

In the classical setting, \mu is a measure on the real line, and M is the sequence \{x^n : n=1,2,\dotsc\}. In this form the question appears in probability theory, asking whether there is a probability measure having specified mean, variance and so on, and whether it is unique.

There are three named classical moment problems: the Hamburger moment problem in which the support of \mu is allowed to be the whole real line; the Stieltjes moment problem, for [0,\infty); and the Hausdorff moment problem for a bounded interval, which without loss of generality may be taken as [0,1].

The moment problem also extends to complex analysis as the trigonometric moment problem in which the Hankel matrices are replaced by Toeplitz matrices and the support of {{math|μ}} is the complex unit circle instead of the real line.{{sfn | Schmüdgen | 2017 | p=257}}

Existence

A sequence of numbers m_n is the sequence of moments of a measure \mu if and only if a certain positivity condition is fulfilled; namely, the Hankel matrices H_n,

:(H_n)_{ij} = m_{i+j}\,,

should be positive semi-definite. This is because a positive-semidefinite Hankel matrix corresponds to a linear functional \Lambda such that \Lambda(x^n) = m_n and \Lambda(f^2) \geq 0 (non-negative for sum of squares of polynomials). Assume \Lambda can be extended to \mathbb{R}[x]^*. In the univariate case, a non-negative polynomial can always be written as a sum of squares. So the linear functional \Lambda is positive for all the non-negative polynomials in the univariate case. By Haviland's theorem, the linear functional has a measure form, that is \Lambda(x^n) = \int_{-\infty}^{\infty} x^n d \mu. A condition of similar form is necessary and sufficient for the existence of a measure \mu supported on a given interval [a,b].

One way to prove these results is to consider the linear functional \varphi that sends a polynomial

:P(x) = \sum_k a_k x^k

to

:\sum_k a_k m_k.

If m_k are the moments of some measure \mu supported on [a,b], then evidently

{{NumBlk|::| \varphi(P) \ge 0 for any polynomial P that is non-negative on [a,b].|{{EquationRef|1}}}}

Vice versa, if ({{EquationNote|1}}) holds, one can apply the M. Riesz extension theorem and extend \varphi to a functional on the space of continuous functions with compact support C_c([a,b])), so that

{{NumBlk|::|\varphi(f) \ge 0 for any f \in C_c([a,b]),\;f\ge 0.|{{EquationRef|2}}}}

By the Riesz representation theorem, ({{EquationNote|2}}) holds iff there exists a measure \mu supported on [a,b], such that

: \varphi(f) = \int f \, d\mu

for every f \in C_c([a,b]).

Thus the existence of the measure \mu is equivalent to ({{EquationNote|1}}). Using a representation theorem for positive polynomials on [a,b], one can reformulate ({{EquationNote|1}}) as a condition on Hankel matrices.{{sfn|Shohat|Tamarkin|1943}}{{sfn|Kreĭn |Nudel′man|1977}}

Uniqueness (or determinacy)

{{See also| Carleman's condition|Krein's condition}}

The uniqueness of \mu in the Hausdorff moment problem follows from the Weierstrass approximation theorem, which states that polynomials are dense under the uniform norm in the space of continuous functions on [0,1]. For the problem on an infinite interval, uniqueness is a more delicate question.{{sfn|Akhiezer|1965}} There are distributions, such as log-normal distributions, which have finite moments for all the positive integers but where other distributions have the same moments.

Formal solution

When the solution exists, it can be formally written using derivatives of the Dirac delta function as

: d\mu(x) = \rho(x) dx, \quad \rho(x) = \sum_{n=0}^\infty \frac{(-1)^n}{n!}\delta^{(n)}(x)m_n

.

The expression can be derived by taking the inverse Fourier transform of its characteristic function.

Variations

{{See also|Chebyshev–Markov–Stieltjes inequalities}}

An important variation is the truncated moment problem, which studies the properties of measures with fixed first {{math| k}} moments (for a finite {{math| k}}). Results on the truncated moment problem have numerous applications to extremal problems, optimisation and limit theorems in probability theory.{{sfn|Kreĭn |Nudel′man|1977}}

Probability

The moment problem has applications to probability theory. The following is commonly used:{{Cite web |last=Sodin |first=Sasha |date=March 5, 2019 |title=The classical moment problem |url=https://webspace.maths.qmul.ac.uk/a.sodin/teaching/moment/clmp.pdf |url-status=live |archive-url=https://web.archive.org/web/20220701072907/https://webspace.maths.qmul.ac.uk/a.sodin/teaching/moment/clmp.pdf |archive-date=1 Jul 2022}}

{{Math theorem|name=Theorem (Fréchet-Shohat)|note=|math_statement=

If \mu is a determinate measure (i.e. its moments determine it uniquely), and the measures \mu_n are such that

\forall k \geq 0 \quad \lim _{n \rightarrow \infty} m_k\left[\mu_n\right]=m_k[\mu],

then \mu_n \rightarrow \mu in distribution.

}}

By checking Carleman's condition, we know that the standard normal distribution is a determinate measure, thus we have the following form of the central limit theorem:

{{Math theorem

| name = Corollary

| note =

| math_statement = If a sequence of probability distributions \nu_n satisfy m_{2k}[\nu_n] \to \frac{(2k)!}{2^k k!}; \quad m_{2k+1}[\nu_n] \to 0 then \nu_n converges to N(0, 1) in distribution.

}}

See also

Notes

{{Reflist}}

References

  • {{cite book | last1 = Shohat | first1 = James Alexander | first2 = Jacob D. | last2 = Tamarkin | authorlink2 = Jacob Tamarkin | title = The Problem of Moments | publisher = American mathematical society | location = New York | year = 1943 |isbn=978-1-4704-1228-9}}
  • {{cite book | last1 = Akhiezer | first1 = Naum I. | authorlink1 = Naum Akhiezer | title = The classical moment problem and some related questions in analysis | url = https://archive.org/details/classicalmomentp0000akhi | url-access = registration | publisher = Hafner Publishing Co. |location = New York | year = 1965 }} (translated from the Russian by N. Kemmer)
  • {{cite book | last1=Kreĭn | first1=M. G. | last2=Nudel′man | first2=A. A. | series=Translations of Mathematical Monographs | title=The Markov Moment Problem and Extremal Problems | publisher=American Mathematical Society | publication-place=Providence, Rhode Island | year=1977 | isbn=978-0-8218-4500-4 | issn=0065-9282 | doi=10.1090/mmono/050}}
  • {{cite book | last=Schmüdgen | first=Konrad | series= Graduate Texts in Mathematics|title=The Moment Problem | publisher=Springer International Publishing | publication-place=Cham | year=2017 | volume=277 | isbn=978-3-319-64545-2 | issn=0072-5285 | doi=10.1007/978-3-319-64546-9}}

Category:Mathematical analysis

Category:Hilbert spaces

Category:Probability problems

Category:Moments (mathematics)

Category:Mathematical problems

Category:Real algebraic geometry

Category:Optimization in vector spaces