complex normal distribution
{{Short description|Statistical distribution of complex random variables}}
{{Probability distribution
| name = Complex normal
| type = multivariate
| pdf_image =
| cdf_image =
| notation =
| parameters = — location
— covariance matrix (positive semi-definite matrix)
— relation matrix (complex symmetric matrix)
| support =
| pdf = complicated, see text
| mean =
| mode =
| variance =
| cf =
\exp\!\big\{i\operatorname{Re}(\overline{w}'\mu) - \tfrac{1}{4}\big(\overline{w}'\Gamma w + \operatorname{Re}(\overline{w}'C\overline{w})\big)\big\}
}}
In probability theory, the family of complex normal distributions, denoted or , characterizes complex random variables whose real and imaginary parts are jointly normal.{{cite journal
| first = N.R.
| last = Goodman
| year = 1963
| title = Statistical analysis based on a certain multivariate complex Gaussian distribution (an introduction)
| journal = The Annals of Mathematical Statistics
| volume = 34
| issue = 1
| pages = 152–177
| jstor = 2991290
| doi=10.1214/aoms/1177704250
| doi-access = free
}} The complex normal family has three parameters: location parameter μ, covariance matrix , and the relation matrix . The standard complex normal is the univariate distribution with , , and .
An important subclass of complex normal family is called the circularly-symmetric (central) complex normal and corresponds to the case of zero relation matrix and zero mean: and .[http://www.rle.mit.edu/rgallager/documents/CircSymGauss.pdf bookchapter, Gallager.R], pg9. This case is used extensively in signal processing, where it is sometimes referred to as just complex normal in the literature.
Definitions
=Complex standard normal random variable=
The standard complex normal random variable or standard complex Gaussian random variable is a complex random variable whose real and imaginary parts are independent normally distributed random variables with mean zero and variance .{{cite book | author=Lapidoth, A.| title=A Foundation in Digital Communication| publisher=Cambridge University Press | year=2009 | isbn=9780521193955}}{{rp|p. 494}}{{cite book |first=David |last=Tse |year=2005 |title=Fundamentals of Wireless Communication |publisher=Cambridge University Press|isbn=9781139444668 |url=https://books.google.com/books?id=GdsLAQAAQBAJ&q=%22random+variable%22}}{{rp|pp. 501}} Formally,
{{Equation box 1
|indent =
|title=
|equation = {{NumBlk|||{{EquationRef|Eq.1}}}}
|cellpadding= 6
|border
|border colour = #0073CF
|background colour=#F5FFFA}}
where denotes that is a standard complex normal random variable.
=Complex normal random variable=
Suppose and are real random variables such that is a 2-dimensional normal random vector. Then the complex random variable is called complex normal random variable or complex Gaussian random variable.{{rp|p. 500}}
{{Equation box 1
|indent =
|title=
|equation = {{NumBlk|||{{EquationRef|Eq.2}}}}
|cellpadding= 6
|border
|border colour = #0073CF
|background colour=#F5FFFA}}
=Complex standard normal random vector=
A n-dimensional complex random vector is a complex standard normal random vector or complex standard Gaussian random vector if its components are independent and all of them are standard complex normal random variables as defined above.{{rp|p. 502}}{{rp|pp. 501}}
That is a standard complex normal random vector is denoted .
{{Equation box 1
|indent =
|title=
|equation = {{NumBlk|||{{EquationRef|Eq.3}}}}
|cellpadding= 6
|border
|border colour = #0073CF
|background colour=#F5FFFA}}
=Complex normal random vector=
If and are random vectors in such that is a normal random vector with components. Then we say that the complex random vector
:
\mathbf{Z} = \mathbf{X} + i \mathbf{Y} \,
is a complex normal random vector or a complex Gaussian random vector.
{{Equation box 1
|indent =
|title=
|equation = {{NumBlk|||{{EquationRef|Eq.4}}}}
|cellpadding= 6
|border
|border colour = #0073CF
|background colour=#F5FFFA}}
Mean, covariance, and relation{{anchor|Mean and covariance}}
The complex Gaussian distribution can be described with 3 parameters:{{cite journal
| last = Picinbono
| first = Bernard
| year = 1996
| title = Second-order complex random vectors and normal distributions
| journal = IEEE Transactions on Signal Processing
| volume = 44
| issue = 10
| pages = 2637–2640
| doi=10.1109/78.539051
| bibcode = 1996ITSP...44.2637P
| url = https://ieeexplore-ieee-org.ezp1.lib.umn.edu/document/539051
}}
:
\mu = \operatorname{E}[\mathbf{Z}], \quad
\Gamma = \operatorname{E}[(\mathbf{Z}-\mu)({\mathbf{Z}}-\mu)^{\mathrm H}], \quad
C = \operatorname{E}[(\mathbf{Z}-\mu)(\mathbf{Z}-\mu)^{\mathrm T}],
where denotes matrix transpose of , and denotes conjugate transpose.{{rp|p. 504}}{{rp|pp. 500}}
Here the location parameter is a n-dimensional complex vector; the covariance matrix is Hermitian and non-negative definite; and, the relation matrix or pseudo-covariance matrix is symmetric. The complex normal random vector
\mathbf{Z}
can now be denoted as
\mathbf{Z}\ \sim\ \mathcal{CN}(\mu,\ \Gamma,\ C).
Moreover, matrices and are such that the matrix
:
P = \overline{\Gamma} - {C}^{\mathrm H}\Gamma^{-1}C
is also non-negative definite where denotes the complex conjugate of .
Relationships between covariance matrices
{{main|Complex random vector#Covariance matrix and pseudo-covariance matrix}}
As for any complex random vector, the matrices and can be related to the covariance matrices of and via expressions
:
& V_{XX} \equiv \operatorname{E}[(\mathbf{X}-\mu_X)(\mathbf{X}-\mu_X)^\mathrm T] = \tfrac{1}{2}\operatorname{Re}[\Gamma + C], \quad
V_{XY} \equiv \operatorname{E}[(\mathbf{X}-\mu_X)(\mathbf{Y}-\mu_Y)^\mathrm T] = \tfrac{1}{2}\operatorname{Im}[-\Gamma + C], \\
& V_{YX} \equiv \operatorname{E}[(\mathbf{Y}-\mu_Y)(\mathbf{X}-\mu_X)^\mathrm T] = \tfrac{1}{2}\operatorname{Im}[\Gamma + C], \quad\,
V_{YY} \equiv \operatorname{E}[(\mathbf{Y}-\mu_Y)(\mathbf{Y}-\mu_Y)^\mathrm T] = \tfrac{1}{2}\operatorname{Re}[\Gamma - C],
\end{align}
and conversely
:
& \Gamma = V_{XX} + V_{YY} + i(V_{YX} - V_{XY}), \\
& C = V_{XX} - V_{YY} + i(V_{YX} + V_{XY}).
\end{align}
Density function
The probability density function for complex normal distribution can be computed as
:
f(z) &= \frac{1}{\pi^n\sqrt{\det(\Gamma)\det(P)}}\,
\exp\!\left\{-\frac12 \begin{bmatrix} z - \mu \\ \overline z -\overline \mu\end{bmatrix}^{\mathrm H}
\begin{bmatrix}\Gamma & C \\ \overline{C}&\overline\Gamma\end{bmatrix}^{\!\!-1}\!
\begin{bmatrix}z-\mu \\ \overline{z}-\overline{\mu}\end{bmatrix}
\right\} \\[8pt]
&= \tfrac{\sqrt{\det\left(\overline{P^{-1}}-R^{\ast} P^{-1}R\right)\det(P^{-1})}}{\pi^n}\,
e^{ -(z-\mu)^\ast\overline{P^{-1}}(z-\mu) +
\operatorname{Re}\left((z-\mu)^\intercal R^\intercal\overline{P^{-1}}(z-\mu)\right)},
\end{align}
where and .
Characteristic function
The characteristic function of complex normal distribution is given by
:
\varphi(w) = \exp\!\big\{i\operatorname{Re}(\overline{w}'\mu) - \tfrac{1}{4}\big(\overline{w}'\Gamma w + \operatorname{Re}(\overline{w}'C\overline{w})\big)\big\},
where the argument is an n-dimensional complex vector.
Properties
- If is a complex normal n-vector, an m×n matrix, and a constant m-vector, then the linear transform will be distributed also complex-normally:
:
Z\ \sim\ \mathcal{CN}(\mu,\, \Gamma,\, C) \quad \Rightarrow \quad AZ+b\ \sim\ \mathcal{CN}(A\mu+b,\, A \Gamma A^{\mathrm H},\, A C A^{\mathrm T})
- If is a complex normal n-vector, then
:
2\Big[ (\mathbf{Z}-\mu)^{\mathrm H} \overline{P^{-1}}(\mathbf{Z}-\mu) -
\operatorname{Re}\big((\mathbf{Z}-\mu)^{\mathrm T} R^{\mathrm T} \overline{P^{-1}}(\mathbf{Z}-\mu)\big)
\Big]\ \sim\ \chi^2(2n)
- Central limit theorem. If are independent and identically distributed complex random variables, then
:
\sqrt{T}\Big( \tfrac{1}{T}\textstyle\sum_{t=1}^T Z_t - \operatorname{E}[Z_t]\Big) \ \xrightarrow{d}\
\mathcal{CN}(0,\,\Gamma,\,C),
:where and .
- The modulus of a complex normal random variable follows a Hoyt distribution.{{cite web |title=The Hoyt Distribution (Documentation for R package 'shotGroups' version 0.6.2) |author=Daniel Wollschlaeger |url=http://finzi.psych.upenn.edu/usr/share/doc/library/shotGroups/html/hoyt.html }}{{Dead link|date=July 2019 |bot=InternetArchiveBot |fix-attempted=yes }}
Circularly-symmetric central case
=Definition=
A complex random vector is called circularly symmetric if for every deterministic the distribution of equals the distribution of .{{rp|pp. 500–501}}
{{main|Complex random vector#Circular symmetry}}
Central normal complex random vectors that are circularly symmetric are of particular interest because they are fully specified by the covariance matrix .
The circularly-symmetric (central) complex normal distribution corresponds to the case of zero mean and zero relation matrix, i.e. and .{{rp|p. 507}}[http://www.rle.mit.edu/rgallager/documents/CircSymGauss.pdf bookchapter, Gallager.R] This is usually denoted
:
=Distribution of real and imaginary parts=
If is circularly-symmetric (central) complex normal, then the vector is multivariate normal with covariance structure
:
\begin{pmatrix}\mathbf{X} \\ \mathbf{Y}\end{pmatrix} \ \sim\
\mathcal{N}\Big( \begin{bmatrix}
0 \\
0
\end{bmatrix},\
\tfrac{1}{2}\begin{bmatrix}
\operatorname{Re}\,\Gamma & -\operatorname{Im}\,\Gamma \\
\operatorname{Im}\,\Gamma & \operatorname{Re}\,\Gamma
\end{bmatrix}\Big)
where .
=Probability density function=
For nonsingular covariance matrix , its distribution can also be simplified as{{rp|p. 508}}
:
f_{\mathbf{Z}}(\mathbf{z}) = \tfrac{1}{\pi^n \det(\Gamma)}\, e^{ -(\mathbf{z}-\mathbf{\mu})^{\mathrm H} \Gamma^{-1} (\mathbf{z}-\mathbf{\mu})}
.
Therefore, if the non-zero mean and covariance matrix are unknown, a suitable log likelihood function for a single observation vector would be
:
\ln(L(\mu,\Gamma)) = -\ln (\det(\Gamma)) -\overline{(z - \mu)}' \Gamma^{-1} (z - \mu) -n \ln(\pi).
The standard complex normal (defined in {{EquationNote|Eq.1}}) corresponds to the distribution of a scalar random variable with , and . Thus, the standard complex normal distribution has density
:
f_Z(z) = \tfrac{1}{\pi} e^{-\overline{z}z} = \tfrac{1}{\pi} e^{-|z|^2}.
=Properties=
The above expression demonstrates why the case , is called “circularly-symmetric”. The density function depends only on the magnitude of but not on its argument. As such, the magnitude of a standard complex normal random variable will have the Rayleigh distribution and the squared magnitude will have the exponential distribution, whereas the argument will be distributed uniformly on .
If are independent and identically distributed n-dimensional circular complex normal random vectors with , then the random squared norm
:
Q = \sum_{j=1}^k \mathbf{Z}_j^{\mathrm H} \mathbf{Z}_j = \sum_{j=1}^k \| \mathbf{Z}_j \|^2
has the generalized chi-squared distribution and the random matrix
:
W = \sum_{j=1}^k \mathbf{Z}_j \mathbf{Z}_j^{\mathrm H}
has the complex Wishart distribution with degrees of freedom. This distribution can be described by density function
:
f(w) = \frac{\det(\Gamma^{-1})^k\det(w)^{k-n}}{\pi^{n(n-1)/2}\prod_{j=1}^k(k-j)!}\
e^{-\operatorname{tr}(\Gamma^{-1}w)}
where , and is a nonnegative-definite matrix.
See also
- Complex normal ratio distribution
- {{section link|Directional statistics|Distribution of the mean}} (polar form)
- Normal distribution
- Multivariate normal distribution (a complex normal distribution is a bivariate normal distribution)
- Generalized chi-squared distribution
- Wishart distribution
- Complex random variable
References
{{More footnotes needed|date=July 2011}}
{{reflist}}
{{ProbDistributions|continuous-infinite}}
Category:Continuous distributions