stochastic equicontinuity
In estimation theory in statistics, stochastic equicontinuity is a property of estimators (estimation procedures) that is useful in dealing with their asymptotic behaviour as the amount of data increases.{{cite book |first=Robert M. |last=de Jong |chapter=Stochastic Equicontinuity for Mixing Processes |title=Asymptotic Theory of Expanding Parameter Space Methods and Data Dependence in Econometrics |location=Amsterdam |year=1993 |isbn=90-5170-227-2 |pages=53–72 }} It is a version of equicontinuity used in the context of functions of random variables: that is, random functions. The property relates to the rate of convergence of sequences of random variables and requires that this rate is essentially the same within a region of the parameter space being considered.
For instance, stochastic equicontinuity, along with other conditions, can be used to show uniform weak convergence, which can be used to prove the convergence of extremum estimators.{{cite journal |last=Newey |first=Whitney K. |year=1991 |title=Uniform Convergence in Probability and Stochastic Equicontinuity |journal=Econometrica |volume=59 |issue=4 |pages=1161–1167 |doi=10.2307/2938179 |jstor=2938179 }}
Definition
{{Expand section|date=September 2010|{{JSTOR|2938179}}}}
Let be a family of random functions defined from , where is any normed metric space. Here might represent a sequence of estimators applied to datasets of size n, given that the data arises from a population for which the parameter indexing the statistical model for the data is θ. The randomness of the functions arises from the data generating process under which a set of observed data is considered to be a realisation of a probabilistic or statistical model. However, in , θ relates to the model currently being postulated or fitted rather than to an underlying model which is supposed to represent the mechanism generating the data. Then is stochastically equicontinuous if, for every and , there is a such that:
:
Here B(θ, δ) represents a ball in the parameter space, centred at θ and whose radius depends on δ.
Applications
= Econometrics =
- M-Estimators: Stochastic equicontinuity is needed to prove the consistency and asymptotic normality of M-estimators.{{Cite web |date=15 February 2007 |title=Applications of ULLNs: Consistency of M-estimators |url=https://people.eecs.berkeley.edu/~jordan/courses/210B-spring08/lectures/stat210b_lecture_9.pdf}}
Example: Consider an M-estimator defined by minimizing a sample objective function . Stochastic equicontinuity helps in showing that converges uniformly to its population counterpart , ensuring that the estimator converges to the true parameter .
- Nonparametric Estimation: In nonparametric estimation, stochastic equicontinuity is needed in establishing the uniform convergence of nonparametric estimators. Like - kernel density estimators or spline regressions.{{Cite web |date=30 August 2010 |title=Uniform Convergence in Probability and Stochastic Equicontinuity |url=https://users.ssc.wisc.edu/~xshi/Newey1991.pdf}}
Example: For a kernel density estimator , stochastic equicontinuity ensures that converges uniformly to the true density function as the sample size increases.
= Time Series Models =
- Nonlinear Time Series Models: In nonlinear time series models, stochastic equicontinuity ensures the stability and consistency of estimators.
Example: Consider a GARCH model used to model volatility in financial time series. Stochastic equicontinuity helps the estimated parameters of the GARCH model converge to the true parameters as the sample size increases, despite the model’s nonlinear nature.{{Cite journal |last=Hagemann |first=Andreas |title=Stochastic equicontinuity in nonlinear time series models |journal=The Econometrics Journal |date=2014 |volume=17 |pages=188–196 |url=https://academic.oup.com/ectj/article-abstract/17/1/188/5056416 |language=English |doi=10.1111/ectj.12013|arxiv=1206.2385 }}
- Consistency of Estimators: Stochastic equicontinuity is a key condition for proving the consistency of estimators in time series models.
References
{{Reflist}}
Further reading
- {{cite book |first=David |last=Pollard |title=Convergence of Stochastic Processes |location=New York |publisher=Springer |year=1984 |chapter=Stochastic Equicontinuity |pages=138–142 |isbn=0-387-90990-7 |chapter-url=https://books.google.com/books?id=B2vgGMa9vd4C&pg=PA138 }}
Category:Asymptotic theory (statistics)
{{probability-stub}}