regenerative process

File:Warehouse md17.jpg

In applied probability, a regenerative process is a class of stochastic process with the property that certain portions of the process can be treated as being statistically independent of each other.{{Cite book | last1 = Ross | first1 = S. M. | chapter = Renewal Theory and Its Applications | doi = 10.1016/B978-0-12-375686-2.00003-0 | title = Introduction to Probability Models | pages = 421–641 | year = 2010 | isbn = 9780123756862 }} This property can be used in the derivation of theoretical properties of such processes.

History

Regenerative processes were first defined by Walter L. Smith in Proceedings of the Royal Society A in 1955.{{Cite journal

| last1 = Schellhaas | first1 = Helmut

| doi = 10.1287/moor.4.1.70

| title = Semi-Regenerative Processes with Unbounded Rewards

| journal = Mathematics of Operations Research

| volume = 4

| pages = 70–78

| year = 1979

| jstor = 3689240}}{{Cite journal | last1 = Smith | first1 = W. L. | author-link1 = Wally Smith (mathematician)| title = Regenerative Stochastic Processes | doi = 10.1098/rspa.1955.0198 | journal = Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences | volume = 232 | issue = 1188 | pages = 6–31| year = 1955 |bibcode = 1955RSPSA.232....6S }}

Definition

A regenerative process is a stochastic process with time points at which, from a probabilistic point of view, the process restarts itself.{{cite book|title=Introduction to probability models|author=Sheldon M. Ross|isbn=0-12-598062-0|page=442|year=2007|publisher=Academic Press}} These time point may themselves be determined by the evolution of the process. That is to say, the process {X(t), t ≥ 0} is a regenerative process if there exist time points 0 ≤ T0 < T1 < T2 < ... such that the post-Tk process {X(Tk + t) : t ≥ 0}

  • has the same distribution as the post-T0 process {X(T0 + t) : t ≥ 0}
  • is independent of the pre-Tk process {X(t) : 0 ≤ t < Tk}

for k ≥ 1.{{Cite book | first1 = Peter J. | last1 = Haas|author-link= Peter J. Haas (computer scientist)| doi = 10.1007/0-387-21552-2_6 | chapter = Regenerative Simulation | title = Stochastic Petri Nets | series = Springer Series in Operations Research and Financial Engineering | pages = 189–273 | year = 2002 | isbn = 0-387-95445-7 }} Intuitively this means a regenerative process can be split into i.i.d. cycles.{{Cite book | first1 = Søren | last1 = Asmussen| doi = 10.1007/0-387-21525-5_6 | chapter = Regenerative Processes | title = Applied Probability and Queues | series = Stochastic Modelling and Applied Probability | volume = 51 | pages = 168–185 | year = 2003 | isbn = 978-0-387-00211-8 }}

When T0 = 0, X(t) is called a nondelayed regenerative process. Else, the process is called a delayed regenerative process.

Examples

  • Renewal processes are regenerative processes, with T1 being the first renewal.
  • Alternating renewal processes, where a system alternates between an 'on' state and an 'off' state.
  • A recurrent Markov chain is a regenerative process, with T1 being the time of first recurrence. This includes Harris chains.
  • Reflected Brownian motion is a regenerative process (where one measures the time it takes particles to leave and come back).

Properties

::\lim_{t \to \infty} \frac{1}{t}\int_0^t X(s) ds= \frac{\mathbb{E}[R]}{\mathbb{E}[\tau]}.

:where \tau is the length of the first cycle and R=\int_0^\tau X(s) ds is the value over the first cycle.

  • A measurable function of a regenerative process is a regenerative process with the same regeneration time

References

{{reflist}}

{{Stochastic processes}}

Category:Stochastic processes