regenerative process
In applied probability, a regenerative process is a class of stochastic process with the property that certain portions of the process can be treated as being statistically independent of each other.{{Cite book | last1 = Ross | first1 = S. M. | chapter = Renewal Theory and Its Applications | doi = 10.1016/B978-0-12-375686-2.00003-0 | title = Introduction to Probability Models | pages = 421–641 | year = 2010 | isbn = 9780123756862 }} This property can be used in the derivation of theoretical properties of such processes.
History
Regenerative processes were first defined by Walter L. Smith in Proceedings of the Royal Society A in 1955.{{Cite journal
| last1 = Schellhaas | first1 = Helmut
| doi = 10.1287/moor.4.1.70
| title = Semi-Regenerative Processes with Unbounded Rewards
| journal = Mathematics of Operations Research
| volume = 4
| pages = 70–78
| year = 1979
Definition
A regenerative process is a stochastic process with time points at which, from a probabilistic point of view, the process restarts itself.{{cite book|title=Introduction to probability models|author=Sheldon M. Ross|isbn=0-12-598062-0|page=442|year=2007|publisher=Academic Press}} These time point may themselves be determined by the evolution of the process. That is to say, the process {X(t), t ≥ 0} is a regenerative process if there exist time points 0 ≤ T0 < T1 < T2 < ... such that the post-Tk process {X(Tk + t) : t ≥ 0}
- has the same distribution as the post-T0 process {X(T0 + t) : t ≥ 0}
- is independent of the pre-Tk process {X(t) : 0 ≤ t < Tk}
for k ≥ 1.{{Cite book | first1 = Peter J. | last1 = Haas|author-link= Peter J. Haas (computer scientist)| doi = 10.1007/0-387-21552-2_6 | chapter = Regenerative Simulation | title = Stochastic Petri Nets | series = Springer Series in Operations Research and Financial Engineering | pages = 189–273 | year = 2002 | isbn = 0-387-95445-7 }} Intuitively this means a regenerative process can be split into i.i.d. cycles.{{Cite book | first1 = Søren | last1 = Asmussen| doi = 10.1007/0-387-21525-5_6 | chapter = Regenerative Processes | title = Applied Probability and Queues | series = Stochastic Modelling and Applied Probability | volume = 51 | pages = 168–185 | year = 2003 | isbn = 978-0-387-00211-8 }}
When T0 = 0, X(t) is called a nondelayed regenerative process. Else, the process is called a delayed regenerative process.
Examples
- Renewal processes are regenerative processes, with T1 being the first renewal.
- Alternating renewal processes, where a system alternates between an 'on' state and an 'off' state.
- A recurrent Markov chain is a regenerative process, with T1 being the time of first recurrence. This includes Harris chains.
- Reflected Brownian motion is a regenerative process (where one measures the time it takes particles to leave and come back).
Properties
- By the renewal reward theorem, with probability 1,Sigman, Karl (2009) Regenerative Processes, lecture notes
::
:where is the length of the first cycle and is the value over the first cycle.
- A measurable function of a regenerative process is a regenerative process with the same regeneration time