Markovian arrival process
{{About|arrival processes to queues|bivariate processes|Markov additive process}}
In queueing theory, a discipline within the mathematical theory of probability, a Markovian arrival process (MAP or MArP{{Cite book | first1=S. R. |last1=Asmussen| doi = 10.1007/0-387-21525-5_11 | chapter = Markov Additive Models | title = Applied Probability and Queues | series = Stochastic Modelling and Applied Probability | volume = 51 | pages = 302–339 | year = 2003 | isbn = 978-0-387-00211-8 }}) is a mathematical model for the time between job arrivals to a system. The simplest such process is a Poisson process where the time between each arrival is exponentially distributed.{{Cite journal | last1 = Asmussen | first1 = S. | title = Matrix-analytic Models and their Analysis | doi = 10.1111/1467-9469.00186 | journal = Scandinavian Journal of Statistics | volume = 27 | issue = 2 | pages = 193–226 | year = 2000 | jstor = 4616600| s2cid = 122810934 | doi-access = free }}{{Cite book | last1 = Chakravarthy | first1 = S. R. | chapter = Markovian Arrival Processes | doi = 10.1002/9780470400531.eorms0499 | title = Wiley Encyclopedia of Operations Research and Management Science | year = 2011 | isbn = 9780470400531 }}
The processes were first suggested by Marcel F. Neuts in 1979.{{cite journal | last1 = Neuts | first1 = Marcel F. | year = 1979 | title = A Versatile Markovian Point Process | journal = Journal of Applied Probability | volume = 16 | issue = 4 | pages = 764–779 | publisher = Applied Probability Trust | jstor = 3213143 | doi = 10.2307/3213143 | s2cid = 123525892 }}
Definition
A Markov arrival process is defined by two matrices, D0 and D1 where elements of D0 represent hidden transitions and elements of D1 observable transitions. The block matrix Q below is a transition rate matrix for a continuous-time Markov chain.{{Cite journal | last1 = Casale | first1 = G. | doi = 10.1145/2007116.2007176 | title = Building accurate workload models using Markovian arrival processes | journal = ACM SIGMETRICS Performance Evaluation Review | volume = 39 | pages = 357 | year = 2011 }}
:
Q=\left[\begin{matrix}
D_{0}&D_{1}&0&0&\dots\\
0&D_{0}&D_{1}&0&\dots\\
0&0&D_{0}&D_{1}&\dots\\
\vdots & \vdots & \ddots & \ddots & \ddots
\end{matrix}\right]\; .
The simplest example is a Poisson process where D0 = −λ and D1 = λ where there is only one possible transition, it is observable, and occurs at rate λ. For Q to be a valid transition rate matrix, the following restrictions apply to the Di
:
0\leq [D_{1}]_{i,j}&<\infty \\
0\leq [D_{0}]_{i,j}&<\infty \quad i\neq j \\
\, [D_{0}]_{i,i}&<0 \\
(D_{0}+D_{1})\boldsymbol{1} &= \boldsymbol{0}
\end{align}
Special cases
=Phase-type renewal process=
The phase-type renewal process is a Markov arrival process with phase-type distributed sojourn between arrivals. For example, if an arrival process has an interarrival time distribution PH with an exit vector denoted , the arrival process has generator matrix,
:
Q=\left[\begin{matrix}
S&\boldsymbol{S}^{0}\boldsymbol{\alpha}&0&0&\dots\\
0&S&\boldsymbol{S}^{0}\boldsymbol{\alpha}&0&\dots\\
0&0&S&\boldsymbol{S}^{0}\boldsymbol{\alpha}&\dots\\
\vdots&\vdots&\ddots&\ddots&\ddots\\
\end{matrix}\right]
Generalizations
= Batch Markov arrival process =
The batch Markovian arrival process (BMAP) is a generalisation of the Markovian arrival process by allowing more than one arrival at a time.{{Cite book | last1 = Lucantoni | first1 = D. M. | chapter = The BMAP/G/1 queue: A tutorial | doi = 10.1007/BFb0013859 | title = Performance Evaluation of Computer and Communication Systems | series = Lecture Notes in Computer Science | volume = 729 | pages = 330–358 | year = 1993 | isbn = 3-540-57297-X | s2cid = 35110866 }}{{cite journal |last1=Singh |first1=Gagandeep |last2=Gupta |first2=U. C. |last3=Chaudhry |first3=M. L. |title=Detailed computational analysis of queueing-time distributions of the BMAP/G/1 queue using roots |journal=Journal of Applied Probability |date=2016 |volume=53 |issue=4 |pages=1078–1097 |doi=10.1017/jpr.2016.66 |s2cid=27505255 |url=https://www.cambridge.org/core/journals/journal-of-applied-probability/article/abs/detailed-computational-analysis-of-queueingtime-distributions-of-the-bmapg1-queue-using-roots/740DBCF255AFE602075EDB174FF0F25D}} The homogeneous case has rate matrix,
:
Q=\left[\begin{matrix}
D_{0}&D_{1}&D_{2}&D_{3}&\dots\\
0&D_{0}&D_{1}&D_{2}&\dots\\
0&0&D_{0}&D_{1}&\dots\\
\vdots & \vdots & \ddots & \ddots & \ddots
\end{matrix}\right]\; .
An arrival of size occurs every time a transition occurs in the sub-matrix . Sub-matrices have elements of , the rate of a Poisson process, such that,
:
0\leq [D_{k}]_{i,j}<\infty\;\;\;\; 1\leq k
:
0\leq [D_{0}]_{i,j}<\infty\;\;\;\; i\neq j
:
[D_{0}]_{i,i}<0\;
and
:
\sum^{\infty}_{k=0}D_{k}\boldsymbol{1}=\boldsymbol{0}
= Markov-modulated Poisson process =
The Markov-modulated Poisson process or MMPP where m Poisson processes are switched between by an underlying continuous-time Markov chain.{{Cite journal |last1=Fischer |first1=W. |last2=Meier-Hellstern |first2=K. |year=1993 |title=The Markov-modulated Poisson process (MMPP) cookbook |journal=Performance Evaluation |volume=18 |issue=2 |pages=149 |doi=10.1016/0166-5316(93)90035-S}} If each of the m Poisson processes has rate λi and the modulating continuous-time Markov has m × m transition rate matrix R, then the MAP representation is
:
D_{1} &= \operatorname{diag}\{\lambda_{1},\dots,\lambda_{m}\}\\
D_{0} &=R-D_1.
\end{align}
Fitting
A MAP can be fitted using an expectation–maximization algorithm.{{Cite book | last1 = Buchholz | first1 = P. | chapter = An EM-Algorithm for MAP Fitting from Real Traffic Data | doi = 10.1007/978-3-540-45232-4_14 | title = Computer Performance Evaluation. Modelling Techniques and Tools | series = Lecture Notes in Computer Science | volume = 2794 | pages = 218–236 | year = 2003 | isbn = 978-3-540-40814-7 }}
=Software=
- [https://github.com/kpctoolboxteam/kpc-toolbox KPC-toolbox] a library of MATLAB scripts to fit a MAP to data.{{Cite book | last1 = Casale | first1 = G. | last2 = Zhang | first2 = E. Z. | last3 = Smirni | first3 = E. | author3-link = Evgenia Smirni | doi = 10.1109/QEST.2008.33 | chapter = KPC-Toolbox: Simple Yet Effective Trace Fitting Using Markovian Arrival Processes | title = 2008 Fifth International Conference on Quantitative Evaluation of Systems | pages = 83 | year = 2008 | isbn = 978-0-7695-3360-5 | s2cid = 252444 | chapter-url = http://www.doc.ic.ac.uk/~gcasale/qest08kpctoolbox.pdf}}