Phase-type distribution

Phase-type
Parameters S,m×m subgenerator matrix
𝜶, probability row vector
Support x∈[0;∞)
PDF 𝜶exS𝑺0
See article for details
CDF 1−𝜶exS1
Mean −𝜶S−1𝟏
Median no simple closed form
Mode no simple closed form
Variance 2𝜶S−2𝟏−(𝜶S−1𝟏)2
MGF −𝜶(tI+S)−1𝑺0+α0
CF −𝜶(itI+S)−1𝑺0+α0

A phase-type distribution is a probability distribution constructed by a convolution or mixture of exponential distributions. It results from a system of one or more inter-related Poisson processes occurring in sequence, or phases. The sequence in which each of the phases occurs may itself be a stochastic process. The distribution can be represented by a random variable describing the time until absorption of a Markov process with one absorbing state. Each of the states of the Markov process represents one of the phases.

It has a discrete-time equivalent – the discrete phase-type distribution.

The set of phase-type distributions is dense in the field of all positive-valued distributions, that is, it can be used to approximate any positive-valued distribution.

Definition

Consider a continuous-time Markov process with m + 1 states, where m ≥ 1, such that the states 1,...,m are transient states and state 0 is an absorbing state. Further, let the process have an initial probability of starting in any of the m + 1 phases given by the probability vector (α0,α) where α0 is a scalar and α is a 1 × m vector.

The continuous phase-type distribution is the distribution of time from the above process's starting until absorption in the absorbing state.

This process can be written in the form of a transition rate matrix,

Q=[0𝟎𝐒0S],

where S is an m × m matrix and S0 = –S1. Here 1 represents an m × 1 column vector with every element being 1.

Characterization

The distribution of time X until the process reaches the absorbing state is said to be phase-type distributed and is denoted PH(α,S).

The distribution function of X is given by,

F(x)=1−𝜶exp⁡(Sx)𝟏,

and the density function,

f(x)=𝜶exp⁡(Sx)𝐒𝟎,

for all x > 0, where exp( · ) is the matrix exponential. It is usually assumed the probability of process starting in the absorbing state is zero (i.e. α0= 0). The moments of the distribution function are given by

E[Xn]=(−1)nn!𝜶S−n𝟏.

The Laplace transform of the phase type distribution is given by

M(s)=α0+𝜶(sI−S)−1𝐒𝟎,

where I is the identity matrix.

Special cases

The following probability distributions are all considered special cases of a continuous phase-type distribution:

As the phase-type distribution is dense in the field of all positive-valued distributions, we can represent any positive valued distribution. However, the phase-type is a light-tailed or platykurtic distribution. So the representation of heavy-tailed or leptokurtic distribution by phase type is an approximation, even if the precision of the approximation can be as good as we want.

Examples

In all the following examples it is assumed that there is no probability mass at zero, that is α0 = 0.

Exponential distribution

The simplest non-trivial example of a phase-type distribution is the exponential distribution of parameter λ. The parameter of the phase-type distribution are : S = -λ and α = 1.

Hyperexponential or mixture of exponential distribution

The mixture of exponential or hyperexponential distribution with λ1,λ2,...,λn>0 can be represented as a phase type distribution with

𝜶=(α1,α2,α3,α4,...,αn)

with ∑i=1nαi=1 and

S=[−λ100000−λ200000−λ300000−λ400000−λ5].

This mixture of densities of exponential distributed random variables can be characterized through

f(x)=∑i=1nαiλie−λix=∑i=1nαifXi(x),

or its cumulative distribution function

F(x)=1−∑i=1nαie−λix=∑i=1nαiFXi(x).

with Xi∼Exp(λi)

Erlang distribution

The Erlang distribution has two parameters, the shape an integer k > 0 and the rate λ > 0. This is sometimes denoted E(k,λ). The Erlang distribution can be written in the form of a phase-type distribution by making S a k×k matrix with diagonal elements -λ and super-diagonal elements λ, with the probability of starting in state 1 equal to 1. For example, E(5,λ),

𝜶=(1,0,0,0,0),

and

S=[−λλ0000−λλ0000−λλ0000−λλ0000−λ].

For a given number of phases, the Erlang distribution is the phase type distribution with smallest coefficient of variation.

The hypoexponential distribution is a generalisation of the Erlang distribution by having different rates for each transition (the non-homogeneous case).

Mixture of Erlang distribution

The mixture of two Erlang distributions with parameter E(3,β1), E(3,β2) and (α1,α2) (such that α1 + α2 = 1 and for each i, αi ≥ 0) can be represented as a phase type distribution with

𝜶=(α1,0,0,α2,0,0),

and

S=[−β1β100000−β1β100000−β1000000−β2β200000−β2β200000−β2].

Coxian distribution

The Coxian distribution is a generalisation of the Erlang distribution. Instead of only being able to enter the absorbing state from state k it can be reached from any phase. The phase-type representation is given by,

S=[−λ1p1λ10…000−λ2p2λ2⋱00⋮⋱⋱⋱⋱⋮00⋱−λk−2pk−2λk−2000…0−λk−1pk−1λk−100…00−λk]

and

𝜶=(1,0,…,0),

where 0 < p1,...,pk-1 ≤ 1. In the case where all pi = 1 we have the Erlang distribution. The Coxian distribution is extremely important as any acyclic phase-type distribution has an equivalent Coxian representation.

The generalised Coxian distribution relaxes the condition that requires starting in the first phase.

Properties

Minima of Independent PH Random Variables

Similarly to the exponential distribution, the class of PH distributions is closed under minima of independent random variables. A description of this is here.

Generating samples from phase-type distributed random variables

BuTools includes methods for generating samples from phase-type distributed random variables.

Approximating other distributions

Any distribution can be arbitrarily well approximated by a phase type distribution. In practice, however, approximations can be poor when the size of the approximating process is fixed. Approximating a deterministic distribution of time 1 with 10 phases, each of average length 0.1 will have variance 0.1 (because the Erlang distribution has smallest variance).

Fitting a phase type distribution to data

Methods to fit a phase type distribution to data can be classified as maximum likelihood methods or moment matching methods. Fitting a phase type distribution to heavy-tailed distributions has been shown to be practical in some situations.

See also