State-transition matrix

In control theory and dynamical systems theory, the state-transition matrix is a matrix function that describes how the state of a linear system changes over time. Essentially, if the system's state is known at an initial time ⁠t0⁠, the state-transition matrix allows for the calculation of the state at any future time ⁠t⁠.

The matrix is used to find the general solution to the homogeneous linear differential equation 𝐱˙(t)=𝐀(t)𝐱(t) and is also a key component in finding the full solution for the non-homogeneous (input-driven) case.

For linear time-invariant (LTI) systems, where the matrix 𝐀 is constant, the state-transition matrix is the matrix exponential ⁠exp⁡(𝐀(t−t0))⁠. In the more complex time-variant case, where 𝐀(t) can change over time, there is no simple formula, and the matrix is typically found by calculating the Peano–Baker series.

Linear systems solutions

The state-transition matrix is used to find the solution to a general state-space representation of a linear system in the following form 𝐱˙(t)=𝐀(t)𝐱(t)+𝐁(t)𝐮(t),𝐱(t0)=𝐱0, where 𝐱(t) are the states of the system; 𝐮(t) is the input signal; 𝐀(t) and 𝐁(t) are matrix functions; and 𝐱0 is the initial condition at ⁠t0⁠. Using the state-transition matrix ⁠𝜱(t,τ)⁠, the solution is given by: 𝐱(t)=𝜱(t,t0)𝐱(t0)+∫t0t𝜱(t,τ)𝐁(τ)𝐮(τ) dτ.

The first term is known as the zero-input response and represents how the system's state would evolve in the absence of any input. The second term is known as the zero-state response and defines how the inputs impact the system.

Peano–Baker series

The most general transition matrix is given by a product integral, referred to as the Peano–Baker series: 𝜱(t,τ)=𝐈+∫τt𝐀(σ1)dσ1+∫τt𝐀(σ1)∫τσ1𝐀(σ2)dσ2dσ1+∫τt𝐀(σ1)∫τσ1𝐀(σ2)∫τσ2𝐀(σ3)dσ3dσ2dσ1+⋯, where 𝐈 is the identity matrix. This matrix converges uniformly and absolutely to a solution that exists and is unique. The series has a formal sum that can be written as 𝜱(t,τ)=exp⁡𝒯∫τt𝐀(σ)dσ, where 𝒯 is the time-ordering operator, used to ensure that the repeated product integral is in proper order. The Magnus expansion provides a means for evaluating this product.

Other properties

The state transition matrix 𝜱 satisfies the following relationships. These relationships are generic to the product integral.

  1. It is continuous and has continuous derivatives.
  2. It is never singular; in fact 𝜱−1(t,τ)=𝜱(τ,t) and ⁠𝜱−1(t,τ)𝜱(t,τ)=𝐈⁠, where 𝐈 is the identity matrix.
  3. 𝜱(t,t)=𝐈 for all ⁠t⁠.
  4. 𝜱(t2,t1)𝜱(t1,t0)=𝜱(t2,t0) for all ⁠t0≤t1≤t2⁠.
  5. It satisfies the differential equation ∂∂t𝜱(t,t0)=𝐀(t)𝜱(t,t0) with initial conditions ⁠1⁠.
  6. The state-transition matrix ⁠𝜱(t,τ)⁠, given by 𝜱(t,τ)≡𝐔(t)𝐔−1(τ) where the n×n matrix 𝐔(t) is the fundamental solution matrix that satisfies 𝐔˙(t)=𝐀(t)𝐔(t) with initial condition ⁠𝐔(t0)=𝐈⁠.
  7. Given the state 𝐱(τ) at any time ⁠τ⁠, the state at any other time t is given by the mapping ⁠𝐱(t)=𝜱(t,τ)𝐱(τ)⁠.

Estimation of the state-transition matrix

In the time-invariant case, we can define ⁠𝜱⁠, using the matrix exponential, as ⁠𝜱(t,t0)=exp⁡(𝐀(t−t0))⁠.

In the time-variant case, the state-transition matrix 𝜱(t,t0) can be estimated from the solutions of the differential equation 𝐮˙(t)=𝐀(t)𝐮(t) with initial conditions 𝐮(t0) given by ⁠[1, 0, …, 0]T⁠, ⁠[0, 1, …, 0]T⁠, ..., ⁠[0, 0, …, 1]T⁠. The corresponding solutions provide the n columns of matrix ⁠𝜱(t,t0)⁠. Now, from property 4, 𝜱(t,τ)=𝜱(t,t0)𝜱(τ,t0)−1 for all ⁠t0≤τ≤t⁠. The state-transition matrix must be determined before analysis on the time-varying solution can continue.

See also