Uniform integrability

In mathematics, uniform integrability is an important concept in real analysis, functional analysis and measure theory, and plays a vital role in the theory of martingales.

Measure-theoretic definition

Uniform integrability is an extension to the notion of a family of functions being dominated in $L^{1}$ which is central in dominated convergence. Several textbooks on real analysis and measure theory use the following definition:

Definition A: Let $(X, 𝔐, μ)$ be a positive measure space. A set $Φ \subset L^{1} (μ)$ is called uniformly integrable if $sup_{f \in Φ} ‖ f ‖_{L^{1} (μ)} < \infty$ , and to each $ε > 0$ there corresponds a $δ > 0$ such that

$\int_{E} | f | d μ < ε$

whenever $f \in Φ$ and $μ (E) < δ .$

Definition A is rather restrictive for infinite measure spaces. A more general definition of uniform integrability that works well in general measure spaces was introduced by G. A. Hunt.

Definition H: Let $(X, 𝔐, μ)$ be a positive measure space. A set $Φ \subset L^{1} (μ)$ is called uniformly integrable if and only if

$inf_{g \in L_{+}^{1} (μ)} sup_{f \in Φ} \int_{{| f | > g}} | f | d μ = 0$

where $L_{+}^{1} (μ) = {g \in L^{1} (μ) : g \geq 0}$ .

Since Hunt's definition is equivalent to Definition A when the underlying measure space is finite (see Theorem 2 below), Definition H is widely adopted in Mathematics.

The following result provides another equivalent notion to Hunt's. This equivalency is sometimes given as definition for uniform integrability.

Theorem 1: If $(X, 𝔐, μ)$ is a (positive) finite measure space, then a set $Φ \subset L^{1} (μ)$ is uniformly integrable if and only if

$inf_{g \in L_{+}^{1} (μ)} sup_{f \in Φ} \int (| f | - g)^{+} d μ = 0$

If in addition $μ (X) < \infty$ , then uniform integrability is equivalent to either of the following conditions

1. $inf_{a > 0} sup_{f \in Φ} \int (| f | - a)_{+} d μ = 0$ .

2. $inf_{a > 0} sup_{f \in Φ} \int_{{| f | > a}} | f | d μ = 0$

When the underlying space $(X, 𝔐, μ)$ is $σ$ -finite, Hunt's definition is equivalent to the following:

Theorem 2: Let $(X, 𝔐, μ)$ be a $σ$ -finite measure space, and $h \in L^{1} (μ)$ be such that $h > 0$ almost everywhere. A set $Φ \subset L^{1} (μ)$ is uniformly integrable if and only if $sup_{f \in Φ} ‖ f ‖_{L^{1} (μ)} < \infty$ , and for any $ε > 0$ , there exists $δ > 0$ such that

$sup_{f \in Φ} \int_{A} | f | d μ < ε$

whenever $\int_{A} h d μ < δ$ .

A consequence of Theorems 1 and 2 is that equivalence of Definitions A and H for finite measures follows. Indeed, the statement in Definition A is obtained by taking $h \equiv 1$ in Theorem 2.

Tightness, boundedness, equi-integrability and uniform integrability

Another concept associated with uniform integrability is that of tightness. In this article tightness is taken in a more general setting.

Definition: Suppose $(X, 𝔐, μ)$ is a measure space. Let $𝒦 \subset 𝔐$ be a collection of sets of finite measure. A family $Φ \subset L^{1} (μ)$ is said to be tight with respect to $𝒦$ if

$inf_{K \in 𝒦} sup_{f \in Φ} \int_{X ∖ K} | f | d μ = 0$

When $𝒦 = 𝔐 \cap L^{1} (μ)$ , $Φ$ is simply said to be tight.

When the measure space $(X, 𝔐, μ)$ is a metric space equipped with the Borel $σ$ algebra, $μ$ is a regular measure, and $𝒦$ is the collection of all compact subsets of $X$ , the notion of $𝒦$ -tightness discussed above coincides with the well known concept of tightness used in the analysis of regular measures in metric spaces

For $σ$ -finite measure spaces, it can be shown that if a family $Φ \subset L^{1} (μ)$ is uniformly integrable, then $Φ$ is tight. This is captured by the following result which is often used as definition of uniform integrability in the analysis literature:

Theorem 3: Suppose $(X, 𝔐, μ)$ is a $σ$ -finite measure space. A family $Φ \subset L^{1} (μ)$ is uniformly integrable if and only if

$sup_{f \in Φ} ‖ f ‖_{1} < \infty$ .

$inf_{a > 0} sup_{f \in Φ} \int_{{| f | > a}} | f | d μ = 0$

$Φ$ is tight.

When $μ (X) < \infty$ , condition 3 is redundant (see Theorem 1 above).

In many books in analysis , condition 2 in Theorem 3 is often replaced by another condition called equi-integrability:

Definition: A family $𝒞$ of complex or real valued measurable functions is equi-integrable (or uniformly absolutely continuous with respect to a measure $μ$ ) if for any $ε > 0$ there is $δ > 0$ such that $sup_{f \in 𝒞} \int_{A} | f | d μ < ε whenever μ (A) < δ$

Theorem 3 then says that equi-integrability together with $L^{1}$ boundedness and tightness (conditions (1) and (3) in Theorem 3) is equivalent to uniform integrability.

Relevant theorems

The following theorems describe very useful criteria for uniform integrability which have many applications in Analysis and Probability.

de la Vallée-Poussin theorem
Suppose $(X, 𝔐, μ)$ is a finite measure space. The family $ℱ \subset L^{1} (μ)$ is uniformly integrable if and only if there exists a function $G : [0, \infty) \to [0, \infty)$ such that $lim_{t \to \infty} \frac{G (t)}{t} = \infty$ and $sup_{f \in ℱ} \int_{X} G (| f |) d μ < \infty .$ The function $G$ can be chosen to be monotone increasing and convex.

Uniform integrability gives a characterization of weak compactness in $L^{1}$ .

Dunford–Pettis theorem
Suppose $(X, 𝔐, μ)$ is a $σ$ -finite measure. A family $ℱ \subset L^{1} (μ)$ has compact closure in the weak topology $σ (L^{1}, L^{\infty})$ if and only if $ℱ$ is uniformly integrable.

Probability definition

In probability theory, Definition A or the statement of Theorem 1 are often presented as definitions of uniform integrability using the notation expectation of random variables., that is,

1. A class $𝒞$ of random variables is called uniformly integrable if:

There exists a finite $M$ such that, for every $X$ in $𝒞$ , $E (| X |) \leq M$ and
For every $ε > 0$ there exists $δ > 0$ such that, for every measurable $A$ such that $P (A) \leq δ$ and every $X$ in $𝒞$ , $E (| X | I_{A}) \leq ε$ .

or alternatively

2. A class $𝒞$ of random variables is called uniformly integrable (UI) if for every $ε > 0$ there exists $K \in [0, \infty)$ such that $E (| X | I_{| X | \geq K}) \leq ε for all X \in 𝒞$ , where $I_{| X | \geq K}$ is the indicator function $I_{| X | \geq K} = {\begin{matrix} 1 & if | X | \geq K, \\ 0 & if | X | < K . \end{matrix}$ .

Related corollaries

The following results apply to the probabilistic definition.

Definition 1 could be rewritten by taking the limits as $lim_{K \to \infty} sup_{X \in 𝒞} E (| X | I_{| X | \geq K}) = 0.$
A non-UI sequence. Let $Ω = [0, 1] \subset ℝ$ , and define $X_{n} (ω) = {\begin{matrix} n, & ω \in (0, 1 / n), \\ 0, & otherwise. \end{matrix}$ Clearly $X_{n} \in L^{1}$ , and indeed $E (| X_{n} |) = 1,$ for all n. However, $E (| X_{n} | I_{{| X_{n} | \geq K}}) = 1 for all n \geq K,$ and comparing with definition 1, it is seen that the sequence is not uniformly integrable.

By using Definition 2 in the above example, it can be seen that the first clause is satisfied as $L^{1}$ norm of all $X_{n}$ s are 1 i.e., bounded. But the second clause does not hold as given any $δ$ positive, there is an interval $(0, 1 / n)$ with measure less than $δ$ and $E [| X_{m} | : (0, 1 / n)] = 1$ for all $m \geq n$ .
If $X$ is a UI random variable, by splitting $E (| X |) = E (| X | I_{{| X | \geq K}}) + E (| X | I_{{| X | < K}})$ and bounding each of the two, it can be seen that a uniformly integrable random variable is always bounded in $L^{1}$ .
If any sequence of random variables $X_{n}$ is dominated by an integrable, non-negative $Y$ : that is, for all ω and n, $| X_{n} (ω) | \leq Y (ω), Y (ω) \geq 0, E (Y) < \infty,$ then the class $𝒞$ of random variables ${X_{n}}$ is uniformly integrable.
A class of random variables bounded in $L^{p}$ ( $p > 1$ ) is uniformly integrable.

Uniform integrability and stochastic ordering

A family of random variables ${X_{i}}_{i \in I}$ is uniformly integrable if and only if there exists a random variable $X$ such that $E X < \infty$ and $| X_{i} | \leq_{i c x} X$ for all $i \in I$ , where $\leq_{i c x}$ denotes the increasing convex stochastic order defined by $A \leq_{i c x} B$ if $E ϕ (A) \leq E ϕ (B)$ for all nondecreasing convex real functions $ϕ$ .

Relation to convergence of random variables

A sequence ${X_{n}}$ converges to $X$ in the $L^{1}$ norm if and only if it converges in measure to $X$ and it is uniformly integrable. In probability terms, a sequence of random variables converging in probability also converge in the mean if and only if they are uniformly integrable. This is a generalization of Lebesgue's dominated convergence theorem, see Vitali convergence theorem.

Stochastic processes
Discrete time	Bernoulli process Branching process Chinese restaurant process Galton–Watson process Independent and identically distributed random variables Markov chain Moran process Random walk Loop-erased Self-avoiding Biased Maximal entropy
Continuous time	Additive process Airy process Bessel process Birth–death process pure birth Brownian motion Bridge Dyson Excursion Fractional Geometric Meander Cauchy process Contact process Continuous-time random walk Cox process Diffusion process Empirical process Feller process Fleming–Viot process Gamma process Geometric process Hawkes process Hunt process Interacting particle systems Itô diffusion Itô process Jump diffusion Jump process Lévy process Local time Markov additive process McKean–Vlasov process Ornstein–Uhlenbeck process Poisson process Compound Non-homogeneous Quasimartingale Schramm–Loewner evolution Semimartingale Sigma-martingale Stable process Superprocess Telegraph process Variance gamma process Wiener process Wiener sausage
Both	Branching process Gaussian process Hidden Markov model (HMM) Markov process Martingale Differences Local Sub- Super- Random dynamical system Regenerative process Renewal process Stochastic chains with memory of variable length White noise
Fields and other	Dirichlet process Gaussian random field Gibbs measure Hopfield model Ising model Potts model Boolean network Markov random field Percolation Pitman–Yor process Point process Cox Determinantal Poisson Random field Random graph
Time series models	Autoregressive conditional heteroskedasticity (ARCH) model Autoregressive integrated moving average (ARIMA) model Autoregressive (AR) model Autoregressive moving-average (ARMA) model Generalized autoregressive conditional heteroskedasticity (GARCH) model Moving-average (MA) model
Financial models	Binomial options pricing model Black–Derman–Toy Black–Karasinski Black–Scholes Chan–Karolyi–Longstaff–Sanders (CKLS) Chen Constant elasticity of variance (CEV) Cox–Ingersoll–Ross (CIR) Garman–Kohlhagen Heath–Jarrow–Morton (HJM) Heston Ho–Lee Hull–White Korn-Kreer-Lenssen LIBOR market Rendleman–Bartter SABR volatility Vašíček Wilkie
Actuarial models	Bühlmann Cramér–Lundberg Risk process Sparre–Anderson
Queueing models	Bulk Fluid Generalized queueing network M/G/1 M/M/1 M/M/c
Properties	Càdlàg paths Continuous Continuous paths Ergodic Exchangeable Feller-continuous Gauss–Markov Markov Mixing Piecewise-deterministic Predictable Progressively measurable Self-similar Stationary Time-reversible
Limit theorems	Central limit theorem Donsker's theorem Doob's martingale convergence theorems Ergodic theorem Fisher–Tippett–Gnedenko theorem Large deviation principle Law of large numbers (weak/strong) Law of the iterated logarithm Maximal ergodic theorem Sanov's theorem Zero–one laws (Blumenthal, Borel–Cantelli, Engelbert–Schmidt, Hewitt–Savage, Kolmogorov, Lévy)
Inequalities	Burkholder–Davis–Gundy Doob's martingale Doob's upcrossing Kunita–Watanabe Marcinkiewicz–Zygmund
Tools	Cameron–Martin theorem Convergence of random variables Doléans-Dade exponential Doob decomposition theorem Doob–Meyer decomposition theorem Doob's optional stopping theorem Dynkin's formula Feynman–Kac formula Filtration Girsanov theorem Infinitesimal generator Itô integral Itô's lemma Kolmogorov continuity theorem Kolmogorov extension theorem Kosambi–Karhunen–Loève theorem Lévy–Prokhorov metric Malliavin calculus Martingale representation theorem Optional stopping theorem Prokhorov's theorem Quadratic variation Reflection principle Skorokhod integral Skorokhod's representation theorem Skorokhod space Snell envelope Stochastic differential equation Tanaka Stopping time/Hitting time Stratonovich integral Uniform integrability Usual hypotheses Wiener space Classical Abstract
Disciplines	Actuarial mathematics Control theory Econometrics Ergodic theory Extreme value theory (EVT) Large deviations theory Mathematical finance Mathematical statistics Probability theory Queueing theory Renewal theory Ruin theory Signal processing Statistics Stochastic analysis Time series analysis Machine learning
List of topics Category