In probability theory, the central limit theorem says that, under certain conditions, the sum of many independent identically-distributed random variables, when scaled appropriately, converges in distribution to a standard normal distribution. The martingale central limit theorem generalizes this result for random variables to martingales, which are stochastic processes where the change in the value of the process from time t to time t + 1 has expectation zero, even conditioned on previous outcomes.
Statement Here is a simple version of the martingale central limit theorem: Let
X 1 , X 2 , … {\displaystyle X_{1},X_{2},\dots \,} be a martingale with bounded increments; that is, suppose
E [ X t + 1 − X t | X 1 , … , X t ] = 0 , {\displaystyle \operatorname {E} [X_{t+1}-X_{t}\vert X_{1},\dots ,X_{t}]=0\,,}
and
| X t + 1 − X t | ≤ k {\displaystyle |X_{t+1}-X_{t}|\leq k}
almost surely for some fixed bound k and all t. Also assume that | X 1 | ≤ k {\displaystyle |X_{1}|\leq k} almost surely. Define
σ t 2 = E [ ( X t + 1 − X t ) 2 | X 1 , … , X t ] , {\displaystyle \sigma _{t}^{2}=\operatorname {E} [(X_{t+1}-X_{t})^{2}|X_{1},\ldots ,X_{t}],}
and let
τ ν = min { t : ∑ i = 1 t σ i 2 ≥ ν } . {\displaystyle \tau _{\nu }=\min \left\{t:\sum _{i=1}^{t}\sigma _{i}^{2}\geq \nu \right\}.}
Then
X τ ν ν {\displaystyle {\frac {X_{\tau _{\nu }}}{\sqrt {\nu }}}}
converges in distribution to the normal distribution with mean 0 and variance 1 as ν → + ∞ {\displaystyle \nu \to +\infty \!} . More explicitly,
lim ν → + ∞ P ( X τ ν ν < x ) = Φ ( x ) = 1 2 π ∫ − ∞ x exp ( − u 2 2 ) d u , x ∈ R . {\displaystyle \lim _{\nu \to +\infty }\operatorname {P} \left({\frac {X_{\tau _{\nu }}}{\sqrt {\nu }}}<x\right)=\Phi (x)={\frac {1}{\sqrt {2\pi }}}\int _{-\infty }^{x}\exp \left(-{\frac {u^{2}}{2}}\right)\,du,\quad x\in \mathbb {R} .}
The sum of variances must diverge to infinity The statement of the above result implicitly assumes the variances sum to infinity, so the following holds with probability 1:
∑ t = 1 ∞ σ t 2 = ∞ {\displaystyle \sum _{t=1}^{\infty }\sigma _{t}^{2}=\infty }
This ensures that with probability 1:
τ ν < ∞ , ∀ ν ≥ 0 {\displaystyle \tau _{\nu }<\infty ,\forall \nu \geq 0}
This condition is violated, for example, by a martingale that is defined to be zero almost surely for all time.
… excerpt ends here. Continue reading the full article.
