L2 and a.s. ergodic theorem for stationary sequences via covariance decay

[11/55%]
Show
LaTeX

Let {Xn,n∈Z}\left\{ X_{n}, n \in \mathbb {Z}\right\} be a stationary process with mean aa and covariance function R=R(n),n∈ZR = R(n), n \in \mathbb {Z}. Prove that as N→∞N \rightarrow \infty

1N∑k=0N−1Xk⟶L2(Ω)a⟺1N∑k=0N−1R(k)→0 \frac{1}{N} \sum _{k = 0}^{N-1} X_{k} \stackrel{L^{2}(\Omega )}{\longrightarrow } a \Longleftrightarrow \frac{1}{N} \sum _{k = 0}^{N-1} R(k) \rightarrow 0
?

Suppose that, under the conditions of the preceding exercise,

1N2∑k=1N∑m=1NR(k−m)≡1N∑∣k∣⩽N−1R(k)(1−∣k∣/N)⩽cN−γ(85) \frac{1}{N^{2}} \sum _{k = 1}^{N} \sum _{m = 1}^{N} R(k-m) \equiv \frac{1}{N} \sum _{\left|k\right| \leqslant N-1} R(k)(1-\left|k\right| / N) \leqslant c N^{-\gamma } \tag {85}

for some c,γ>0c, \gamma > 0 and all N∈NN \in \mathbb {N}. Prove that then

1N∑k=0N−1Xk→0 a.s. as N→∞ \frac{1}{N} \sum _{k = 0}^{N-1} X_{k} \rightarrow 0 \text{ a.s. as } N \rightarrow \infty

Show that condition (85) holds if R(n)=O(n−γ)R(n) = O\left(n^{-\gamma }\right) as n→∞n \rightarrow \infty.

?

Let X1,X2,…X_{1}, X_{2}, \ldots be a real-valued stationary sequence with zero means and autocovariance function c(m)c(m). Show that

Var⁡[1n∑j=1nXj]=c(0)∫(−π,π](sin⁡(nλ/2)nsin⁡(λ/2))2dF(λ) \operatorname {Var}\left[\frac{1}{n} \sum _{j = 1}^{n} X_{j}\right] = c(0) \int _{(-\pi , \pi ]}\left(\frac{\sin (n \lambda / 2)}{n \sin (\lambda / 2)}\right)^{2} d F(\lambda )

where FF is the spectral distribution function. Deduce that n−1∑j=1nXj→ m.s. 0n^{-1} \sum_{j = 1}^{n} X_{j} \xrightarrow {\text{ m.s. }} 0 if and only if F(0)−F(0−)=0F(0)-F(0-) = 0, and show that

c(0){F(0)−F(0−)}=lim⁡n→∞1n∑j=0n−1c(j) c(0)\left\{ F(0)-F(0-)\right\} = \lim _{n \rightarrow \infty } \frac{1}{n} \sum _{j = 0}^{n-1} c(j)
?

Assume that X1,X2,…X_{1}, X_{2}, \ldots is a stationary sequence with autocovariance function c(m)c(m). Show that

Var⁡[1n∑i=1nXi]=2n2∑j=1n∑i=0j−1c(i)−c(0)n \operatorname {Var}\left[\frac{1}{n} \sum _{i = 1}^{n} X_{i}\right] = \frac{2}{n^{2}} \sum _{j = 1}^{n} \sum _{i = 0}^{j-1} c(i)-\frac{c(0)}{n}

Assuming that j−1∑i=0j−1c(i)→σ2j^{-1} \sum_{i = 0}^{j-1} c(i) \rightarrow \sigma^{2} as j→∞j \rightarrow \infty, show that

Var⁡[1n∑i=1nXi]→σ2 as n→∞ \operatorname {Var}\left[\frac{1}{n} \sum _{i = 1}^{n} X_{i}\right] \rightarrow \sigma ^{2} \quad \text{ as } n \rightarrow \infty
?

Let X={Xn:n≥1}X = \left\{ X_{n}: n \geq 1\right\} be stationary with constant mean μ=E[Xn]\mu = \mathbb {E}\left[X_{n}\right] for all nn, and such that Cov⁡[X1,Xn]→0\operatorname {Cov}\left[X_{1}, X_{n}\right] \rightarrow 0 as n→∞n \rightarrow \infty. Show that n−1∑j=1nXj→ m.s. μn^{-1} \sum_{j = 1}^{n} X_{j} \xrightarrow {\text{ m.s. }} \mu.

?

Let f1,…,fnf_1,\ldots ,f_n be different (non-random) frequencies, and let A1,…,AnA_1,\ldots ,A_n and ϕ1,…,ϕn\phi_1,\ldots ,\phi_n be mutually independent random variables, with all ϕk\phi_k uniform on [0,2π][0,2\pi ]. Let A0A_0 be a random constant, independent of all other AkA_k and ϕk\phi_k. Consider the process

X(t)=A0+∑k=1nAkcos⁡(2πfkt+ϕk), X(t) = A_0 + \sum _{k=1}^{n} A_k\cos (2\pi f_k t+\phi _k),

and the time-averaged power ET=1T∫0TX(t)2 dtE_T=\frac{1}{T}\int_0^T X(t)^2\, \mathrm{d}t over the interval [0,T][0,T]. Expanding X(t)2X(t)^2 by trigonometric identities gives

ET=1T∫0TX(t)2 dt=1T(TA02+2∑k=1nA0Ak∫0Tcos⁡(2πfkt+ϕk) dt+∑k=1nAk2∫0Tcos⁡2(2πfkt+ϕk) dt+2∑l=1n−1∑k=l+1nAkAl∫0Tcos⁡(2πflt+ϕl)cos⁡(2πfkt+ϕk) dt). E_T = \frac{1}{T}\int _0^T X(t)^2\, \mathrm{d}t = \frac{1}{T}\left(TA_0^2+2\sum _{k=1}^{n}A_0A_k\int _0^T\cos (2\pi f_k t+\phi _k)\, \mathrm{d}t+\sum _{k=1}^{n}A_k^2\int _0^T\cos ^2(2\pi f_k t+\phi _k)\, \mathrm{d}t+2\sum _{l=1}^{n-1}\sum _{k=l+1}^{n}A_kA_l\int _0^T\cos (2\pi f_l t+\phi _l)\cos (2\pi f_k t+\phi _k)\, \mathrm{d}t\right).

It is stated to be "easy to see" that T−1∫0Tcos⁡(2πfkt+ϕk) dt→0T^{-1}\int_0^T\cos (2\pi f_k t+\phi_k)\, \mathrm{d}t \to 0 as T→∞T\to \infty, and also, for fk≠flf_k \neq f_l,

T−1∫0Tcos⁡(2πflt+ϕl)cos⁡(2πfkt+ϕk) dt→0,T−1∫0Tcos⁡2(2πfkt+ϕk) dt→1/2, T^{-1}\int _0^T\cos (2\pi f_l t+\phi _l)\cos (2\pi f_k t+\phi _k)\, \mathrm{d}t \to 0, \qquad T^{-1}\int _0^T\cos ^2(2\pi f_k t+\phi _k)\, \mathrm{d}t \to 1/2,

so that, as T→∞T\to \infty,

ET→A02+∑k=1nAk2/2. E_T \to A_0^2 + \sum _{k=1}^{n}A_k^2/2.

Complete the "easy to see" part of this convergence, i.e., prove the three limit statements above.

?

Let YY and {Xn,n=1,2,…}\left\{ X_n, n=1,2,\ldots \right\} be independent normal variables and define Zn=Xn+YZ_n = X_n+Y. Is {Zn,n=1,2,…}\left\{ Z_n, n=1,2,\ldots \right\} a linearly ergodic sequence? Compare with the covariance criterion for ergodicity.

?

Let {Xn,n∈Z}\left\{ X_{n}, n \in \mathbb {Z}\right\} be a wide-sense stationary sequence with mean aa and covariance function R(n)R(n). Prove that

1n∑k=1nXk⟶L2a \frac{1}{n} \sum _{k=1}^{n} X_{k} \stackrel{L^{2}}{\longrightarrow } a

if and only if

1n∑k=1nR(k)⟶0. \frac{1}{n} \sum _{k=1}^{n} R(k) \longrightarrow 0.
?

Let (Xt,t∈R)\left(X_{t}, t \in \mathbb {R}\right) be a wide-sense stationary process, and

Xt=m+∫ReitλZ(dλ), X_{t}=m+\int _{\mathbb {R}} e^{i t \lambda } Z(d \lambda ),

its spectral representation. Prove that

(L2)lim⁡b−a→+∞1b−a(∫abXtdt)=m+Z({0}). \left(L^{2}\right) \lim _{b-a \rightarrow +\infty } \frac{1}{b-a}\left(\int _{a}^{b} X_{t} d t\right)=m+Z(\left\{ 0\right\} ).
?

Let {ξk}\left\{ \xi_{k}\right\} be a stationary sequence, E[ξ0ξn]−(E[ξ0])2→0\mathbb {E}\left[\xi_{0} \xi_{n}\right]-\left(\mathbb {E}\left[\xi_{0}\right]\right)^{2} \rightarrow 0 as n→∞n \rightarrow \infty. Prove that

lim⁡n→∞1n∑k=0n−1ξk=E[ξ0]. \lim _{n \rightarrow \infty } \frac{1}{n} \sum _{k = 0}^{n-1} \xi _{k} = \mathbb {E}\left[\xi _{0}\right] .
?

Let the correlation function of a random process ξt\xi_{t} stationary in the wide sense tend to zero at infinity. Prove that 1t2−t1∫t1t2ξtdt\frac{1}{t_{2}-t_{1}} \int_{t_{1}}^{t_{2}} \xi_{t} d t converges to E[ξt]\mathbb {E}\left[\xi_{t}\right] in the mean square as t2−t1→∞t_{2}-t_{1} \rightarrow \infty.

?

References

[БуШи05] Булинский А.В., Ширяев А.Н. Теория случайных процессов. ФИЗМАТЛИТ, 2005.
[GrSt20] Grimmett G.R., Stirzaker D.R. Probability and Random Processes. 4th ed., Oxford University Press, 2020.
[LRS14] Lindgren G., Rootzén H., Sandsten M. Stationary Stochastic Processes for Scientists and Engineers. CRC Press (Taylor & Francis Group), 2014.
[ЖРШ16] Жуковский М.Е., Родионов И.В., Шабанов Д.А. Основы теории случайных процессов. МФТИ, 2016.
[ПУУ86] Прохоров А.В., Ушаков В.Г., Ушаков Н. Задачи по теории вероятностей. Наука. Главная редакция физико-математической литературы, 1986.