Section 11.4

The L2L^{2} Strong Law

[5/0%]
Show
LaTeX
Problem 11.4.1

In Claim 3, show that the function gg as defined there is an element of L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ), so that we may meaningfully discuss the integral ∫Ωg dμ\int_{\Omega } g \, d\mu.

?
Remark.
?

Claim 3: Let F⊆NF \subseteq \mathbb {N} be nonempty and finite, and for each i∈Fi \in F let fif_{i} denote a function in L1(Ωi,Fi,μi)L^{1}(\Omega_{i}, \mathcal{F}_{i}, \mu_{i}). Let gg denote the mapping on Ω\Omega given for every ω∈Ω\omega \in \Omega by the rule ω↦∏i∈Ffi(ωi)\omega \mapsto \prod_{i \in F} f_{i}(\omega_{i}). Then

∫Ωg(ω) dμ(ω)=∏i∈F∫Ωifi(ωi) dμi(ωi). \int _{\Omega } g(\omega ) \, d\mu (\omega )=\prod _{i \in F} \int _{\Omega _{i}} f_{i}(\omega _{i}) \, d\mu _{i}(\omega _{i}).
Problem 11.4.2

In the statement of the L2L^{2} Strong Law, replace the assumption that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges with the assumption that ∑k=1∞ck∥gk∥22\sum_{k=1}^{\infty } c_{k} \left\| g_{k}\right\|_{2}^{2} converges, where {ck}k=1∞\left\{ c_{k}\right\}_{k=1}^{\infty } is a sequence of positive numbers such that ∑k=1∞ck<+∞\sum_{k=1}^{\infty } c_{k}<+\infty. Then ∑k=1∞ckfk(ω)\sum_{k=1}^{\infty } c_{k} f_{k}(\omega ) converges for μ\mu-a.e. ω∈Ω\omega \in \Omega.

?
Remark.
?

L2L^{2} Strong Law of Large Numbers: For each k∈Nk \in \mathbb {N}, let gkg_{k} denote a function in L2(Ωk,Fk,μk)L^{2}(\Omega_{k}, \mathcal{F}_{k}, \mu_{k}) such that ∫Ωkgk dμk=0\int_{\Omega_{k}} g_{k} \, d\mu_{k}=0. Let fkf_{k} denote the function on Ω\Omega that assigns each ω∈Ω\omega \in \Omega to gk(ωk)g_{k}(\omega_{k}). Assume that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges. Then lim⁡n1n∑k=1nfk(ω)=0\lim_{n} \frac{1}{n} \sum_{k=1}^{n} f_{k}(\omega )=0 for μ\mu-a.e. ω∈Ω\omega \in \Omega.

Problem 11.4.3

In the statement of the L2L^{2} Strong Law, replace the assumption that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges with the assumption that lim⁡n1n2∑k=1n∥fk∥22=0\lim_{n} \frac{1}{n^{2}} \sum_{k=1}^{n} \left\| f_{k}\right\|_{2}^{2}=0. Deduce for every ϵ>0\epsilon >0 that

lim⁡nμ({ω∈Ω:∣1n∑k=1nfk(ω)∣>ϵ})=0, \lim _{n} \mu \left(\left\{ \omega \in \Omega : \left|\frac{1}{n} \sum _{k=1}^{n} f_{k}(\omega )\right|>\epsilon \right\} \right)=0,

which shows that {1n∑k=1nfk}n=1∞\left\{ \frac{1}{n} \sum_{k=1}^{n} f_{k}\right\}_{n=1}^{\infty } converges in μ\mu-measure to zero. This result is known as the Weak Law of Large Numbers.

?
Remark.
?

L2L^{2} Strong Law of Large Numbers: For each k∈Nk \in \mathbb {N}, let gkg_{k} denote a function in L2(Ωk,Fk,μk)L^{2}(\Omega_{k}, \mathcal{F}_{k}, \mu_{k}) such that ∫Ωkgk dμk=0\int_{\Omega_{k}} g_{k} \, d\mu_{k}=0. Let fkf_{k} denote the function on Ω\Omega that assigns each ω∈Ω\omega \in \Omega to gk(ωk)g_{k}(\omega_{k}). Assume that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges. Then lim⁡n1n∑k=1nfk(ω)=0\lim_{n} \frac{1}{n} \sum_{k=1}^{n} f_{k}(\omega )=0 for μ\mu-a.e. ω∈Ω\omega \in \Omega.

Problem 11.4.4

Reconsider the framework of Exercise 11.2.5, and recall the definitions of fnf_{n} and hnh_{n} for each n∈Nn \in \mathbb {N}.

?
(a)

The hypotheses of the Strong Law are satisfied since ∥fj∥22=14\left\| f_{j}\right\|_{2}^{2}=\frac{1}{4} for each j∈Nj \in \mathbb {N}, and hence lim⁡nhn=lim⁡n1n(f1+⋯+fn)=0\lim_{n} h_{n}=\lim_{n} \frac{1}{n}(f_{1}+\cdots +f_{n})=0 μ\mu-a.e. on Ω\Omega, that is hnh_{n} converges to zero μ\mu-a.e. on Ω\Omega.

(b)

Show that the result of (a) implies the result of part (d) of Exercise 11.2.5.

(c)

As with part (e) of Exercise 11.2.5, discuss the result of (a) in terms of tossing a fair coin.

Remark.
?

Framework of Exercise 11.2.5: let I=NI=\mathbb {N}, let Ωi={0,1}\Omega_{i}=\left\{ 0,1\right\} for each i∈Ni \in \mathbb {N}, and let Fi=2Ωi\mathcal{F}_{i}=2^{\Omega_{i}} for each i∈Ni \in \mathbb {N}. For each i∈Ni \in \mathbb {N}, let μi\mu_{i} be defined on Fi\mathcal{F}_{i} by writing μi({0})=μi({1})=12\mu_{i}(\left\{ 0\right\} )=\mu_{i}(\left\{ 1\right\} )=\frac{1}{2}. Let Ω=×∞i=1Ωi\Omega =\underset {i=1}{\overset {\infty }{\times }} \Omega_{i}, let F\mathcal{F} denote the usual σ\sigma-field on Ω\Omega, and let μ\mu denote the corresponding product measure. For each i∈Ni \in \mathbb {N}, define fif_{i} on Ω\Omega by writing fi(ω)=ωi−12f_{i}(\omega )=\omega_{i}-\frac{1}{2}. Next, for each n∈Nn \in \mathbb {N}, define hn=1n(f1+⋯+fn)h_{n}=\frac{1}{n}(f_{1}+\cdots +f_{n}). Part (d) of Exercise 11.2.5 shows that hnh_{n} converges in measure to 00; part (e) interprets that result by letting 00 and 11 correspond to obtaining heads or tails, respectively, upon flipping a fair coin, so that 1n(ω1+⋯+ωn)\frac{1}{n}(\omega_{1}+\cdots +\omega_{n}) may in a certain sense be thought of as the proportion of tails obtained in the first nn flips.

Problem 11.4.5

For each n∈Nn \in \mathbb {N}, make the following definitions: Ωn={0,1,⋯ ,k−1}\Omega_{n}=\left\{ 0,1, \cdots , k-1\right\}, Fn=2Ωn\mathcal{F}_{n}=2^{\Omega_{n}}, and μn\mu_{n} is the counting measure. Consider the usual product space (Ω,F,μ)(\Omega , \mathcal{F}, \mu ) as constructed in Sections 11.1 and 11.2. Fix m∈{0,1,⋯ ,k−1}m \in \left\{ 0,1, \cdots , k-1\right\}, and for each n∈Nn \in \mathbb {N} define the mapping gng_{n} on Ω\Omega by writing gn(ω)=1g_{n}(\omega )=1 if ωn=m\omega_{n}=m, and gn(ω)=0g_{n}(\omega )=0 otherwise. Show that 1n∑i=1ngi→1k\frac{1}{n} \sum_{i=1}^{n} g_{i} \rightarrow \frac{1}{k} in μ\mu-measure. That is, show for every ϵ>0\epsilon >0 that

lim⁡nμ({ω∈Ω:∣1n∑i=1ngi(ω)−1k∣>ϵ})=0. \lim _{n} \mu \left(\left\{ \omega \in \Omega : \left|\frac{1}{n} \sum _{i=1}^{n} g_{i}(\omega )-\frac{1}{k}\right|>\epsilon \right\} \right)=0.
?