Chapter 11

Arbitrary Products of Measure Spaces

[25/28%]
Show
LaTeX
Problem 11.1.1

Let Ω1\Omega_{1} denote a nonempty set, and let A\mathcal{A} denote a nonempty collection of subsets of Ω1\Omega_{1}. Let Ω2\Omega_{2} denote a nonempty set, and let B\mathfrak {B} denote a nonempty collection of subsets of Ω2\Omega_{2}.

?
(a)

Let B⊆Ω2B \subseteq \Omega_{2} be nonempty. Then σΩ1×B(A×{B})=σ(A)×{B}\sigma_{\Omega_{1} \times B}(\mathscr {A} \times \left\{ B\right\} )=\sigma (\mathscr {A}) \times \left\{ B\right\}.

(b)

σ(A×B)=σ(σ(A)×σ(B))\sigma (\mathscr {A} \times \mathscr {B})=\sigma (\sigma (\mathscr {A}) \times \sigma (\mathscr {B})).

Problem 11.1.2

Prove the claim in the Identification Lemma for the case where PP is a two-element set, which case is really the only one that we use.

?
Remark.
?

Identification Lemma: Let {Dp}p∈P\left\{ D_{p}\right\}_{p \in P} denote a disjoint family of nonempty subsets of II with ⋃p∈PDp=I\bigcup_{p \in P} D_{p}=I. Define Φ:Ω→×p∈PΩDp\Phi : \Omega \rightarrow \underset {p \in P}{\times } \Omega_{D_{p}} for every ω=(ωi)i∈I∈Ω\omega =(\omega_{i})_{i \in I} \in \Omega by the rule Φ(ω)=((ωi)i∈Dp)p∈P\Phi (\omega )=\left((\omega_{i})_{i \in D_{p}}\right)_{p \in P}. Then: (a) Φ\Phi is one-to-one and onto ×p∈PΩDp\underset {p \in P}{\times } \Omega_{D_{p}}. Let F∗\mathcal{F}^{*} denote the σ\sigma-field of subsets of ×p∈PΩDp\underset {p \in P}{\times } \Omega_{D_{p}} generated by sets of the form ×p∈PADp\underset {p \in P}{\times } A_{D_{p}}, where ADp∈FDpA_{D_{p}} \in \mathcal{F}_{D_{p}} for each p∈Pp \in P and ADp≠ΩDpA_{D_{p}} \neq \Omega_{D_{p}} for at most finitely many p∈Pp \in P. (b) For every set in F\mathcal{F} there is a unique corresponding set in F∗\mathcal{F}^{*}, and vice versa; i.e., Φ\Phi establishes a one-to-one correspondence between F\mathcal{F} and F∗\mathcal{F}^{*}.

Problem 11.1.3

Prove the Identification Lemma in full generality for the case where PP is an arbitrary set.

?
Remark.
?

Identification Lemma: Let {Dp}p∈P\left\{ D_{p}\right\}_{p \in P} denote a disjoint family of nonempty subsets of II with ⋃p∈PDp=I\bigcup_{p \in P} D_{p}=I. Define Φ:Ω→×p∈PΩDp\Phi : \Omega \rightarrow \underset {p \in P}{\times } \Omega_{D_{p}} for every ω=(ωi)i∈I∈Ω\omega =(\omega_{i})_{i \in I} \in \Omega by the rule Φ(ω)=((ωi)i∈Dp)p∈P\Phi (\omega )=\left((\omega_{i})_{i \in D_{p}}\right)_{p \in P}. Then: (a) Φ\Phi is one-to-one and onto ×p∈PΩDp\underset {p \in P}{\times } \Omega_{D_{p}}. Let F∗\mathcal{F}^{*} denote the σ\sigma-field of subsets of ×p∈PΩDp\underset {p \in P}{\times } \Omega_{D_{p}} generated by sets of the form ×p∈PADp\underset {p \in P}{\times } A_{D_{p}}, where ADp∈FDpA_{D_{p}} \in \mathcal{F}_{D_{p}} for each p∈Pp \in P and ADp≠ΩDpA_{D_{p}} \neq \Omega_{D_{p}} for at most finitely many p∈Pp \in P. (b) For every set in F\mathcal{F} there is a unique corresponding set in F∗\mathcal{F}^{*}, and vice versa; i.e., Φ\Phi establishes a one-to-one correspondence between F\mathcal{F} and F∗\mathcal{F}^{*}.

Problem 11.1.4

Show that EF\mathscr {E}_{F} is a semiring on ΩF\Omega_{F}.

?
Problem 11.1.5

Let A\mathcal{A} denote a semiring on Ω1\Omega_{1}, and let B\mathfrak {B} denote a semiring on Ω2\Omega_{2}. Then A×B\mathcal{A} \times \mathcal{B} is a semiring on Ω1×Ω2\Omega_{1} \times \Omega_{2}.

?
Problem 11.2.1

Refer to the proof of Claim 4.

?
(a)

Prove Subclaim 1.

(b)

Prove Subclaim 2.

(c)

Why can't we use the same type of proof as used to demonstrate the finite additivity of μ\mu to show that μ\mu as defined on H\mathscr {H} is countably additive?

Remark.
?

Claim 4: Define the collection H={B⊆Ω:B=ΦF−1(AF×ΩFc) for some finite F⊆I and AF∈FF}\mathscr {H}=\left\{ B \subseteq \Omega : B=\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right) \text{ for some finite } F \subseteq I \text{ and } A_{F} \in \mathcal{F}_{F}\right\}. Then: (a) H\mathscr {H} is a field on Ω\Omega with G⊆H⊆F\mathscr {G} \subseteq \mathscr {H} \subseteq \mathcal{F}, where G\mathscr {G} is the field on Ω\Omega generated by the sets ×i∈IAi\underset {i \in I}{\times } A_{i} with Ai∈FiA_{i} \in \mathcal{F}_{i} for each i∈Ii \in I and Ai≠ΩiA_{i} \neq \Omega_{i} for at most finitely many i∈Ii \in I; (b) σ(H)=F\sigma (\mathscr {H})=\mathcal{F}; (c) there exists a unique finitely additive measure μ\mu on the field H\mathscr {H} such that μ(ΦF−1(AF×ΩFc))=μF(AF)\mu \left(\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right)\right)=\mu_{F}(A_{F}) for every finite F⊆IF \subseteq I and AF∈FFA_{F} \in \mathcal{F}_{F}. Subclaim 1 (used in proving (a)): Let AF1∈FF1A_{F_{1}} \in \mathcal{F}_{F_{1}}. There exists CF1∪F2∈FF1∪F2C_{F_{1} \cup F_{2}} \in \mathcal{F}_{F_{1} \cup F_{2}} with the property that ΦF1−1(AF1×ΩF1c)=ΦF1∪F2−1(CF1∪F2×Ω(F1∪F2)c)\Phi_{F_{1}}^{-1}\left(A_{F_{1}} \times \Omega_{F_{1}^{c}}\right)=\Phi_{F_{1} \cup F_{2}}^{-1}\left(C_{F_{1} \cup F_{2}} \times \Omega_{\left(F_{1} \cup F_{2}\right)^{c}}\right). Subclaim 2 (used in showing that μ\mu is well defined, given finite F1,F2⊆IF_{1}, F_{2} \subseteq I and F3=F1∪F2F_{3}=F_{1} \cup F_{2}): Let AF1∈FF1A_{F_{1}} \in \mathcal{F}_{F_{1}}. Then ΦF1−1(AF1×ΩF1c)=ΦF3−1[ΦF1,F3−1(AF1×ΩF3\F1)×ΩF3c]\Phi_{F_{1}}^{-1}\left(A_{F_{1}} \times \Omega_{F_{1}^{c}}\right)=\Phi_{F_{3}}^{-1}\left[\Phi_{F_{1}, F_{3}}^{-1}\left(A_{F_{1}} \times \Omega_{F_{3} \backslash F_{1}}\right) \times \Omega_{F_{3}^{c}}\right].

Problem 11.2.2

Prove equalities (*) and (**) given in the proof of Subclaim 3 of Claim 7.

?
Remark.
?

Claim 7: Let {(Ωi,Fi,μi)}i=1∞\left\{ (\Omega_{i}, \mathcal{F}_{i}, \mu_{i})\right\}_{i=1}^{\infty } denote a sequence of measure spaces with μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for each i∈Ni \in \mathbb {N}. There exists a unique measure μ\mu on F\mathcal{F} such that μ(ΦF−1(AF×ΩFc))=μF(AF)\mu \left(\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right)\right)=\mu_{F}(A_{F}) whenever F⊆NF \subseteq \mathbb {N} is finite and AF∈FFA_{F} \in \mathcal{F}_{F}. In the course of showing that the finitely additive measure μ\mu from Claim 4 is in fact countably additive on H\mathscr {H}, one fixes a nonincreasing sequence {Em}\left\{ E_{m}\right\} of H\mathscr {H}-sets with ⋂mEm=∅\bigcap_{m} E_{m}=\varnothing, writes Em=ΦNm−1(ANm×ΩNmc)E_{m}=\Phi_{\mathbb {N}_{m}}^{-1}\left(A_{\mathbb {N}_{m}} \times \Omega_{\mathbb {N}_{m}^{c}}\right), and, assuming toward a contradiction that μ(Em)\mu (E_{m}) does not tend to 00, constructs a point ξ=(ξ1,ξ2,…)∈Ω\xi =(\xi_{1}, \xi_{2}, \ldots ) \in \Omega. Subclaim 3: It cannot be the case that for some n∈Nn \in \mathbb {N} and some large m>nm>n we have   1ANm(ξ1,…,ξn,ωn+1,…,ωm)=0\; \mathbb {1}_{A_{\mathbb {N}_{m}}}\left(\xi_{1}, \ldots , \xi_{n}, \omega_{n+1}, \ldots , \omega_{m}\right)=0 for each ωn+1∈Ωn+1,…,ωm∈Ωm\omega_{n+1} \in \Omega_{n+1}, \ldots , \omega_{m} \in \Omega_{m}.

Problem 11.2.3

Let {(Ωi,Fi,μi)}i=1∞\left\{ (\Omega_{i}, \mathcal{F}_{i}, \mu_{i})\right\}_{i=1}^{\infty } denote a sequence of measure spaces such that μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for all but finitely many i∈Ni \in \mathbb {N} and the remaining finitely many measure spaces are σ\sigma-finite. There exists a measure μ\mu on F\mathcal{F} such that μ(AF×ΩFc)=μF(AF)\mu \left(A_{F} \times \Omega_{F^{c}}\right)=\mu_{F}(A_{F}) for every nonempty finite F⊆IF \subseteq I and AF∈FFA_{F} \in \mathcal{F}_{F}.

?
Remark.
?

Note that Claim 4 of this section does not require the individual component spaces to have measure one, and hence we may construct a measure μF\mu_{F} as given in the definition following Claim 4 for this slightly more general situation. Claim 4: Define the collection H={B⊆Ω:B=ΦF−1(AF×ΩFc) for some finite F⊆I and AF∈FF}\mathscr {H}=\left\{ B \subseteq \Omega : B=\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right) \text{ for some finite } F \subseteq I \text{ and } A_{F} \in \mathcal{F}_{F}\right\}. Then: (a) H\mathscr {H} is a field on Ω\Omega with G⊆H⊆F\mathscr {G} \subseteq \mathscr {H} \subseteq \mathcal{F}, where G\mathscr {G} is the field on Ω\Omega generated by the sets ×i∈IAi\underset {i \in I}{\times } A_{i} with Ai∈FiA_{i} \in \mathcal{F}_{i} for each i∈Ii \in I and Ai≠ΩiA_{i} \neq \Omega_{i} for at most finitely many i∈Ii \in I; (b) σ(H)=F\sigma (\mathscr {H})=\mathcal{F}; (c) there exists a unique finitely additive measure μ\mu on the field H\mathscr {H} such that μ(ΦF−1(AF×ΩFc))=μF(AF)\mu \left(\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right)\right)=\mu_{F}(A_{F}) for every finite F⊆IF \subseteq I and AF∈FFA_{F} \in \mathcal{F}_{F}.

Problem 11.2.4

Let {(Ωi,Fi,μi)}i=1∞\left\{ (\Omega_{i}, \mathcal{F}_{i}, \mu_{i})\right\}_{i=1}^{\infty } denote a sequence of measure spaces with μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for each i∈Ni \in \mathbb {N}. If EE has the form ×∞i=1Ai\underset {i=1}{\overset {\infty }{\times }} A_{i} where Ai∈FiA_{i} \in \mathcal{F}_{i} for each i∈Ni \in \mathbb {N}, then E∈FE \in \mathcal{F} and

μ(E)=∏i=1∞μi(Ai)=lim⁡n∏i=1nμi(Ai). \mu (E)=\prod _{i=1}^{\infty } \mu _{i}(A_{i})=\lim _{n} \prod _{i=1}^{n} \mu _{i}(A_{i}).
?
Remark.
?

Write EE as the limit of the sequence {A1×⋯×An×Ωn+1×Ωn+2×⋯ }n=1∞\left\{ A_{1} \times \cdots \times A_{n} \times \Omega_{n+1} \times \Omega_{n+2} \times \cdots \right\}_{n=1}^{\infty }. This sequence is in F\mathcal{F} and is decreasing to ×∞i=1Ai\underset {i=1}{\overset {\infty }{\times }} A_{i}. Use the fact that measures are continuous from above and invoke the product property of μ\mu.

Problem 11.2.5

Let I=NI=\mathbb {N}, let Ωi={0,1}\Omega_{i}=\left\{ 0,1\right\} for each i∈Ni \in \mathbb {N}, and let Fi=2Ωi\mathcal{F}_{i}=2^{\Omega_{i}} for each i∈Ni \in \mathbb {N}. For each i∈Ni \in \mathbb {N}, let μi\mu_{i} be defined on Fi\mathcal{F}_{i} by writing μi({0})=μi({1})=12\mu_{i}(\left\{ 0\right\} )=\mu_{i}(\left\{ 1\right\} )=\frac{1}{2}. Let Ω=×∞i=1Ωi\Omega =\underset {i=1}{\overset {\infty }{\times }} \Omega_{i}, let F\mathcal{F} denote the usual σ\sigma-field on Ω\Omega, and let μ\mu denote the measure of Claim 7.

?
(a)

For any finite subset {i1,⋯ ,ik}\left\{ i_{1}, \cdots , i_{k}\right\} of II and sequence (ai1,⋯ ,aik)(a_{i_{1}}, \cdots , a_{i_{k}}) of zeros and ones, define

A(ai1,⋯ ,aik)={ω∈Ω:ωi1=ai1,⋯ ,ωik=aik}. A(a_{i_{1}}, \cdots , a_{i_{k}})=\left\{ \omega \in \Omega : \omega _{i_{1}}=a_{i_{1}}, \cdots , \omega _{i_{k}}=a_{i_{k}}\right\} .

Show that μ(A(ai1,⋯ ,aik))=2−k\mu \left(A(a_{i_{1}}, \cdots , a_{i_{k}})\right)=2^{-k}.

(b)

For each i∈Ni \in \mathbb {N}, define fif_{i} on Ω\Omega by writing fi(ω)=ωi−12f_{i}(\omega )=\omega_{i}-\frac{1}{2}. Next, for each n∈Nn \in \mathbb {N}, define hn=1n(f1+⋯+fn)h_{n}=\frac{1}{n}(f_{1}+\cdots +f_{n}).

  1. Show that fj=  1A(1j)−12f_{j}=\; \mathbb {1}_{A(1_{j})}-\frac{1}{2} for each j∈Nj \in \mathbb {N}.

  2. Show that fjfk=  1A(1j,1k)−12  1A(1j)−12  1A(1k)+14f_{j} f_{k}=\; \mathbb {1}_{A(1_{j}, 1_{k})}-\frac{1}{2}\; \mathbb {1}_{A(1_{j})}-\frac{1}{2}\; \mathbb {1}_{A(1_{k})}+\frac{1}{4} for all j,k∈Nj, k \in \mathbb {N} with j≠kj \neq k.

  3. Show that fj2=14f_{j}^{2}=\frac{1}{4} for each j∈Nj \in \mathbb {N}.

(c)

Show that

∥hn∥22=1n2∑j=1n∑k=1n∫Ωfjfk dμ=14n2∑j=1n∑k=1nδjk=14n, \left\| h_{n}\right\| _{2}^{2}=\frac{1}{n^{2}} \sum _{j=1}^{n} \sum _{k=1}^{n} \int _{\Omega } f_{j} f_{k} \, d\mu =\frac{1}{4n^{2}} \sum _{j=1}^{n} \sum _{k=1}^{n} \delta _{jk}=\frac{1}{4n},

where δjk\delta_{jk} is 11 or 00 as j=kj=k or j≠kj \neq k. Therefore, hnh_{n} converges to 00 in the L2L^{2} norm.

(d)

Show that hnh_{n} converges in measure to 00. That is, for every ϵ>0\epsilon >0 we have

lim⁡nμ({ω∈Ω:∣ω1+⋯+ωnn−12∣>ϵ})=0. \lim _{n} \mu \left(\left\{ \omega \in \Omega : \left|\frac{\omega _{1}+\cdots +\omega _{n}}{n}-\frac{1}{2}\right|>\epsilon \right\} \right)=0.
(e)

Let 00 and 11 correspond to obtaining heads or tails, respectively, upon flipping a fair coin. Then 1n(ω1+⋯+ωn)\frac{1}{n}(\omega_{1}+\cdots +\omega_{n}) may in a certain sense be thought of as the proportion of tails obtained in the first nn flips. Interpret (d) in this coin-toss setting.

Remark.
?

Claim 7: Let {(Ωi,Fi,μi)}i=1∞\left\{ (\Omega_{i}, \mathcal{F}_{i}, \mu_{i})\right\}_{i=1}^{\infty } denote a sequence of measure spaces with μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for each i∈Ni \in \mathbb {N}. There exists a unique measure μ\mu on F\mathcal{F} such that μ(ΦF−1(AF×ΩFc))=μF(AF)\mu \left(\Phi_{F}^{-1}\left(A_{F} \times \Omega_{F^{c}}\right)\right)=\mu_{F}(A_{F}) whenever F⊆NF \subseteq \mathbb {N} is finite and AF∈FFA_{F} \in \mathcal{F}_{F}.

Problem 11.2.6

Halmos gives the following application of the theory of this section to give a completely nontopological construction of Lebesgue measure on the real line. For each n∈Nn \in \mathbb {N}, let Ωn={0,1}\Omega_{n}=\left\{ 0,1\right\}, Fn=2Ωn\mathcal{F}_{n}=2^{\Omega_{n}}, and let μn({0})=μn({1})=12\mu_{n}(\left\{ 0\right\} )=\mu_{n}(\left\{ 1\right\} )=\frac{1}{2}. Let (Ω,F,μ)(\Omega , \mathcal{F}, \mu ) denote the product measure space [for the sequence {(Ωn,Fn,μn)}n=1∞\left\{ (\Omega_{n}, \mathcal{F}_{n}, \mu_{n})\right\}_{n=1}^{\infty }] as constructed in this section.

?
(a)

For every ω=(ω1,ω2,⋯ )∈Ω\omega =(\omega_{1}, \omega_{2}, \cdots ) \in \Omega, we have {ω}∈F\left\{ \omega \right\} \in \mathcal{F} and μ({ω})=0\mu (\left\{ \omega \right\} )=0.

(b)

The set E‾\overline{E} of all points ω∈Ω\omega \in \Omega for which ωi=1\omega_{i}=1 for all but a finite number of ii is in F\mathcal{F} and has μ\mu-measure zero.

Consider now the measure space (Ω‾,F‾,μ‾)(\overline{\Omega }, \overline{\mathcal{F}}, \overline{\mu }), where Ω‾=Ω−E‾\overline{\Omega }=\Omega -\overline{E}, F‾\overline{\mathcal{F}} denotes the σ\sigma-field consisting of the sets of the form A∩Ω‾A \cap \overline{\Omega } as AA ranges over F\mathcal{F}, and μ‾(E∩Ω‾)=μ(E)\overline{\mu }(E \cap \overline{\Omega })=\mu (E) for every E∈FE \in \mathcal{F}.

(c)

Given ω∈Ω‾\omega \in \overline{\Omega }, write z(ω)=∑i=1∞ωi2iz(\omega )=\sum_{i=1}^{\infty } \frac{\omega_{i}}{2^{i}}. Show that zz establishes a one-to-one correspondence between Ω‾\overline{\Omega } and [0,1)[0,1).

(d)

Let 0≤a<b≤10 \leq a<b \leq 1. Let A={x:a≤x<b}A=\left\{ x: a \leq x<b\right\} and E={ω∈Ω‾:z(ω)∈A}E=\left\{ \omega \in \overline{\Omega }: z(\omega ) \in A\right\}. Then E∈F‾E \in \overline{\mathcal{F}} and μ‾(E)=b−a\overline{\mu }(E)=b-a.

(e)

If AA is any Borel subset of [0,1)[0,1) and E={ω∈Ω‾:z(ω)∈A}E=\left\{ \omega \in \overline{\Omega }: z(\omega ) \in A\right\}, then E∈F‾E \in \overline{\mathcal{F}} and μ‾(E)\overline{\mu }(E) equals the Lebesgue measure of AA.

(f)

Lebesgue measure on [0,1)[0,1) has been constructed. By considering the real line as a countable disjoint union of the intervals [n,n+1)[n, n+1) as nn ranges over Z\mathbb {Z}, construct Lebesgue measure on the real line.

Problem 11.3.1

Quickly verify that

  1. the definitions of fnf_{n} and fn′f_{n}^{\prime } make sense for each ω∈Ω\omega \in \Omega when ff is nonnegative, and

  2. the definitions make sense for μ\mu-a.e. ω∈Ω\omega \in \Omega when ff in L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ) is general.

?
Remark.
?

Framework: Let (Ωi,Fi,μi)(\Omega_{i}, \mathcal{F}_{i}, \mu_{i}) denote a measure space with μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for each ii in an index set II, taken to be I=NI=\mathbb {N} in this section. Let Nm={1,⋯ ,m}\mathbb {N}_{m}=\left\{ 1, \cdots , m\right\} for each m∈Nm \in \mathbb {N}. Let f∈L1(Ω,F,μ)f \in L^{1}(\Omega , \mathcal{F}, \mu ), where F\mathcal{F} and μ\mu are the product σ\sigma-field and measure discussed and constructed in the previous two sections of this chapter. For each ω∈Ω\omega \in \Omega and n∈Nn \in \mathbb {N}, write

fn(ω)=fn(ω1,⋯ ,ωn,ωn+1,⋯ )=∫ΩNncf(ω1,⋯ ,ωn,ξn+1,⋯ ) dμNnc(ξn+1,⋯ ). \begin{aligned} f_{n}(\omega ) & =f_{n}(\omega _{1}, \cdots , \omega _{n}, \omega _{n+1}, \cdots ) \\ & =\int _{\Omega _{\mathbb {N}_{n}^{c}}} f(\omega _{1}, \cdots , \omega _{n}, \xi _{n+1}, \cdots ) \, d\mu _{\mathbb {N}_{n}^{c}}(\xi _{n+1}, \cdots ). \end{aligned}

[Note for each ω∈Ω\omega \in \Omega that fn(ω)f_{n}(\omega ) does not depend on ωn+1,ωn+2,⋯\omega_{n+1}, \omega_{n+2}, \cdots.] For each ω∈Ω\omega \in \Omega and n∈Nn \in \mathbb {N}, we write

fn′(ω)=fn′(ω1,⋯ ,ωn,ωn+1,⋯ )=∫ΩNnf(ξ1,⋯ ,ξn,ωn+1,⋯ ) dμNn(ξ1,⋯ ,ξn). \begin{aligned} f_{n}^{\prime }(\omega ) & =f_{n}^{\prime }(\omega _{1}, \cdots , \omega _{n}, \omega _{n+1}, \cdots ) \\ & =\int _{\Omega _{\mathbb {N}_{n}}} f(\xi _{1}, \cdots , \xi _{n}, \omega _{n+1}, \cdots ) \, d\mu _{\mathbb {N}_{n}}(\xi _{1}, \cdots , \xi _{n}). \end{aligned}

[Note for each ω∈Ω\omega \in \Omega that fn′(ω)f_{n}^{\prime }(\omega ) does not depend on ω1,⋯ ,ωn\omega_{1}, \cdots , \omega_{n}.]

Problem 11.3.2

From the fact that Claim 1 holds for nonnegative ff, show that Claim 1 holds for general ff in L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ).

?
Remark.
?

Claim 1: lim⁡nfn(ω)=f(ω)\lim_{n} f_{n}(\omega )=f(\omega ) for μ\mu-a.e. ω∈Ω\omega \in \Omega, where fnf_{n} is as defined in the Framework of this section (see Exercise 11.3.1).

Problem 11.3.3

Consider the framework of this section. For each n∈Nn \in \mathbb {N}, let E(n)∈FnE^{(n)} \in \mathcal{F}_{n}, and write En=E(n)×Ω{n}cE_{n}=E^{(n)} \times \Omega_{\left\{ n\right\}^{c}}. Define F=⋂n=1∞⋃k=n∞EkF=\bigcap_{n=1}^{\infty } \bigcup_{k=n}^{\infty } E_{k}. Use Kolmogorov's Zero-One Law to show that μ(F)\mu (F) must be zero or one.

?
Remark.
?

Kolmogorov's Zero-One Law: Let ω\omega and ξ\xi denote elements of Ω\Omega. We say that ω\omega and ξ\xi are ultimately equal, written ω=uξ\omega =_{u} \xi, if and only if there is NN such that ωn=ξn\omega_{n}=\xi_{n} for all n≥Nn \geq N. Now let U∈FU \in \mathcal{F} have the following property: for every ω∈Ω\omega \in \Omega, ω∈U\omega \in U if and only if every ξ∈Ω\xi \in \Omega with ξ=uω\xi =_{u} \omega is in UU. Then μ(U)∈{0,1}\mu (U) \in \left\{ 0,1\right\}.

Problem 11.3.4

Prove Claim 3: let (Ξ,Q,μ)(\Xi , \mathcal{Q}, \mu ) denote an arbitrary measure space, and assume that every A∈QA \in \mathcal{Q} is such that μ(A)∈{0,1}\mu (A) \in \left\{ 0,1\right\}. Let f:Ξ→R‾f: \Xi \rightarrow \overline{\mathbb {R}} denote a Q/B∗\mathcal{Q}/\mathcal{B}^{*}-measurable function. Then there is α\alpha so that f=αf=\alpha μ\mu-a.e. on Ξ\Xi.

?
Problem 11.3.5

Using the fact that Claim 4 holds for nonnegative ff in L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ), quickly show that Claim 4 holds for general ff in L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ).

?
Remark.
?

Claim 4: lim⁡nfn′(ω)\lim_{n} f_{n}^{\prime }(\omega ) exists and equals the number ∫Ωf dμ\int_{\Omega } f \, d\mu for μ\mu-a.e. ω∈Ω\omega \in \Omega, where fn′f_{n}^{\prime } is as defined in the Framework of this section (see Exercise 11.3.1).

Problem 11.3.6

Return to the framework of Exercise 11.2.5 in the previous section for the following exercise, which is taken from (22.19) of Hewitt and Stromberg.

?
(a)

Let DD denote an infinite subset of N\mathbb {N}, and fix ω∈Ω\omega \in \Omega. Define the F\mathcal{F}-set BB by writing B={x∈Ω:ωn=xn for every n∈D}B=\left\{ x \in \Omega : \omega_{n}=x_{n} \text{ for every } n \in D\right\}. Then μ(B)=0\mu (B)=0.

(b)

Using the notation of Exercise 11.2.5, we have for each n∈Nn \in \mathbb {N} that

A(01,03,05,⋯ ,02n−1)={x∈Ω:x1=x3=⋯=x2n−1=0}. A(0_{1}, 0_{3}, 0_{5}, \cdots , 0_{2n-1})=\left\{ x \in \Omega : x_{1}=x_{3}=\cdots =x_{2n-1}=0\right\} .

Let the above set be denoted by SnS_{n}. Then lim⁡n2n  1Sn(ω)=0\lim_{n} 2^{n} \; \mathbb {1}_{S_{n}}(\omega )=0 for μ\mu-a.e. ω∈Ω\omega \in \Omega.

Remark.
?

For part (b): F(n)\mathcal{F}^{(n)} denotes the σ\sigma-field {ANn×ΩNnc:ANn∈FNn}\left\{ A_{\mathbb {N}_{n}} \times \Omega_{\mathbb {N}_{n}^{c}}: A_{\mathbb {N}_{n}} \in \mathcal{F}_{\mathbb {N}_{n}}\right\} constructed in the proof of Claim 1 of this section, and F0=⋂n=1∞F(n)\mathcal{F}_{0}=\bigcap_{n=1}^{\infty } \mathcal{F}^{(n)} denotes the tail σ\sigma-field of Ω\Omega -- the σ\sigma-field on which Kolmogorov's Zero-One Law is applied.

Problem 11.3.7

If ff is an F/B∗\mathcal{F}/\mathcal{B}^{*}-measurable function on Ω\Omega such that

f(ω1,⋯ ,ωn,ρn+1,ρn+2,⋯ )=f(ξ1,⋯ ,ξn,ρn+1,ρn+2,⋯ ) f(\omega _{1}, \cdots , \omega _{n}, \rho _{n+1}, \rho _{n+2}, \cdots )=f(\xi _{1}, \cdots , \xi _{n}, \rho _{n+1}, \rho _{n+2}, \cdots )

for every n∈Nn \in \mathbb {N} and choice of (ω1,⋯ ,ωn)(\omega_{1}, \cdots , \omega_{n}) and (ξ1,⋯ ,ξn)(\xi_{1}, \cdots , \xi_{n}) in ΩNn\Omega_{\mathbb {N}_{n}}, then ff is constant μ\mu-a.e. on Ω\Omega.

?
Remark.
?

Use either the Zero-One Law or Claim 4. Claim 4: lim⁡nfn′(ω)\lim_{n} f_{n}^{\prime }(\omega ) exists and equals the number ∫Ωf dμ\int_{\Omega } f \, d\mu for μ\mu-a.e. ω∈Ω\omega \in \Omega, where fn′f_{n}^{\prime } is as defined in the Framework of this section (see Exercise 11.3.1).

Problem 11.3.8

Let (Ω1,F1,μ1)(\Omega_{1}, \mathcal{F}_{1}, \mu_{1}) and (Ω2,F2,μ2)(\Omega_{2}, \mathcal{F}_{2}, \mu_{2}) denote measure spaces with μ1(Ω1)=1\mu_{1}(\Omega_{1})=1 and μ2(Ω2)=1\mu_{2}(\Omega_{2})=1. Write

(Ω,F,μ)=(Ω1×Ω2,F1⊗F2,μ1⊗μ2). (\Omega , \mathcal{F}, \mu )=(\Omega _{1} \times \Omega _{2}, \mathcal{F}_{1} \otimes \mathcal{F}_{2}, \mu _{1} \otimes \mu _{2}).

Let 1≤p<+∞1 \leq p<+\infty. For f∈Lp(Ω,F,μ)f \in L^{p}(\Omega , \mathcal{F}, \mu ), let SfSf denote the function on Ω\Omega such that

Sf(ω1,ω2)=∫Ω2f(ω1,ξ2) dμ2(ξ2) Sf(\omega _{1}, \omega _{2})=\int _{\Omega _{2}} f(\omega _{1}, \xi _{2}) \, d\mu _{2}(\xi _{2})

for every (ω1,ω2)∈Ω(\omega_{1}, \omega_{2}) \in \Omega. Then Sf∈Lp(Ω,F,μ)Sf \in L^{p}(\Omega , \mathcal{F}, \mu ) and ∥Sf∥p≤∥f∥p\left\| Sf\right\|_{p} \leq \left\| f\right\|_{p}.

?
Remark.
?

Since μ(Ω)=1\mu (\Omega )=1, we have Lp(Ω,F,μ)⊆L1(Ω,F,μ)L^{p}(\Omega , \mathcal{F}, \mu ) \subseteq L^{1}(\Omega , \mathcal{F}, \mu ) by Claim 1 of Section 8.5, so f∈L1(Ω,F,μ)f \in L^{1}(\Omega , \mathcal{F}, \mu ). Using the Fubini Theorem, the mapping

ω1↦∫Ω2f(ω1,ξ2) dμ2(ξ2) \omega _{1} \mapsto \int _{\Omega _{2}} f(\omega _{1}, \xi _{2}) \, d\mu _{2}(\xi _{2})

is in L1(Ω1,F1,μ1)L^{1}(\Omega_{1}, \mathcal{F}_{1}, \mu_{1}). This function is F1/B∗\mathcal{F}_{1}/\mathcal{B}^{*}-measurable, and since the mapping

(ω1,ω2)↦∫Ω2f(ω1,ξ2) dμ2(ξ2) (\omega _{1}, \omega _{2}) \mapsto \int _{\Omega _{2}} f(\omega _{1}, \xi _{2}) \, d\mu _{2}(\xi _{2})

does not depend on ω2\omega_{2}, it is F/B∗\mathcal{F}/\mathcal{B}^{*}-measurable. Next, verify that

∥Sf∥pp=∫Ω1×Ω2∣∫Ω2f(ω1,ξ2) dμ2(ξ2)∣p dμ1⊗μ2(ω1,ω2)≤∫Ω1×Ω2[∫Ω2∣f(ω1,ξ2)∣ dμ2(ξ2)]p dμ1⊗μ2(ω1,ω2)≤∫Ω1×Ω2∫Ω2∣f(ω1,ξ2)∣p dμ2(ξ2) dμ1⊗μ2(ω1,ω2)=∫Ω2(∫Ω1∫Ω2∣f(ω1,ξ2)∣p dμ2(ξ2) dμ1(ω1)) dμ2(ω2)=∫Ω2[∫Ω1×Ω2∣f(ω1,ξ2)∣p dμ1⊗μ2(ω1,ξ2)] dμ2(ω2)=∫Ω2∥f∥pp dμ2(ω2)=∥f∥pp. \begin{aligned} \left\| Sf\right\| _{p}^{p} & =\int _{\Omega _{1} \times \Omega _{2}} \left|\int _{\Omega _{2}} f(\omega _{1}, \xi _{2}) \, d\mu _{2}(\xi _{2})\right|^{p} \, d\mu _{1} \otimes \mu _{2}(\omega _{1}, \omega _{2}) \\ & \leq \int _{\Omega _{1} \times \Omega _{2}}\left[\int _{\Omega _{2}} \left|f(\omega _{1}, \xi _{2})\right| \, d\mu _{2}(\xi _{2})\right]^{p} \, d\mu _{1} \otimes \mu _{2}(\omega _{1}, \omega _{2}) \\ & \leq \int _{\Omega _{1} \times \Omega _{2}} \int _{\Omega _{2}} \left|f(\omega _{1}, \xi _{2})\right|^{p} \, d\mu _{2}(\xi _{2}) \, d\mu _{1} \otimes \mu _{2}(\omega _{1}, \omega _{2}) \\ & =\int _{\Omega _{2}}\left(\int _{\Omega _{1}} \int _{\Omega _{2}} \left|f(\omega _{1}, \xi _{2})\right|^{p} \, d\mu _{2}(\xi _{2}) \, d\mu _{1}(\omega _{1})\right) \, d\mu _{2}(\omega _{2}) \\ & =\int _{\Omega _{2}}\left[\int _{\Omega _{1} \times \Omega _{2}} \left|f(\omega _{1}, \xi _{2})\right|^{p} \, d\mu _{1} \otimes \mu _{2}(\omega _{1}, \xi _{2})\right] \, d\mu _{2}(\omega _{2}) \\ & =\int _{\Omega _{2}} \left\| f\right\| _{p}^{p} \, d\mu _{2}(\omega _{2}) \\ & =\left\| f\right\| _{p}^{p}. \end{aligned}

(The second inequality follows by Claim 1 of Section 8.5.) This shows that SfSf is in Lp(Ω,F,μ)L^{p}(\Omega , \mathcal{F}, \mu ) and ∥Sf∥p≤∥f∥p\left\| Sf\right\|_{p} \leq \left\| f\right\|_{p}.

Problem 11.3.9

The following results obtain, in the framework below. Sets listed as FF [with or without a subscript] are finite sets.

?
(a)

fFc∈Lp(Ω,F,μ)f_{F^{c}} \in L^{p}(\Omega , \mathcal{F}, \mu ), and for every ϵ>0\epsilon >0 there is finite F0⊆IF_{0} \subseteq I such that F⊇F0F \supseteq F_{0} forces ∥fFc−∫Ωf dμ∥p<ϵ\left\| f_{F^{c}}-\int_{\Omega } f \, d\mu \right\|_{p}<\epsilon.

(b)

fF∈Lp(Ω,F,μ)f_{F} \in L^{p}(\Omega , \mathcal{F}, \mu ), and for every ϵ>0\epsilon >0 there is finite F0⊆IF_{0} \subseteq I such that F⊇F0F \supseteq F_{0} forces \left\| f_{F}-f\right\|_{p}_{p}=0.

Remark.
?

Framework: Let (Ωi,Fi,μi)(\Omega_{i}, \mathcal{F}_{i}, \mu_{i}) denote an infinite collection of measure spaces with μi(Ωi)=1\mu_{i}(\Omega_{i})=1 for each i∈Ii \in I. For every finite subset F⊆IF \subseteq I, we use the identification conventions of Claim 9 of Section 11.2 to identify the infinite product space (Ω,F,μ)(\Omega , \mathcal{F}, \mu ) with (ΩF×ΩFc,FF⊗FFc,μF⊗μFc)(\Omega_{F} \times \Omega_{F^{c}}, \mathcal{F}_{F} \otimes \mathcal{F}_{F^{c}}, \mu_{F} \otimes \mu_{F^{c}}). We take 1≤p<+∞1 \leq p<+\infty and f∈Lp(Ω,F,μ)f \in L^{p}(\Omega , \mathcal{F}, \mu ). We define fFcf_{F^{c}} on Ω\Omega by writing

fFc(ωF,ωFc)=∫ΩFf(ξF,ωFc) dμF(ξF). f_{F^{c}}(\omega _{F}, \omega _{F^{c}})=\int _{\Omega _{F}} f(\xi _{F}, \omega _{F^{c}}) \, d\mu _{F}(\xi _{F}).

Therefore, fFcf_{F^{c}} is a function of the form SfSf as given in Exercise 11.3.8 (with FF playing the role of the index set there identified with Ω1\Omega_{1}, and FcF^{c} the role identified with Ω2\Omega_{2}). We next define fFf_{F} on Ω\Omega by writing

fF(ωF,ωFc)=∫ΩFcf(ωF,ξFc) dμFc(ξFc). f_{F}(\omega _{F}, \omega _{F^{c}})=\int _{\Omega _{F^{c}}} f(\omega _{F}, \xi _{F^{c}}) \, d\mu _{F^{c}}(\xi _{F^{c}}).
Problem 11.4.1

In Claim 3, show that the function gg as defined there is an element of L1(Ω,F,μ)L^{1}(\Omega , \mathcal{F}, \mu ), so that we may meaningfully discuss the integral ∫Ωg dμ\int_{\Omega } g \, d\mu.

?
Remark.
?

Claim 3: Let F⊆NF \subseteq \mathbb {N} be nonempty and finite, and for each i∈Fi \in F let fif_{i} denote a function in L1(Ωi,Fi,μi)L^{1}(\Omega_{i}, \mathcal{F}_{i}, \mu_{i}). Let gg denote the mapping on Ω\Omega given for every ω∈Ω\omega \in \Omega by the rule ω↦∏i∈Ffi(ωi)\omega \mapsto \prod_{i \in F} f_{i}(\omega_{i}). Then

∫Ωg(ω) dμ(ω)=∏i∈F∫Ωifi(ωi) dμi(ωi). \int _{\Omega } g(\omega ) \, d\mu (\omega )=\prod _{i \in F} \int _{\Omega _{i}} f_{i}(\omega _{i}) \, d\mu _{i}(\omega _{i}).
Problem 11.4.2

In the statement of the L2L^{2} Strong Law, replace the assumption that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges with the assumption that ∑k=1∞ck∥gk∥22\sum_{k=1}^{\infty } c_{k} \left\| g_{k}\right\|_{2}^{2} converges, where {ck}k=1∞\left\{ c_{k}\right\}_{k=1}^{\infty } is a sequence of positive numbers such that ∑k=1∞ck<+∞\sum_{k=1}^{\infty } c_{k}<+\infty. Then ∑k=1∞ckfk(ω)\sum_{k=1}^{\infty } c_{k} f_{k}(\omega ) converges for μ\mu-a.e. ω∈Ω\omega \in \Omega.

?
Remark.
?

L2L^{2} Strong Law of Large Numbers: For each k∈Nk \in \mathbb {N}, let gkg_{k} denote a function in L2(Ωk,Fk,μk)L^{2}(\Omega_{k}, \mathcal{F}_{k}, \mu_{k}) such that ∫Ωkgk dμk=0\int_{\Omega_{k}} g_{k} \, d\mu_{k}=0. Let fkf_{k} denote the function on Ω\Omega that assigns each ω∈Ω\omega \in \Omega to gk(ωk)g_{k}(\omega_{k}). Assume that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges. Then lim⁡n1n∑k=1nfk(ω)=0\lim_{n} \frac{1}{n} \sum_{k=1}^{n} f_{k}(\omega )=0 for μ\mu-a.e. ω∈Ω\omega \in \Omega.

Problem 11.4.3

In the statement of the L2L^{2} Strong Law, replace the assumption that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges with the assumption that lim⁡n1n2∑k=1n∥fk∥22=0\lim_{n} \frac{1}{n^{2}} \sum_{k=1}^{n} \left\| f_{k}\right\|_{2}^{2}=0. Deduce for every ϵ>0\epsilon >0 that

lim⁡nμ({ω∈Ω:∣1n∑k=1nfk(ω)∣>ϵ})=0, \lim _{n} \mu \left(\left\{ \omega \in \Omega : \left|\frac{1}{n} \sum _{k=1}^{n} f_{k}(\omega )\right|>\epsilon \right\} \right)=0,

which shows that {1n∑k=1nfk}n=1∞\left\{ \frac{1}{n} \sum_{k=1}^{n} f_{k}\right\}_{n=1}^{\infty } converges in μ\mu-measure to zero. This result is known as the Weak Law of Large Numbers.

?
Remark.
?

L2L^{2} Strong Law of Large Numbers: For each k∈Nk \in \mathbb {N}, let gkg_{k} denote a function in L2(Ωk,Fk,μk)L^{2}(\Omega_{k}, \mathcal{F}_{k}, \mu_{k}) such that ∫Ωkgk dμk=0\int_{\Omega_{k}} g_{k} \, d\mu_{k}=0. Let fkf_{k} denote the function on Ω\Omega that assigns each ω∈Ω\omega \in \Omega to gk(ωk)g_{k}(\omega_{k}). Assume that ∑k=1∞∥gk∥22k2\sum_{k=1}^{\infty } \frac{\left\| g_{k}\right\|_{2}^{2}}{k^{2}} converges. Then lim⁡n1n∑k=1nfk(ω)=0\lim_{n} \frac{1}{n} \sum_{k=1}^{n} f_{k}(\omega )=0 for μ\mu-a.e. ω∈Ω\omega \in \Omega.

Problem 11.4.4

Reconsider the framework of Exercise 11.2.5, and recall the definitions of fnf_{n} and hnh_{n} for each n∈Nn \in \mathbb {N}.

?
(a)

The hypotheses of the Strong Law are satisfied since ∥fj∥22=14\left\| f_{j}\right\|_{2}^{2}=\frac{1}{4} for each j∈Nj \in \mathbb {N}, and hence lim⁡nhn=lim⁡n1n(f1+⋯+fn)=0\lim_{n} h_{n}=\lim_{n} \frac{1}{n}(f_{1}+\cdots +f_{n})=0 μ\mu-a.e. on Ω\Omega, that is hnh_{n} converges to zero μ\mu-a.e. on Ω\Omega.

(b)

Show that the result of (a) implies the result of part (d) of Exercise 11.2.5.

(c)

As with part (e) of Exercise 11.2.5, discuss the result of (a) in terms of tossing a fair coin.

Remark.
?

Framework of Exercise 11.2.5: let I=NI=\mathbb {N}, let Ωi={0,1}\Omega_{i}=\left\{ 0,1\right\} for each i∈Ni \in \mathbb {N}, and let Fi=2Ωi\mathcal{F}_{i}=2^{\Omega_{i}} for each i∈Ni \in \mathbb {N}. For each i∈Ni \in \mathbb {N}, let μi\mu_{i} be defined on Fi\mathcal{F}_{i} by writing μi({0})=μi({1})=12\mu_{i}(\left\{ 0\right\} )=\mu_{i}(\left\{ 1\right\} )=\frac{1}{2}. Let Ω=×∞i=1Ωi\Omega =\underset {i=1}{\overset {\infty }{\times }} \Omega_{i}, let F\mathcal{F} denote the usual σ\sigma-field on Ω\Omega, and let μ\mu denote the corresponding product measure. For each i∈Ni \in \mathbb {N}, define fif_{i} on Ω\Omega by writing fi(ω)=ωi−12f_{i}(\omega )=\omega_{i}-\frac{1}{2}. Next, for each n∈Nn \in \mathbb {N}, define hn=1n(f1+⋯+fn)h_{n}=\frac{1}{n}(f_{1}+\cdots +f_{n}). Part (d) of Exercise 11.2.5 shows that hnh_{n} converges in measure to 00; part (e) interprets that result by letting 00 and 11 correspond to obtaining heads or tails, respectively, upon flipping a fair coin, so that 1n(ω1+⋯+ωn)\frac{1}{n}(\omega_{1}+\cdots +\omega_{n}) may in a certain sense be thought of as the proportion of tails obtained in the first nn flips.

Problem 11.4.5

For each n∈Nn \in \mathbb {N}, make the following definitions: Ωn={0,1,⋯ ,k−1}\Omega_{n}=\left\{ 0,1, \cdots , k-1\right\}, Fn=2Ωn\mathcal{F}_{n}=2^{\Omega_{n}}, and μn\mu_{n} is the counting measure. Consider the usual product space (Ω,F,μ)(\Omega , \mathcal{F}, \mu ) as constructed in Sections 11.1 and 11.2. Fix m∈{0,1,⋯ ,k−1}m \in \left\{ 0,1, \cdots , k-1\right\}, and for each n∈Nn \in \mathbb {N} define the mapping gng_{n} on Ω\Omega by writing gn(ω)=1g_{n}(\omega )=1 if ωn=m\omega_{n}=m, and gn(ω)=0g_{n}(\omega )=0 otherwise. Show that 1n∑i=1ngi→1k\frac{1}{n} \sum_{i=1}^{n} g_{i} \rightarrow \frac{1}{k} in μ\mu-measure. That is, show for every ϵ>0\epsilon >0 that

lim⁡nμ({ω∈Ω:∣1n∑i=1ngi(ω)−1k∣>ϵ})=0. \lim _{n} \mu \left(\left\{ \omega \in \Omega : \left|\frac{1}{n} \sum _{i=1}^{n} g_{i}(\omega )-\frac{1}{k}\right|>\epsilon \right\} \right)=0.
?