Chapter 12

Probability Measures

[17/0%]
Show
LaTeX
Problem 12.1

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and A∈FA \in \mathcal{F}. Prove that AA and Ω\A\Omega \backslash A are independent if and only if P(A)=0\mathbb {P}\left(A\right) = 0 or P(A)=1\mathbb {P}\left(A\right) = 1.

?
Problem 12.2

Suppose P\mathbb {P} is Lebesgue measure on [0,1]. Give an example of two disjoint Borel subsets AA and BB of [0,1][0,1] such that P(A)=P(B)=12,[0,12]\mathbb {P}\left(A\right) = \mathbb {P}\left(B\right) = \frac{1}{2},\left[0, \frac{1}{2}\right] and AA are independent, and [0,12]\left[0, \frac{1}{2}\right] and BB are independent.

?
Problem 12.3

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and A,B∈FA, B \in \mathcal{F}. Prove that the following are equivalent:

?
(a)

AA and BB are independent events.

(b)

AA and Ω\B\Omega \backslash B are independent events.

(c)

Ω\A\Omega \backslash A and BB are independent events.

(d)

Ω\A\Omega \backslash A and Ω\B\Omega \backslash B are independent events.

Problem 12.4

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and {Ak}k∈Γ\left\{ A_{k}\right\}_{k \in \Gamma } is a family of events. Prove the family {Ak}k∈Γ\left\{ A_{k}\right\}_{k \in \Gamma } is independent if and only if the family {Ω\Ak}k∈Γ\left\{ \Omega \backslash A_{k}\right\}_{k \in \Gamma } is independent.

?
Problem 12.5

Give an example of a probability space (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) and events A,B1,B2A, B_{1}, B_{2} such that AA and B1B_{1} are independent, AA and B2B_{2} are independent, but AA and B1∪B2B_{1} \cup B_{2} are not independent.

?
Problem 12.6

Give an example of a probability space (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) and events A1,A2,A3A_{1}, A_{2}, A_{3} such that A1A_{1} and A2A_{2} are independent, A1A_{1} and A3A_{3} are independent, and A2A_{2} and A3A_{3} are independent, but the family A1,A2,A3A_{1}, A_{2}, A_{3} is not independent.

?
Problem 12.7

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space, A∈FA \in \mathcal{F}, and B1⊆B2⊆⋯B_{1} \subseteq B_{2} \subseteq \cdots is an increasing sequence of events such that AA and BnB_{n} are independent events for each n∈Nn \in \mathbb {N}. Show that AA and ⋃n=1∞Bn\bigcup_{n = 1}^{\infty } B_{n} are independent.

?
Problem 12.8

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and {At}t∈R\left\{ A_{t}\right\}_{t \in \mathbb {R}} is an independent family of events such that P(At)<1\mathbb {P}\left(A_{t}\right) < 1 for each t∈Rt \in \mathbb {R}. Prove that there exists a sequence t1,t2,…t_{1}, t_{2}, \ldots in R\mathbb {R} such that P(⋂n=1∞Atn)=0\mathbb {P}\left(\bigcap_{n = 1}^{\infty } A_{t_{n}}\right) = 0.

?
Problem 12.9

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and B1,…,Bn∈FB_{1}, \ldots , B_{n} \in \mathcal{F} are such that P(B1∩⋯∩Bn)>0\mathbb {P}\left(B_{1} \cap \cdots \cap B_{n}\right) > 0. Prove that P(A∩B1∩⋯∩Bn)=P(B1)⋅PB1(B2)⋯PB1∩⋯∩Bn−1(Bn)⋅PB1∩⋯∩Bn(A)\mathbb {P}\left(A \cap B_{1} \cap \cdots \cap B_{n}\right) = \mathbb {P}\left(B_{1}\right) \cdot \mathbb {P}_{B_{1}}\left(B_{2}\right) \cdots \mathbb {P}_{B_{1} \cap \cdots \cap B_{n-1}}\left(B_{n}\right) \cdot \mathbb {P}_{B_{1} \cap \cdots \cap B_{n}}\left(A\right) for every event A∈FA \in \mathcal{F}.

?
Problem 12.10

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and A∈FA \in \mathcal{F} is an event such that 0<P(A)<10 < \mathbb {P}\left(A\right) < 1. Prove that

P(B)=PA(B)⋅P(A)+PΩ\A(B)⋅P(Ω\A) \mathbb {P}\left(B\right) = \mathbb {P}_{A}\left(B\right) \cdot \mathbb {P}\left(A\right)+\mathbb {P}_{\Omega \backslash A}\left(B\right) \cdot \mathbb {P}\left(\Omega \backslash A\right)

for every event B∈FB \in \mathcal{F}.

?
Problem 12.11

Give an example of a probability space (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) and X,Y∈L2(P)X, Y \in \mathcal{L}^{2}(P) such that Var⁡[X+Y]=Var⁡[X]+Var⁡[Y]\operatorname {Var}\left[X+Y\right] = \operatorname {Var}\left[X\right]+\operatorname {Var}\left[Y\right] but XX and YY are not independent random variables.

?
Problem 12.12

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) and (Ω′,F′,P′)\left(\Omega^{\prime }, \mathcal{F}^{\prime }, \mathbb {P}^{\prime }\right) are probability spaces, XX is a random variable on Ω,Y\Omega , Y is a random variable on Ω′\Omega^{\prime }, and X~=Y~\widetilde{X} = \widetilde{Y}. Prove that PX=PY′\mathbb {P}_{X} = \mathbb {P}_{Y}^{\prime }.

?
Problem 12.13

Suppose H:R→(0,1)H: \mathbb {R} \rightarrow (0,1) is a continuous one-to-one function satisfying conditions (a) through (d) of 12.29. Show that the function X:(0,1)→RX:(0,1) \rightarrow \mathbb {R} produced in the proof of 12.29 is the inverse function of HH.

?
Remark.
?

Theorem 12.29 (characterization of distribution functions): suppose H:R→[0,1]H: \mathbb {R} \rightarrow [0,1] is a function. Then there exists a probability space (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) and a random variable XX on (Ω,F)(\Omega , \mathcal{F}) such that H=X~H = \widetilde{X} if and only if the following conditions are all satisfied:

  1. s<t⇒H(s)≤H(t)s < t \Rightarrow H(s) \leq H(t) (in other words, HH is an increasing function);

  2. lim⁡t→−∞H(t)=0\lim_{t \rightarrow -\infty } H(t) = 0;

  3. lim⁡t→∞H(t)=1\lim_{t \rightarrow \infty } H(t) = 1;

  4. lim⁡t↓sH(t)=H(s)\lim_{t \downarrow s} H(t) = H(s) for every s∈Rs \in \mathbb {R} (in other words, HH is right continuous). In the proof of the "if" direction, XX is constructed by taking Ω=(0,1)\Omega = (0,1), F\mathcal{F} the Borel subsets of (0,1)(0,1), P\mathbb {P} Lebesgue measure on F\mathcal{F}, and X(ω)=sup⁡{t∈R:H(t)<ω}X(\omega ) = \sup \left\{ t \in \mathbb {R} : H(t) < \omega \right\} for ω∈(0,1)\omega \in (0,1).

Problem 12.14

Suppose (Ω,F,P)(\Omega , \mathcal{F}, \mathbb {P}) is a probability space and XX is a random variable. Prove that the following are equivalent:

?
(a)

X~\widetilde{X} is a continuous function on R\mathbb {R}.

(b)

X~\widetilde{X} is a uniformly continuous function on R\mathbb {R}.

(c)

P(X=t)=0\mathbb {P}\left(X = t\right) = 0 for every t∈Rt \in \mathbb {R}.

(d)

(X~∘X)∼(s)=s(\widetilde{X} \circ X)^{\sim }(s) = s for all s∈[0,1]s \in [0,1].

Problem 12.15

Suppose α>0\alpha > 0 and h(x)={0 if x<0,α2xe−αx if x≥0.h(x) = \begin{cases} 0 & \text{ if } x < 0, \\ \alpha^{2} x e^{-\alpha x} & \text{ if } x \geq 0.\end{cases} Let P=hdλ\mathbb {P} = h d \lambda and let XX be the random variable defined by X(x)=xX(x) = x for x∈Rx \in \mathbb {R}.

?
(a)

Verify that ∫−∞∞hdλ=1\int_{-\infty }^{\infty } h d \lambda = 1.

(b)

Find a formula for the distribution function X~\widetilde{X}.

(c)

Find a formula (in terms of α\alpha) for E[X]\mathbb {E}\left[X\right].

(d)

Find a formula (in terms of α\alpha) for σ(X)\sigma (X).

Problem 12.16

Suppose B\mathcal{B} is the σ\sigma-algebra of Borel subsets of [0,1)[0,1) and P\mathbb {P} is Lebesgue measure on ([0,1),B)([0,1), \mathcal{B}). Let {ek}k∈N\left\{ e_{k}\right\}_{k \in \mathbb {N}}be the family of functions defined by the fourth bullet point of Example 8.51 (notice that k=0k = 0 is excluded). Show that the family {ek}k∈N\left\{ e_{k}\right\}_{k \in \mathbb {N}}is an i.i.d.

?
Remark.
?

Example 8.51 (fourth bullet point): for kk a nonnegative integer, define ek:[0,1)→Fe_{k}: [0,1) \rightarrow \mathbf{F} (a Rademacher function) by ek(x)=1e_{k}(x) = 1 if x∈[n−12k,n2k]x \in \left[\frac{n-1}{2^{k}}, \frac{n}{2^{k}}\right] for some odd integer nn, and ek(x)=−1e_{k}(x) = -1 if xx is in such an interval for some even integer nn.

Problem 12.17

Suppose B\mathcal{B} is the σ\sigma-algebra of Borel subsets of (−π,π](-\pi , \pi ] and P\mathbb {P} is Lebesgue measure on ((−π,π],B)((-\pi , \pi ], \mathcal{B}) divided by 2π2 \pi. Let {ek}k∈Z\{0}\left\{ e_{k}\right\}_{k \in \mathbf{Z} \backslash \left\{ 0\right\} } be the family of trigonometric functions defined by the third bullet point of Example 8.51 (notice that k=0k = 0 is excluded).

?
(a)

Show that {ek}k∈Z\{0}\left\{ e_{k}\right\}_{k \in \mathbf{Z} \backslash \left\{ 0\right\} } is not an independent family of random variables.

(b)

Show that {ek}k∈Z\{0}\left\{ e_{k}\right\}_{k \in \mathbf{Z} \backslash \left\{ 0\right\} } is an identically distributed family.

Remark.
?

Example 8.51 (third bullet point): for k∈Zk \in \mathbb {Z}, define ek:(−π,π]→Re_{k}: (-\pi , \pi ] \rightarrow \mathbb {R} by

ek(t)={1πsin⁡(kt)if k>0,12πif k=0,1πcos⁡(kt)if k<0. e_{k}(t) = \begin{cases} \frac{1}{\sqrt{\pi }} \sin (kt) & \text{if } k > 0, \\ \frac{1}{\sqrt{2\pi }} & \text{if } k = 0, \\ \frac{1}{\sqrt{\pi }} \cos (kt) & \text{if } k < 0.\end{cases}