Chapter 7

Conditional distributions and conditional expectations

[42/67%]
Show
LaTeX
Problem 7.1

On the probability space (Ω,A,P)(\Omega , \mathscr {A}, \mathbb {P}), where Ω=[0,1]\Omega = [0,1], A\mathscr {A} is the σ\sigma-algebra of Borel subsets, and P\mathbb {P} is Lebesgue measure, a random variable ξ\xi is given. Let B\mathscr {B} be the σ\sigma-algebra generated by the sets [0,1/3),{1/3}[0,1 / 3),\left\{ 1 / 3\right\}, and (1/3,1/2)(1 / 3,1 / 2). Find E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B} \right] if

?
(a)

ξ=ω\xi = \omega;

(b)

ξ=sin⁡πω\xi = \sin \pi \omega;

(c)

ξ=ω2\xi = \omega^{2};

(d)

ξ=1−ω\xi = 1-\omega;

(e)

ξ={1,ω∈[0,1/3],2,ω∈(1/3,1].\xi = \begin{cases} 1, & \omega \in [0,1 / 3], \\ 2, & \omega \in (1 / 3,1] . \end{cases}

Problem 7.2

Under the conditions of the previous problem, find the distribution function of the random variable E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B} \right].

?
(a)
(b)
(c)
(d)
(e)
Problem 7.3

On the probability space (Ω,A,P)(\Omega , \mathscr {A}, \mathbb {P}), where Ω=[0,1]\Omega = [0,1], A\mathscr {A} is the σ\sigma-algebra of Borel subsets, and P\mathbb {P} is Lebesgue measure, a random variable ξ=ω\xi = \omega is given. Find E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B} \right] if:

?
(a)

B\mathscr {B} is the σ\sigma-algebra of all Borel subsets of the segment [0,1][0,1] that are symmetric about the point 1/21 / 2;

(b)

B\mathscr {B} is the σ\sigma-algebra generated by the sets [0,1/3],[1/3,2/3][0,1 / 3],[1 / 3,2 / 3];

(c)

B\mathscr {B} is the σ\sigma-algebra generated by the random variable η=min⁡{2ω,1}\eta = \min \left\{ 2 \omega , 1\right\}.

Problem 7.4

Let ξ\xi and η\eta be independent random variables. Find Var⁡[E[ξη∣ξ]]\operatorname {Var}\left[\mathbb {E}\left[ \xi \eta \mid \xi \right]\right] if:

?
(a)

ξ\xi is uniformly distributed on the segment [0,1][0,1], and η\eta has a normal distribution with parameters aa and σ2\sigma^{2};

(b)

ξ\xi and η\eta have an exponential distribution with parameters λ\lambda and μ\mu, respectively.

Problem 7.5

Suppose the random variable ξ\xi takes at most nn values. Is it true that E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B} \right] also takes at most nn values?

?
Problem 7.6

Prove that if every event of the σ\sigma-algebra B\mathscr {B} has probability 0 or 1, then with probability 1

E[ξ∣B]=E[ξ]. \mathbb {E}\left[ \xi \mid \mathscr {B} \right] = \mathbb {E}\left[\xi \right] .
?
Problem 7.7

Let ξ\xi be a random variable and φ(x)\varphi (x) a Borel function such that E[φ(ξ)]\mathbb {E}\left[\varphi (\xi )\right] exists. Prove that

E[φ(ξ)∣ξ]=φ(ξ). \mathbb {E}\left[ \varphi (\xi ) \mid \xi \right] = \varphi (\xi ) .
?
Problem 7.8

Prove that if the σ\sigma-algebras B1\mathscr {B}_{1} and B2\mathscr {B}_{2} are independent, then for any ξ\xi and η\eta the random variables E[ξ∣B1]\mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \right] and E[η∣B2]\mathbb {E}\left[ \eta \mid \mathscr {B}_{2} \right] are independent.

?
Problem 7.9

Let B1\mathscr {B}_{1} and B2\mathscr {B}_{2} be independent σ\sigma-algebras. Prove that for any random variable ξ\xi having an expectation, with probability 1

E[ξ∣B1∩B2]=E[ξ]. \mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \cap \mathscr {B}_{2} \right] = \mathbb {E}\left[\xi \right] .
?
Problem 7.10

Let a random variable η=ω\eta = \omega be given on the probability space (Ω,A,P)(\Omega , \mathscr {A}, \mathbb {P}), where Ω\Omega is the segment [0,1],A[0,1], \mathscr {A} is the σ\sigma-algebra of Borel subsets of Ω\Omega, and P\mathbb {P} is Lebesgue measure. Prove that for any random variable ξ\xi, with probability 1E[ξ∣η]=ξ1 \quad \mathbb {E}\left[ \xi \mid \eta \right] = \xi.

?
Problem 7.11

Must the random variable E[ξ∣η]\mathbb {E}\left[ \xi \mid \eta \right] be measurable with respect to the σ\sigma-algebra generated by the random variable ξ\xi?

?
Problem 7.12

Let ξ\xi and η\eta be random variables with finite expectation. Prove that if there exists a random variable ζ\zeta such that E[ξ∣ζ]=η\mathbb {E}\left[ \xi \mid \zeta \right] = \eta, then E[ξ]=E[η]\mathbb {E}\left[\xi \right] = \mathbb {E}\left[\eta \right]. Is the converse true, i.e., does E[ξ]=E[η]\mathbb {E}\left[\xi \right] = \mathbb {E}\left[\eta \right] imply the existence of ζ\zeta such that E[ξ∣ζ]=η\mathbb {E}\left[ \xi \mid \zeta \right] = \eta?

?
Problem 7.13

Let ξ\xi and η\eta be independent identically distributed random variables with finite expectation. Prove that the random variables E[ξ∣ξ+η]\mathbb {E}\left[ \xi \mid \xi +\eta \right] and E[η∣ξ+η]\mathbb {E}\left[ \eta \mid \xi +\eta \right] are identically distributed. In what case are they independent?

?
Problem 7.14

Prove that under the conditions of the previous problem

E[ξ∣ξ+η]=E[η∣ξ+η] a.s.  \mathbb {E}\left[ \xi \mid \xi +\eta \right] = \mathbb {E}\left[ \eta \mid \xi +\eta \right] \quad \text{ a.s. }
?
Problem 7.15

Let ξ\xi and η\eta be independent identically distributed random variables with finite expectation. Prove that

E[ξ∣ξ+η]=E[η∣ξ+η]=ξ+η2 a.s.  \mathbb {E}\left[ \xi \mid \xi +\eta \right] = \mathbb {E}\left[ \eta \mid \xi +\eta \right] = \frac{\xi +\eta }{2} \text{ a.s. }
?
Problem 7.16

Let B1,B2,…\mathscr {B}_{1}, \mathscr {B}_{2}, \ldots be a nonincreasing sequence of σ\sigma-algebras, and let ξ\xi be a random variable. Find

E[E[…E[ξ∣B1]][B2]…∣Bn]. \mathbb {E}\left[ \mathbb {E}\left[\ldots \mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \right]\right][\mathscr {B}_{2}] \ldots \mid \mathscr {B}_{n} \right] .
?
Problem 7.17

Let B1,B2,…\mathscr {B}_{1}, \mathscr {B}_{2}, \ldots be a nondecreasing sequence of σ\sigma-algebras, and let ξ\xi be a random variable. Find

E[E[…E[ξ∣B1]][B2]…∣Bn]. \mathbb {E}\left[ \mathbb {E}\left[\ldots \mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \right]\right][\mathscr {B}_{2}] \ldots \mid \mathscr {B}_{n} \right] .
?
Problem 7.18

Let ξ\xi and η\eta be random variables with finite expectations. Prove that if with probability 1 E[ξ∣η]=η\mathbb {E}\left[ \xi \mid \eta \right] = \eta and E[η∣ξ]=ξ\mathbb {E}\left[ \eta \mid \xi \right] = \xi, then ξ=η\xi = \eta a.s.

?
Problem 7.19

Let ξ\xi be a random variable with expectation aa, let B1\mathscr {B}_{1} and B2\mathscr {B}_{2} be independent σ\sigma-algebras, and let ξ1=E[ξ∣B1],ξ2=E[ξ1∣B2]\xi_{1} = \mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \right], \quad \xi_{2} = \mathbb {E}\left[ \xi_{1} \mid \mathscr {B}_{2} \right]. Find the distribution of ξ2\xi_{2}.

?
Problem 7.20

Let ξ1,…,ξn\xi_{1}, \ldots , \xi_{n} be independent identically distributed random variables with finite expectation, and let ηn=ξ1+…+ξn\eta_{n} = \xi_{1}+\ldots +\xi_{n}. Prove that

E[ξ1∣ηn,ηn+1,…]=ηn∣n \mathbb {E}\left[ \xi _{1} \mid \eta _{n}, \eta _{n+1}, \ldots \right] = \eta _{n} \mid n

with probability one.

?
Problem 7.21

(Jensen's inequality) Let φ(x)\varphi (x) be a convex function, and let ξ\xi be a random variable such that E[∣φ(ξ)∣]<∞\mathbb {E}\left[\left|\varphi (\xi )\right|\right] < \infty. Prove that

E[φ(ξ)∣B]⩾φ(E[ξ∣B]). \mathbb {E}\left[ \varphi (\xi ) \mid \mathscr {B} \right] \geqslant \varphi (\mathbb {E}\left[ \xi \mid \mathscr {B} \right]) .
?
Problem 7.22

Prove that Var⁡[E[ξ∣B]]⩽Var⁡[ξ]\operatorname {Var}\left[\mathbb {E}\left[ \xi \mid \mathscr {B} \right]\right] \leqslant \operatorname {Var}\left[\xi \right].

?
Problem 7.23

Let 0<α⩽1,0<β⩽1,α+β⩽1,ξ0 < \alpha \leqslant 1,0 < \beta \leqslant 1, \alpha +\beta \leqslant 1, \xi and η\eta be random variables with finite expectations. Prove that

E[∣ξ∣α∣η∣β∣B]⩽[E[∣ξ∣∣B]]α[E[∣η∣∣B]]β. \mathbb {E}\left[ \left|\xi \right|^{\alpha }\left|\eta \right|^{\beta } \mid \mathscr {B} \right] \leqslant [\mathbb {E}\left[ \left|\xi \right| \mid \mathscr {B} \right]]^{\alpha }[\mathbb {E}\left[ \left|\eta \right| \mid \mathscr {B} \right]]^{\beta } .
?
Problem 7.24

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables, let η\eta be a random variable with finite variance, and let a=E[η]a = \mathbb {E}\left[\eta \right]. Prove that

1n(E[η∣ξ1]+…+E[η∣ξn])→Pa \frac{1}{n}\left(\mathbb {E}\left[ \eta \mid \xi _{1} \right]+\ldots +\mathbb {E}\left[ \eta \mid \xi _{n} \right]\right) \xrightarrow {\mathbb {P}} a

as n→∞n \rightarrow \infty.

?
Problem 7.25

Is the following assertion true: if ξn→ξ\xi_{n} \rightarrow \xi a.s., then for any random variable η\eta

E[η∣ξn]→PE[η∣ξ]? \mathbb {E}\left[ \eta \mid \xi _{n} \right] \xrightarrow {\mathbb {P}} \mathbb {E}\left[ \eta \mid \xi \right] ?
?
Problem 7.26

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of random variables, and let B\mathscr {B} be a σ\sigma-algebra. Prove that if for some p⩾1p \geqslant 1, E[∣ξn−ξ∣p]→0\mathbb {E}\left[\left|\xi_{n}-\xi \right|^{p}\right] \rightarrow 0 as n→∞n \rightarrow \infty, then

E[∣E[ξn∣B]−E[ξ∣B]∣p]→0. \mathbb {E}\left[\left|\mathbb {E}\left[ \xi _{n} \mid \mathscr {B} \right]-\mathbb {E}\left[ \xi \mid \mathscr {B} \right]\right|^{p}\right] \rightarrow 0.
?
Problem 7.27

Let B1,B2,…\mathscr {B}_{1}, \mathscr {B}_{2}, \ldots be a sequence of σ\sigma-algebras, and let ξ\xi and η\eta be random variables with finite expectations. Prove that if E[ξ∣Bn]→η\mathbb {E}\left[ \xi \mid \mathscr {B}_{n} \right] \rightarrow \eta a.s. as n→∞n \rightarrow \infty, then E[ξ∣B]=E[η∣B]\mathbb {E}\left[ \xi \mid \mathscr {B} \right] = \mathbb {E}\left[ \eta \mid \mathscr {B} \right] a.s., where B=⋂n=1∞Bn\mathscr {B} = \bigcap_{n = 1}^{\infty } \mathscr {B}_{n}.

?
Problem 7.28

Let ξ\xi and η\eta be random variables with finite expectations. Prove that if there exists a sequence of random variables ζ1,ζ2,…\zeta_{1}, \zeta_{2}, \ldots such that E[ξ∣ζn]→η\mathbb {E}\left[ \xi \mid \zeta_{n} \right] \rightarrow \eta a.s. as n→∞n \rightarrow \infty, then E[ξ]=E[η]\mathbb {E}\left[\xi \right] = \mathbb {E}\left[\eta \right].

?
Problem 7.29

Let B1⊂B2⊂…\mathscr {B}_{1} \subset \mathscr {B}_{2} \subset \ldots be a nondecreasing sequence of σ\sigma-algebras, and let ξ\xi be a random variable with finite expectation. Prove that for any ε>0\varepsilon > 0

P(sup⁡1⩽k⩽n∣E[ξ∣Bk]∣>ε)⩽E[∣ξ∣]ε. \mathbb {P}\left(\sup _{1 \leqslant k \leqslant n}\left|\mathbb {E}\left[ \xi \mid \mathscr {B}_{k} \right]\right| > \varepsilon \right) \leqslant \frac{\mathbb {E}\left[\left|\xi \right|\right]}{\varepsilon } .
?
Problem 7.30

Let B1⊂B2⊂…\mathscr {B}_{1} \subset \mathscr {B}_{2} \subset \ldots be a nondecreasing sequence of σ\sigma-algebras,

B=σ(⋃n=1∞Bn), \mathscr {B} = \sigma \left(\bigcup _{n = 1}^{\infty } \mathscr {B}_{n}\right),

and let ξ\xi be a random variable with finite expectation. Prove that E[ξ∣Bn]→E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B}_{n} \right] \rightarrow \mathbb {E}\left[ \xi \mid \mathscr {B} \right] a.s.

?
Problem 7.31

Let B1⊃B2⊃…\mathscr {B}_{1} \supset \mathscr {B}_{2} \supset \ldots be a nonincreasing sequence of σ\sigma-algebras,

B=⋂n=1∞Bn, \mathscr {B} = \bigcap _{n = 1}^{\infty } \mathscr {B}_{n},

and let ξ\xi be a random variable with finite expectation. Prove that E[ξ∣Bn]→E[ξ∣B]\mathbb {E}\left[ \xi \mid \mathscr {B}_{n} \right] \rightarrow \mathbb {E}\left[ \xi \mid \mathscr {B} \right] a.s.

?
Problem 7.32

Let B1,B2,…\mathscr {B}_{1}, \mathscr {B}_{2}, \ldots be a sequence of σ\sigma-algebras, and let ξ\xi be a random variable with finite expectation. Prove that the sequence E[ξ∣B1],E[ξ∣B2],…\mathbb {E}\left[ \xi \mid \mathscr {B}_{1} \right], \mathbb {E}\left[ \xi \mid \mathscr {B}_{2} \right], \ldots is uniformly integrable.

?
Problem 7.33

Prove that the random variable ξ\xi and the σ\sigma-algebra B\mathscr {B} are independent if and only if, for every Borel function φ(x)\varphi (x) such that E[∣φ(ξ)∣]<∞\mathbb {E}\left[\left|\varphi (\xi )\right|\right] < \infty, the equality

E[φ(ξ)∣B]=E[φ(ξ)]. \mathbb {E}\left[ \varphi (\xi ) \mid \mathscr {B} \right] = \mathbb {E}\left[\varphi (\xi )\right] .

holds.

?
Problem 7.34

Let (Ω,A,P)(\Omega , \mathscr {A}, \mathbb {P}) be a probability space, and let B\mathscr {B} be a σ\sigma-algebra, B⊂A\mathscr {B} \subset \mathscr {A}. Prove that for any event AA

P(A)=∫Q˙P(A∣B)P(dω) \mathbb {P}\left(A\right) = \int _{\dot{Q}} \mathbb {P}\left( A \mid \mathscr {B} \right) \mathbb {P}(d \omega )
?
Problem 7.35

Prove that any two random variables defined on a probability space (Ω,A,P)(\Omega , \mathscr {A}, P) are conditionally independent with respect to the σ\sigma-algebra A\mathscr {A}.

?
Problem 7.36

Prove that the random variables ξ\xi and η\eta are independent if and only if they are conditionally independent with respect to the trivial σ\sigma-algebra B={∅,Ω}\mathscr {B} = \left\{ \varnothing , \Omega \right\}.

?
Problem 7.37

Prove that the σ\sigma-algebras B1\mathscr {B}_{1} and B2\mathscr {B}_{2} are conditionally independent with respect to the σ\sigma-algebra B\mathscr {B} if and only if for any B2∈B2B_{2} \in \mathscr {B}_{2}

P(B2∣BB1)=P(B2∣B). \mathbb {P}\left( B_{2} \mid \mathscr {B} \mathscr {B}_{1} \right) = \mathbb {P}\left( B_{2} \mid \mathscr {B} \right) .
?
Problem 7.38

Let the random variables ξ\xi and η\eta be independent. Can they be conditionally dependent with respect to some σ\sigma-algebra B\mathscr {B}?

?
Problem 7.39

Let P(A∣B),A∈A,\mathbb {P}\left( A \mid \mathscr {B} \right), A \in \mathscr {A}, be a regular family of conditional probabilities, and let ξ\xi be a random variable with finite expectation. Prove that

E[ξ∣B]=∫Ωξ(ω)P(dω∣B) a.s.  \mathbb {E}\left[ \xi \mid \mathscr {B} \right] = \int _{\Omega } \xi (\omega ) \mathbb {P}(d \omega \mid \mathscr {B}) \text{ a.s. }
?
Problem 7.40

Let B\mathscr {B} be the σ\sigma-algebra of Borel subsets of Ω=(0,1)\Omega = (0,1), let P be Lebesgue measure on B\mathscr {B}, and let C⊂ΩC \subset \Omega be a set having outer Lebesgue measure 1 and inner Lebesgue measure 0. Consider the probability space (Ω,A,Pc)(\Omega , \mathscr {A}, \mathbf{P}_{c}), where A\mathscr {A} is the σ\sigma-algebra of sets of the form A=B1C+B2Cˉ,B1,B2∈B,PC(A)=12P(B1)+12P(B2)A = B_{1} C+B_{2} \bar{C}, B_{1}, B_{2} \in \mathscr {B}, \quad \mathbb {P}_{C}\left(A\right) = \frac{1}{2} \mathbb {P}\left(B_{1}\right)+\frac{1}{2} \mathbb {P}\left(B_{2}\right). Prove that the family of conditional probabilities Pc(A∣B)\mathbb {P}_{c}\left( A \mid \mathscr {B} \right) is not regular.

?
Problem 7.41

Consider the probability space (Ω,A,P)(\Omega , \mathscr {A}, \mathbb {P}), where Ω=[0,1],A\Omega = [0,1], \mathscr {A} is the σ\sigma-algebra of Borel subsets, and P\mathbb {P} is Lebesgue measure. Prove that the family of conditional probabilities P(A∣B)\mathbb {P}\left( A \mid \mathscr {B} \right) is regular if:

?
(a)

B={∅,Ω}\mathscr {B} = \left\{ \varnothing , \Omega \right\};

(b)

B=A\mathscr {B} = \mathscr {A};

(c)

B\mathscr {B} is the σ\sigma-algebra generated by the set [0,1/2)[0,1 / 2).

Problem 7.42

Let a random variable ξ(ω)=ω\xi (\omega ) = \omega be given on the probability space (Ω,A,P)(\Omega , \mathscr {A}, P), where Ω=[0,1],A\Omega = [0,1], \mathscr {A} is the σ\sigma-algebra of Borel sets, and P\mathbb {P} is Lebesgue measure. Find the conditional distribution of ξ\xi with respect to the σ\sigma-algebra B\mathscr {B} generated by the random variable η\eta, if

?
(a)

η={1,ω∈[0,1/3),0,ω∈[1/3,1];\eta = \begin{cases} 1, & \omega \in [0,1 / 3), \\ 0, & \omega \in [1 / 3,1] ; \end{cases}

(b)

η=sin⁡πω\eta = \sin \pi \omega;

(c)

η={1−3ω,ω∈[0,1/3), 3ω−12,ω∈[1/3,1]. \eta = \begin{cases} 1-3 \omega , & \omega \in [0,1 / 3) \text{, } \\ \frac{3 \omega -1}{2}, & \omega \in [1 / 3,1] \text{. } \end{cases}