Section 21

Convergence in the Mean and Convergence of Means

[27/4%]
Show
LaTeX
Problem 21.1

Prove that convergence in the mean of order α>0\alpha > 0 implies convergence in the mean of order β\beta for every β∈(0,α)\beta \in (0, \alpha ).

?
Remark.
?

A sequence of random variables {ξn}\{ \xi_n\} converges in the mean of order α>0\alpha > 0 to a random variable ξ\xi if E[∣ξn−ξ∣α]→0\mathbb {E}\left[\left|\xi_n - \xi \right|^{\alpha }\right] \rightarrow 0 as n→∞n \rightarrow \infty. Convergence in the mean of order 2 is called mean-square convergence.

Problem 21.2

Prove that convergence in the mean of some order implies convergence in probability.

?
Problem 21.3

Give an example confirming that convergence in the mean of order α\alpha does not imply, in general, almost sure convergence.

?
Problem 21.4

Give an example confirming that convergence in probability does not imply, in general, convergence in the mean of order α\alpha.

?
Problem 21.5

Give an example confirming that almost sure convergence does not imply, in general, convergence in the mean of order α\alpha.

?
Problem 21.6

Prove that a sequence of random variables ξn\xi_n converges in the mean of order α\alpha if and only if the sequence ∣ξn∣α\left|\xi_n\right|^{\alpha } is uniformly integrable and ξn→pξ\xi_n \xrightarrow {p} \xi.

?
Remark.
?

A family of random variables {ξn}\{ \xi_n\} is called uniformly integrable if sup⁡nE[∣ξn∣;∣ξn∣>x]→0\sup_n \mathbb {E}\left[\left|\xi_n\right|; \left|\xi_n\right| > x\right] \rightarrow 0 as x→∞x \rightarrow \infty.

Problem 21.7

Let ∑n=1∞E[∣ξn−ξ∣α]<∞\sum_{n=1}^{\infty } \mathbb {E}\left[\left|\xi_n - \xi \right|^{\alpha }\right] < \infty. Prove that ξn→ξ\xi_n \rightarrow \xi a.s.

?
Problem 21.8

Let ∣ξn∣⩽c<∞\left|\xi_n\right| \leqslant c < \infty a.s. for all nn, and let ξn→ξ\xi_n \rightarrow \xi in probability as n→∞n \rightarrow \infty. Prove that E[∣ξn−ξ∣α]→0\mathbb {E}\left[\left|\xi_n - \xi \right|^{\alpha }\right] \rightarrow 0 for every α>0\alpha > 0.

?
Problem 21.9

Let ξ,ξ1,ξ2,…\xi , \xi_1, \xi_2, \ldots be nonnegative random variables such that ξn→ξ\xi_n \rightarrow \xi in probability and E[ξn]→E[ξ]<∞\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right] < \infty as n→∞n \rightarrow \infty. Prove that E[∣ξn−ξ∣]→0\mathbb {E}\left[\left|\xi_n - \xi \right|\right] \rightarrow 0.

?
Problem 21.10

Let α>0\alpha > 0 and E[∣ξn∣α]<∞\mathbb {E}\left[\left|\xi_n\right|^{\alpha }\right] < \infty for all nn. Prove that the following statements are equivalent:

  1. ξn→ξ\xi_n \rightarrow \xi in probability and E[∣ξn∣α]→E[∣ξ∣α]<∞\mathbb {E}\left[\left|\xi_n\right|^{\alpha }\right] \rightarrow \mathbb {E}\left[\left|\xi \right|^{\alpha }\right] < \infty as n→∞n \rightarrow \infty;

  2. E[∣ξn−ξ∣α]→0\mathbb {E}\left[\left|\xi_n - \xi \right|^{\alpha }\right] \rightarrow 0 as n→∞n \rightarrow \infty.

?
Problem 21.11

Let the family {ξn}\{ \xi_n\} of random variables be uniformly integrable. Prove that sup⁡nE[∣ξn∣]<∞\sup_n \mathbb {E}\left[\left|\xi_n\right|\right] < \infty.

?
Problem 21.12

Let the sequence {ξn}\{ \xi_n\} of random variables be such that sup⁡nE[∣ξn∣1+δ]<∞\sup_n \mathbb {E}\left[\left|\xi_n\right|^{1+\delta }\right] < \infty for some δ>0\delta > 0. Prove that this sequence is uniformly integrable.

?
Problem 21.13

Let {ξn}\{ \xi_n\} be a sequence of random variables. Prove that the following conditions are equivalent:

  1. the family {ξn}\{ \xi_n\} is uniformly integrable;

  2. there exists a nonnegative function g(x)g(x) such that g(x)→∞g(x) \rightarrow \infty as x→∞x \rightarrow \infty and sup⁡nE[∣ξn∣g(∣ξn∣)]<∞\sup_n \mathbb {E}\left[\left|\xi_n\right| g(\left|\xi_n\right|)\right] < \infty.

?
Problem 21.14

Let the sequence {ξn}\{ \xi_n\} of random variables be such that P(∣ξn∣⩾x)⩽P(∣η∣⩾x)\mathbb {P}\left(\left|\xi_n\right| \geqslant x\right) \leqslant \mathbb {P}\left(\left|\eta \right| \geqslant x\right) for every x>0x > 0, with E[∣η∣]<∞\mathbb {E}\left[\left|\eta \right|\right] < \infty. Prove that {ξn}\{ \xi_n\} is uniformly integrable.

?
Problem 21.15

Let {ξn}\{ \xi_n\} be a sequence of nonnegative random variables with finite means such that the distribution of ξn\xi_n converges weakly to the distribution of a random variable ξ\xi and E[ξn]→E[ξ]<∞\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right] < \infty as n→∞n \rightarrow \infty. Prove that this sequence is uniformly integrable.

?
Problem 21.16

Let ξn⇒ξ\xi_n \Rightarrow \xi as n→∞n \rightarrow \infty. Prove that the following statements are equivalent:

  1. the sequence {ξn}\{ \xi_n\} is uniformly integrable;

  2. E[∣ξn∣]<∞\mathbb {E}\left[\left|\xi_n\right|\right] < \infty, E[∣ξ∣]<∞\mathbb {E}\left[\left|\xi \right|\right] < \infty, and as n→∞n \rightarrow \infty

    E[max⁡(0,ξn)]→E[max⁡(0,ξ)],E[min⁡(0,ξn)]→E[min⁡(0,ξ)]. \mathbb {E}\left[\max (0, \xi _n)\right] \rightarrow \mathbb {E}\left[\max (0, \xi )\right], \qquad \mathbb {E}\left[\min (0, \xi _n)\right] \rightarrow \mathbb {E}\left[\min (0, \xi )\right].
?
Problem 21.17

Let the sequences ξn\xi_n and ηn\eta_n be uniformly integrable. Prove that the following sequences are uniformly integrable:

?
(a)

cξnc \xi_n;

(b)

ξn−ηn\xi_n - \eta_n;

(c)

ξn+ηn\xi_n + \eta_n.

Problem 21.18

Let the independent random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots be identically distributed with finite mean; set Sn=ξ1+…+ξnS_n = \xi_1 + \ldots + \xi_n. Prove that the sequence of random variables {Sn/n,n⩾1}\{ S_n / n, n \geqslant 1\} is uniformly integrable.

?
Problem 21.19

Let x∈Rx \in \mathbb {R} and let {ξn}\{ \xi_n\} be a sequence of random variables with finite means such that E[∣ξn∣]→E[∣ξ∣]\mathbb {E}\left[\left|\xi_n\right|\right] \rightarrow \mathbb {E}\left[\left|\xi \right|\right] as n→∞n \rightarrow \infty. Determine whether this implies the convergence E[∣ξn+x∣]→E[∣ξ+x∣]\mathbb {E}\left[\left|\xi_n + x\right|\right] \rightarrow \mathbb {E}\left[\left|\xi + x\right|\right].

?
Problem 21.20

Let ξ,ξ1,ξ2,…\xi , \xi_1, \xi_2, \ldots be nonnegative random variables such that E[ξn]→E[ξ]\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right] and P(ξ>ξn+ε)→0\mathbb {P}\left(\xi > \xi_n + \varepsilon \right) \rightarrow 0 as n→∞n \rightarrow \infty for every ε>0\varepsilon > 0. Prove that E[∣ξn−ξ∣]→0\mathbb {E}\left[\left|\xi_n - \xi \right|\right] \rightarrow 0.

?
Problem 21.21

Let ∣ξn−ξ∣⩽ηn\left|\xi_n - \xi \right| \leqslant \eta_n for every nn, E[∣ξ∣]<∞\mathbb {E}\left[\left|\xi \right|\right] < \infty, and E[ηn]→0\mathbb {E}\left[\eta_n\right] \rightarrow 0 as n→∞n \rightarrow \infty. Prove that ξn→ξ\xi_n \rightarrow \xi in probability and E[ξn]→E[ξ]\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right].

?
Problem 21.22

Let the random variables ξ,ξ1,ξ2,…\xi , \xi_1, \xi_2, \ldots be such that ξn⇒ξ\xi_n \Rightarrow \xi and Var⁡[ξn]→Var⁡[ξ]\operatorname {Var}\left[\xi_n\right] \rightarrow \operatorname {Var}\left[\xi \right]. Prove that E[ξn]→E[ξ]\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right].

?
Problem 21.23

Let {ξn}\{ \xi_n\} be a uniformly integrable sequence of random variables such that the distribution of ξn\xi_n converges weakly to the distribution of a random variable ξ\xi. Prove that E[ξ]\mathbb {E}\left[\xi \right] exists and E[ξn]→E[ξ]\mathbb {E}\left[\xi_n\right] \rightarrow \mathbb {E}\left[\xi \right] as n→∞n \rightarrow \infty.

?
Problem 21.24

Let ξn⇒ξ\xi_n \Rightarrow \xi. Prove that lim inf⁡n→∞Var⁡[ξn]⩾Var⁡[ξ]\liminf_{n \rightarrow \infty } \operatorname {Var}\left[\xi_n\right] \geqslant \operatorname {Var}\left[\xi \right].

?
Problem 21.25

Let ξn→pξ\xi_n \xrightarrow {p} \xi, with E[∣ξn∣]<∞\mathbb {E}\left[\left|\xi_n\right|\right] < \infty for all nn, and suppose

lim sup⁡n→∞E[∣ξn∣]⩽E[∣ξ∣]<∞. \limsup _{n \rightarrow \infty } \mathbb {E}\left[\left|\xi _n\right|\right] \leqslant \mathbb {E}\left[\left|\xi \right|\right] < \infty .

Prove that the sequence of random variables {ξn}\{ \xi_n\} is uniformly integrable and E[∣ξn−ξ∣]→0\mathbb {E}\left[\left|\xi_n - \xi \right|\right] \rightarrow 0 as n→∞n \rightarrow \infty.

?
Problem 21.26

Let ξn→pξ\xi_n \xrightarrow {p} \xi, with E[∣ξn∣]<∞\mathbb {E}\left[\left|\xi_n\right|\right] < \infty for all nn, and suppose

lim sup⁡n→∞E[ξn2]⩽E[ξ2]<∞. \limsup _{n \rightarrow \infty } \mathbb {E}\left[\xi _n^2\right] \leqslant \mathbb {E}\left[\xi ^2\right] < \infty .

Prove that the sequence of random variables {ξn}\{ \xi_n\} is uniformly integrable and E[(ξn−ξ)2]→0\mathbb {E}\left[(\xi_n - \xi )^2\right] \rightarrow 0 as n→∞n \rightarrow \infty.

?
Problem 21.27

Prove that the series ∑n=1∞ξn\sum_{n=1}^{\infty } \xi_n of uncorrelated random variables converges in the mean square if and only if the series ∑n=1∞E[ξn]\sum_{n=1}^{\infty } \mathbb {E}\left[\xi_n\right] and ∑n=1∞Var⁡[ξn]\sum_{n=1}^{\infty } \operatorname {Var}\left[\xi_n\right] converge.

?