Section 19

Convergence in Probability

[26/27%]
Show
LaTeX
Problem 19.1

Let ξn→pξ\xi_n \xrightarrow {p} \xi and ξn→pη\xi_n \xrightarrow {p} \eta. Prove that P(ξ=η)=1\mathbb {P}\left(\xi = \eta \right) = 1.

?
Remark.
?

A sequence of random variables {ξn}\{ \xi_n\} converges in probability to a random variable ξ\xi (written ξn→pξ\xi_n \xrightarrow {p} \xi) if for every ε>0\varepsilon > 0 we have P(ω:∣ξn(ω)−ξ(ω)∣>ε)→0\mathbb {P}\left(\omega : \left|\xi_n(\omega ) - \xi (\omega )\right| > \varepsilon \right) \rightarrow 0 as n→∞n \rightarrow \infty.

Problem 19.2

Let ξn→pξ\xi_n \xrightarrow {p} \xi, ηn→pη\eta_n \xrightarrow {p} \eta, and P(ξ=η)=1\mathbb {P}\left(\xi = \eta \right) = 1. Prove that (ξn−ηn)→p0(\xi_n - \eta_n) \xrightarrow {p} 0 as n→∞n \rightarrow \infty.

?
Problem 19.3

Prove that almost sure convergence implies convergence in probability.

?
Problem 19.4

Prove that convergence in probability does not imply, in general, almost sure convergence.

?
Problem 19.5

Let Ω\Omega be the unit circle, let F\mathscr {F} be the σ\sigma-algebra of Borel sets, and let P()\mathbb {P}\left(\right) be the uniform distribution on the circle. Let ξ(ω)≡1\xi (\omega ) \equiv 1, and

ξn(ω)={2, on the arc [r(n),r(n)+1/n],1, otherwise, \xi _n(\omega ) = \begin{cases} 2, & \text{ on the arc } [r(n), r(n) + 1/n], \\ 1, & \text{ otherwise,} \end{cases}

where r(n)=∑k=1n1kr(n) = \sum_{k=1}^{n} \dfrac {1}{k}. Determine whether the sequence {ξn}\{ \xi_n\} converges to the random variable ξ\xi:

?
(a)

in probability,

(b)

with probability 1.

Problem 19.6

Prove that if the sequence ξn\xi_n converges in probability to ξ\xi, then there exists a subsequence of indices nkn_k such that ξnk→ξ\xi_{n_k} \rightarrow \xi a.s. as k→∞k \rightarrow \infty.

?
Problem 19.7

Prove that if ξ1⩽ξ2⩽…\xi_1 \leqslant \xi_2 \leqslant \ldots and ξn\xi_n converge in probability to ξ\xi, then ξn\xi_n converge to ξ\xi a.s.

?
Problem 19.8

Let the random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots be independent. Prove that if the series ∑n=1∞ξn\sum_{n=1}^{\infty } \xi_n converges in probability, then it also converges a.s.

?
Problem 19.9

Let {ξn}\{ \xi_n\} be a sequence of random variables, where ξn\xi_n takes the values e−αne^{-\alpha n} and eαne^{\alpha n} with probabilities 1−e−βn1 - e^{-\beta n} and e−βne^{-\beta n}, respectively. For which values of α\alpha and β\beta does the convergence ξn→p0\xi_n \xrightarrow {p} 0 hold?

?
Problem 19.10

Let the random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots be independent, where ξn\xi_n has:

?
(a)

the Bernoulli distribution with parameter pnp_n;

(b)

the binomial distribution with parameters nn and pnp_n.

Under what conditions on pnp_n does the sequence of random variables {ξn}\{ \xi_n\} converge in probability?

Problem 19.11

Prove that ξn\xi_n converge in probability to ξ\xi and ηn\eta_n converge in probability to η\eta if and only if the sequence of random vectors (ξn,ηn)(\xi_n, \eta_n) converges in probability to (ξ,η)(\xi , \eta ).

?
Problem 19.12

Let ξn→pξ\xi_n \xrightarrow {p} \xi. Prove that:

?
(a)

∣ξn∣→p∣ξ∣\left|\xi_n\right| \xrightarrow {p} \left|\xi \right|,

(b)

ξn2→pξ2\xi_n^2 \xrightarrow {p} \xi^2.

Problem 19.13

Let ξn→pξ\xi_n \xrightarrow {p} \xi and let g(x)g(x) be a uniformly continuous function. Prove that g(ξn)→pg(ξ)g(\xi_n) \xrightarrow {p} g(\xi ).

?
Problem 19.14

Let ξn→pξ\xi_n \xrightarrow {p} \xi and let g(x)g(x) be a continuous function. Prove that g(ξn)→pg(ξ)g(\xi_n) \xrightarrow {p} g(\xi ).

?
Problem 19.15

Let ξn→pξ\xi_n \xrightarrow {p} \xi, with P(ξ=0)=0\mathbb {P}\left(\xi = 0\right) = 0. Prove that 1ξn→p1ξ\dfrac {1}{\xi_n} \xrightarrow {p} \dfrac {1}{\xi }.

?
Problem 19.16

Let ξn→pξ\xi_n \xrightarrow {p} \xi and let AA be a set of points on the line such that P(ξ∈A)=0\mathbb {P}\left(\xi \in A\right) = 0. Consider a function g(x)g(x) whose set of discontinuity points is contained in AA. Prove that g(ξn)→pg(ξ)g(\xi_n) \xrightarrow {p} g(\xi ).

?
Problem 19.17

Let ξn→p1\xi_n \xrightarrow {p} 1 and ηn→p1\eta_n \xrightarrow {p} 1. Prove that:

?
(a)

1ξn+ηn→p12\dfrac {1}{\xi_n + \eta_n} \xrightarrow {p} \dfrac {1}{2};

(b)

ξnηn→p1\xi_n \eta_n \xrightarrow {p} 1;

(c)

ξn+ηn→p2\xi_n + \eta_n \xrightarrow {p} 2.

Problem 19.18

Let ξn→pξ\xi_n \xrightarrow {p} \xi and ηn→pη\eta_n \xrightarrow {p} \eta. Prove that:

?
(a)

ξnηn→pξη\xi_n \eta_n \xrightarrow {p} \xi \eta;

(b)

aξn+bηn→paξ+bηa \xi_n + b \eta_n \xrightarrow {p} a \xi + b \eta, where aa and bb are arbitrary numbers.

Problem 19.19

Let ξn→pξ\xi_n \xrightarrow {p} \xi, ηn→pη\eta_n \xrightarrow {p} \eta, and let g(x,y)g(x, y) be a uniformly continuous bounded function. Prove that g(ξn,ηn)→pg(ξ,η)g(\xi_n, \eta_n) \xrightarrow {p} g(\xi , \eta ).

?
Problem 19.20

Let ξn→pξ\xi_n \xrightarrow {p} \xi, ηn→pη\eta_n \xrightarrow {p} \eta, and let g(x,y)g(x, y) be a continuous function. Prove that g(ξn,ηn)→pg(ξ,η)g(\xi_n, \eta_n) \xrightarrow {p} g(\xi , \eta ).

?
Problem 19.21

Let (ξn−ξ)2→p0(\xi_n - \xi )^2 \xrightarrow {p} 0. Prove that ξn2→pξ2\xi_n^2 \xrightarrow {p} \xi^2. Is the converse true?

?
Problem 19.22

Prove that if ξn→pξ\xi_n \xrightarrow {p} \xi as n→∞n \rightarrow \infty and g(x)g(x) is a continuous bounded function, then E[g(ξn)]→E[g(ξ)]\mathbb {E}\left[g(\xi_n)\right] \rightarrow \mathbb {E}\left[g(\xi )\right].

?
Problem 19.23

Give an example confirming that, under the conditions of Problem 19.22, the requirement that the function ff be continuous and bounded cannot, in general, be dropped.

?
Problem 19.24

Let gg be a continuous, monotonically increasing, and bounded function on the half-line [0,∞)[0, \infty ) with g(0)=0g(0) = 0. Prove that the condition lim⁡n→∞E[g(∣ξn∣)]=0\lim_{n \rightarrow \infty } \mathbb {E}\left[g(\left|\xi_n\right|)\right] = 0 is necessary and sufficient for ξn→p0\xi_n \xrightarrow {p} 0.

?
Problem 19.25

Prove that ξn\xi_n converge in probability to ξ\xi if and only if

E[∣ξn−ξ∣1+∣ξn−ξ∣]→0. \mathbb {E}\left[\frac{\left|\xi _n - \xi \right|}{1 + \left|\xi _n - \xi \right|}\right] \rightarrow 0.
?
Problem 19.26

Let {ξn}\{ \xi_n\} be a sequence of random variables with zero expectations. Does convergence ξn→p0\xi_n \xrightarrow {p} 0 as n→∞n \rightarrow \infty imply convergence ξ1+…+ξnn→p0\dfrac {\xi_1 + \ldots + \xi_n}{n} \xrightarrow {p} 0?

?