Section 18

Almost Sure Convergence

[25/20%]
Show
LaTeX
Problem 18.1

Let ξn→ξ\xi_n \rightarrow \xi and ξn→η\xi_n \rightarrow \eta a.s. Prove that then P(ξ=η)=1\mathbb {P}\left(\xi = \eta \right) = 1.

?
Remark.
?

A sequence of random variables {ξn}\{ \xi_n\} converges almost surely (with probability 1) to a random variable ξ\xi (written ξn→ξ\xi_n \rightarrow \xi a.s.) if P(ω:ξn(ω)→ξ(ω) as n→∞)=1\mathbb {P}\left(\omega : \xi_n(\omega ) \rightarrow \xi (\omega ) \text{ as } n \rightarrow \infty \right) = 1.

Problem 18.2

Let a sequence of independent random variables ξn\xi_n converge almost surely. Prove that the variance of the limit is zero.

?
Problem 18.3

Prove that ξn→ξ\xi_n \rightarrow \xi a.s. if and only if for every ε>0\varepsilon > 0

P(∣ξn−ξ∣>ε for infinitely many n)=0. \mathbb {P}\left(\left|\xi _n - \xi \right| > \varepsilon \text{ for infinitely many } n\right) = 0.
?
Problem 18.4

Prove that a sequence of random variables converges almost surely to some random variable if and only if it is fundamental with probability 1.

?
Remark.
?

A sequence ξn\xi_n is fundamental with probability 1 if P(ω:ξn(ω) is a fundamental sequence)=1\mathbb {P}\left(\omega : \xi_n(\omega ) \text{ is a fundamental sequence}\right) = 1.

Problem 18.5

Prove that ξn→ξ\xi_n \rightarrow \xi a.s. if and only if for every ε>0\varepsilon > 0

P(sup⁡i⩾n∣ξi−ξ∣>ε)→0 as n→∞. \mathbb {P}\left(\sup _{i \geqslant n} \left|\xi _i - \xi \right| > \varepsilon \right) \rightarrow 0 \text{ as } n \rightarrow \infty .
?
Problem 18.6

Prove that a sequence of random variables {ξn}\{ \xi_n\} is fundamental with probability 1 if and only if for every ε>0\varepsilon > 0

P(sup⁡i⩾1∣ξn+i−ξn∣>ε)→0 as n→∞. \mathbb {P}\left(\sup _{i \geqslant 1} \left|\xi _{n+i} - \xi _n\right| > \varepsilon \right) \rightarrow 0 \text{ as } n \rightarrow \infty .
?
Problem 18.7

Let independent random variables ξn\xi_n take the values 1 and 0 with probabilities pnp_n and 1−pn1 - p_n, respectively. Under what conditions on pnp_n does the sequence of random variables {ξn}\{ \xi_n\} converge a.s.:

?
(a)

to zero;

(b)

to one?

Problem 18.8

Let Ω=[0,1]\Omega = [0, 1], let F\mathscr {F} be the σ\sigma-algebra of Borel sets, and let P()\mathbb {P}\left(\right) be Lebesgue measure. Prove that the sequence of random variables

ξn(ω)={en, for ω∈[0,1/n],0, for ω∈(1/n,1] \xi _n(\omega ) = \begin{cases} e^n, & \text{ for } \omega \in [0, 1/n], \\ 0, & \text{ for } \omega \in (1/n, 1] \end{cases}

converges a.s. and find the limit.

?
Problem 18.9

Let ξn→ξ\xi_n \rightarrow \xi a.s. Prove that:

?
(a)

∣ξn∣→∣ξ∣\left|\xi_n\right| \rightarrow \left|\xi \right| a.s.;

(b)

ξn2→ξ2\xi_n^2 \rightarrow \xi^2 a.s.

Problem 18.10

Let ξn→1\xi_n \rightarrow 1 and ηn→1\eta_n \rightarrow 1 a.s. Prove that:

?
(a)

1ξn+ηn→12\dfrac {1}{\xi_n + \eta_n} \rightarrow \dfrac {1}{2} a.s.;

(b)

ξnηn→1\xi_n \eta_n \rightarrow 1 a.s.;

(c)

ξn+ηn→2\xi_n + \eta_n \rightarrow 2 a.s.

Problem 18.11

Let (ξn−ξ)2→0(\xi_n - \xi )^2 \rightarrow 0 a.s. Prove that ξn2→ξ2\xi_n^2 \rightarrow \xi^2 a.s.

?
Problem 18.12

Let ξn→ξ\xi_n \rightarrow \xi a.s. and let g(x)g(x) be a continuous function. Prove that g(ξn)→g(ξ)g(\xi_n) \rightarrow g(\xi ) a.s.

?
Problem 18.13

Let ξn→ξ\xi_n \rightarrow \xi, ηn→η\eta_n \rightarrow \eta a.s. and let g(x,y)g(x, y) be a continuous function. Prove that g(ξn,ηn)→g(ξ,η)g(\xi_n, \eta_n) \rightarrow g(\xi , \eta ) a.s.

?
Problem 18.14

Let {ξn}\{ \xi_n\} be a sequence of random variables such that for every ε>0\varepsilon > 0

∑n=1∞P(∣ξn−ξ∣>ε)<∞. \sum _{n=1}^{\infty } \mathbb {P}\left(\left|\xi _n - \xi \right| > \varepsilon \right) < \infty .

Prove that ξn→ξ\xi_n \rightarrow \xi a.s.

?
Problem 18.15

Let {ξn}\{ \xi_n\} and {ηn}\{ \eta_n\} be two sequences of random variables such that for every ε>0\varepsilon > 0

∑n=1∞P(∣ξn−ηn∣>ε)<∞. \sum _{n=1}^{\infty } \mathbb {P}\left(\left|\xi _n - \eta _n\right| > \varepsilon \right) < \infty .

Prove that if ηn→a\eta_n \rightarrow a a.s., then ξn→a\xi_n \rightarrow a a.s.

?
Problem 18.16

Let the random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots be independent and let ξn→0\xi_n \rightarrow 0 a.s. Prove that the series ∑n=1∞P(∣ξn∣>1)\sum_{n=1}^{\infty } \mathbb {P}\left(\left|\xi_n\right| > 1\right) converges.

?
Problem 18.17

Let {ξn}\{ \xi_n\} be a sequence of random variables. Prove that if for some summable sequence of positive numbers {εn}\{ \varepsilon_n\}

∑n=1∞P(∣ξn+1−ξn∣>εn)<∞, \sum _{n=1}^{\infty } \mathbb {P}\left(\left|\xi _{n+1} - \xi _n\right| > \varepsilon _n\right) < \infty ,

then the sequence {ξn}\{ \xi_n\} converges with probability 1 to some random variable.

?
Problem 18.18

Let {ξn}\{ \xi_n\} be a sequence of random variables. Prove that if the series ∑n=1∞E[ξn2]\sum_{n=1}^{\infty } \mathbb {E}\left[\xi_n^2\right] converges, then ξn→0\xi_n \rightarrow 0 a.s.

?
Problem 18.19

Let ξ,ξ1,ξ2,…\xi , \xi_1, \xi_2, \ldots be random variables such that the series ∑n=1∞E[∣ξn−ξ∣a]\sum_{n=1}^{\infty } \mathbb {E}\left[\left|\xi_n - \xi \right|^a\right] converges for some a>0a > 0. Prove that ξn→ξ\xi_n \rightarrow \xi a.s.

?
Problem 18.20

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be a sequence of independent random variables such that E[ξn2]<σ2\mathbb {E}\left[\xi_n^2\right] < \sigma^2 and E[ξn]=0\mathbb {E}\left[\xi_n\right] = 0. Prove that the series ∑n=1∞ξn2n\sum_{n=1}^{\infty } \dfrac {\xi_n}{2^n} converges a.s.

?
Problem 18.21

Prove that the radius of convergence RR of the random power series ∑i=0∞ξizi\sum_{i=0}^{\infty } \xi_i z^i, whose coefficients ξi\xi_i are independent, is a constant (almost surely).

?
Problem 18.22

Prove that the radius of convergence RR of the random power series ∑i=0∞ξizi\sum_{i=0}^{\infty } \xi_i z^i, whose coefficients ξi\xi_i are independent and identically distributed with a nondegenerate distribution, equals 1 or 0 according to whether the moment E[ln⁡(1+∣ξ0∣)]\mathbb {E}\left[\ln (1 + \left|\xi_0\right|)\right] is finite or infinite.

?
Problem 18.23

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be independent random variables with the Cauchy distribution. Prove that

lim sup⁡n→∞ξ1+…+ξnn=∞ a.s., \limsup _{n \rightarrow \infty } \frac{\xi _1 + \ldots + \xi _n}{n} = \infty \text{ a.s.},

while for α>0\alpha > 0

lim sup⁡n→∞ξ1+…+ξnn1+α=0 a.s. \limsup _{n \rightarrow \infty } \frac{\xi _1 + \ldots + \xi _n}{n^{1+\alpha }} = 0 \text{ a.s.}
?
Problem 18.24

Let the random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots be independent and uniformly distributed on [0,1][0, 1]. Prove that the series ∑n=1∞∏i=1nξi\sum_{n=1}^{\infty } \prod_{i=1}^{n} \xi_i converges a.s.

?
Problem 18.25

Let independent identically distributed random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots take values in the set {1,…,J}\{ 1, \ldots , J\}, with p(k)=P(ξ1=k)>0p(k) = \mathbb {P}\left(\xi_1 = k\right) > 0 for every k∈{1,…,J}k \in \{ 1, \ldots , J\}. Denote by Nn(k)=∑i=1n  1ξi=kN_n(k) = \sum_{i=1}^{n} \; \mathbb {1}_{\xi_i = k} the number of elements among ξ1,…,ξn\xi_1, \ldots , \xi_n equal to kk; set ηn=∏k=1J(p(k))Nn(k)\eta_n = \prod_{k=1}^{J} (p(k))^{N_n(k)}. Prove that the sequence ln⁡ηnn\dfrac {\ln \eta_n}{n} converges a.s., and find its limit.

?