Section 25

The Central Limit Theorem

[25/64%]
Show
LaTeX
Problem 25.1

Suppose the CLT holds for a sequence {ξn}\{ \xi_{n}\}, and Var⁡[Sn]=o(n2)\operatorname {Var}\left[S_{n}\right] = o(n^{2}) as n→∞n \rightarrow \infty. Prove that the LLN then holds as well.

?
Problem 25.2

Give an example showing that the Lyapunov condition is not necessary for the CLT to hold.

?
Problem 25.3

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a uniformly bounded sequence of independent random variables, i.e., there exists a constant A<∞A < \infty such that ∣ξn∣<A\left|\xi_{n}\right| < A for all nn. Let Sn=ξ1+…+ξnS_{n} = \xi_{1} + \ldots + \xi_{n}. Prove that the sequence {ξn}\{ \xi_{n}\} satisfies the CLT if Var⁡[Sn]→∞\operatorname {Var}\left[S_{n}\right] \rightarrow \infty.

?
Problem 25.4

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed random variables with finite, nonzero variance. Prove that for any aa and bb

lim⁡n→∞P(a⩽Sn⩽b)=0. \lim _{n \rightarrow \infty } \mathbb {P}\left(a \leqslant S_{n} \leqslant b\right) = 0.
?
Problem 25.5

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed random variables with finite variance. Prove that for any bb the limit

lim⁡n→∞P(Sn<b) \lim _{n \rightarrow \infty } \mathbb {P}\left(S_{n} < b\right)

equals either 0, 1, or 1/2. Find the conditions under which each of these situations occurs.

?
Problem 25.6

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed (nondegenerate) random variables with zero mean and finite variance. Prove that for any b>0b > 0 the limit

lim⁡n→∞P(∣Snnα∣<b) \lim _{n \rightarrow \infty } \mathbb {P}\left(\left|\frac{S_{n}}{n^{\alpha }}\right| < b\right)

equals 0 for α<1/2\alpha < 1/2 and 1 for α>1/2\alpha > 1/2.

?
Problem 25.7

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed (nondegenerate) random variables with zero mean and finite variance. Find the limit

lim⁡n→∞P(∣Snn∣<b). \lim _{n \rightarrow \infty } \mathbb {P}\left(\left|\frac{S_{n}}{\sqrt{n}}\right| < b\right).
?
Problem 25.8

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed random variables with zero mean and finite variance. Find Var⁡[ξ1]\operatorname {Var}\left[\xi_{1}\right] if:

?
(a)

lim⁡n→∞P(Snn>1)=13\lim_{n \rightarrow \infty } \mathbb {P}\left(\frac{S_{n}}{\sqrt{n}} > 1\right) = \frac{1}{3};

(b)

lim⁡n→∞P(∣Snn∣>1)=15\lim_{n \rightarrow \infty } \mathbb {P}\left(\left|\frac{S_{n}}{\sqrt{n}}\right| > 1\right) = \frac{1}{5}.

Problem 25.9

The random variable ηn\eta_{n} has a Poisson distribution with parameter nn. Does the limit as n→∞n \rightarrow \infty of the ratio (ηn−n)/n(\eta_{n} - n)/\sqrt{n} exist?

?
Problem 25.10

Prove that as n→∞n \rightarrow \infty

e−n∑k=0nnkk!→12. e^{-n} \sum _{k=0}^{n} \frac{n^{k}}{k!} \rightarrow \frac{1}{2}.
?
Problem 25.11

The random variable ηn\eta_{n} has a binomial distribution with parameters nn and 1/2. Does the limit as n→∞n \rightarrow \infty of the ratio (2ηn−n)/n(2\eta_{n} - n)/\sqrt{n} exist?

?
Problem 25.12

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values nn and −n-n with equal probabilities. Does the distribution of the ratio converge to a normal law:

?
(a)

Sn/nS_{n}/\sqrt{n};

(b)

Sn/Var⁡[Sn]S_{n}/\sqrt{\operatorname {Var}\left[S_{n}\right]}?

Problem 25.13

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values nn, −n-n, and 0 with probabilities:

?
(a)

1/2n21/2n^{2}, 1/2n21/2n^{2}, and 1−1/n21 - 1/n^{2};

(b)

1/2n1/2\sqrt{n}, 1/2n1/2\sqrt{n}, and 1−1/n1 - 1/\sqrt{n};

(c)

1/41/4, 1/41/4, and 1/21/2;

(d)

2−n2^{-n}, 2−n2^{-n}, and 1−2−n+11 - 2^{-n+1}.

Does the CLT hold for the sequence {ξn}\{ \xi_{n}\}?

Problem 25.14

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values n\sqrt{n}, −n-\sqrt{n}, and 0 with probabilities 1/2n1/2n, 1/2n1/2n, and 1−1/n1 - 1/n respectively. Does the CLT hold for the sequence {ξn}\{ \xi_{n}\}?

?
Problem 25.15

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values 2n2^{n} and −2n-2^{n} with probability 1/21/2 each. Does the CLT hold for the sequence {ξn}\{ \xi_{n}\}?

?
Problem 25.16

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values 2n2^{n}, −2n-2^{n}, and 0 with probabilities 2−(2n+1)2^{-(2n+1)}, 2−(2n+1)2^{-(2n+1)}, and 1−2−2n1 - 2^{-2n} respectively. Does the CLT hold for the sequence {ξn}\{ \xi_{n}\}?

?
Problem 25.17

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} be uniformly distributed on the segment [an−1,an+1][a_{n} - 1, a_{n} + 1], where ∑n∣an∣<∞\sum_{n} \left|a_{n}\right| < \infty. Find

lim⁡n→∞P(0<Snn<1). \lim _{n \rightarrow \infty } \mathbb {P}\left(0 < \frac{S_{n}}{\sqrt{n}} < 1\right).
?
Problem 25.18

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values 1 and −1-1 with probability (1−2−n)/2(1 - 2^{-n})/2 each, and the values 2n2^{n} and −2n-2^{n} with probability 2−n−12^{-n-1} each. Prove that the CLT holds for the sequence {ξn}\{ \xi_{n}\}.

?
Problem 25.19

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots have a Poisson distribution with parameter λ\lambda. Does the weak limit as n→∞n \rightarrow \infty of the expression

1n∑i=1n(ξ2i−1−ξ2i)? \frac{1}{\sqrt{n}} \sum _{i=1}^{n} (\xi _{2i-1} - \xi _{2i})?

exist?

?
Problem 25.20

Let ξ\xi and η\eta be independent identically distributed random variables with finite variance. Prove that if the variables ξ+η\xi + \eta and ξ−η\xi - \eta are independent, then ξ\xi and η\eta have a normal distribution, possibly degenerate.

?
Problem 25.21

Let ξ\xi and η\eta be independent identically distributed random variables with zero mean and finite variance. Using the CLT, prove that if ξ\xi and (ξ+η)/2(\xi + \eta )/\sqrt{2} have the same nondegenerate distribution, then that distribution is normal.

?
Problem 25.22

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. Let ξn\xi_{n} take the values ana_{n}, −an-a_{n}, and 0 with probabilities pnp_{n}, pnp_{n}, and 1−2pn1 - 2p_{n} respectively. Find conditions on the constants ana_{n} and pnp_{n} that ensure the CLT holds for the sequence {ξn}\{ \xi_{n}\}.

?
Problem 25.23

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent random variables. When nn is a perfect square, ξn\xi_{n} takes the values −n-\sqrt{n} and n\sqrt{n} with probability 1/21/2 each; for all other nn, ξn\xi_{n} takes the values −1-1 and 1 with probability 1/21/2 each. Does the CLT hold for the sequence {ξn}\{ \xi_{n}\}?

?
Problem 25.24

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be independent identically distributed random variables with E[ξ1]=0\mathbb {E}\left[\xi_{1}\right] = 0 and Var⁡[ξ1]=1\operatorname {Var}\left[\xi_{1}\right] = 1. Find the limiting distribution of the random variables

ηn=nξ1+…+ξnξ12+…+ξn2andζn=ξ1+…+ξnξ12+…+ξn2. \eta _{n} = \sqrt{n} \frac{\xi _{1} + \ldots + \xi _{n}}{\xi _{1}^{2} + \ldots + \xi _{n}^{2}} \quad \text{and} \quad \zeta _{n} = \frac{\xi _{1} + \ldots + \xi _{n}}{\sqrt{\xi _{1}^{2} + \ldots + \xi _{n}^{2}}}.
?
Problem 25.25

Let ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots be a sequence of independent identically distributed random variables with E[ξ1]=0\mathbb {E}\left[\xi_{1}\right] = 0 and Var⁡[ξ1]=σ2>0\operatorname {Var}\left[\xi_{1}\right] = \sigma^{2} > 0. Do the quantities

ξ1+…+ξnn? \frac{\xi _{1} + \ldots + \xi _{n}}{\sqrt{n}}?

converge in probability as n→∞n \rightarrow \infty?

?