Section 5.10

Two limit theorems

[15/100%]
Show
LaTeX
Problem 5.10.1

Prove that, for x≥0x \geq 0, as n→∞n \rightarrow \infty,

?
(a)
∑k:∣k−12n∣≤12xn(nk)∼2n∫−xx12πe−12u2du \sum _{\substack {k: \\ \left|k-\frac{1}{2} n\right| \leq \frac{1}{2} x \sqrt{n}}}\binom {n}{k} \sim 2^{n} \int _{-x}^{x} \frac{1}{\sqrt{2 \pi }} e^{-\frac{1}{2} u^{2}} d u
(b)
∑k:∣k−n∣≤xnnkk!∼en∫−xx12πe−12u2du \sum _{\substack {k: \\ \left|k-n\right| \leq x \sqrt{n}}} \frac{n^{k}}{k!} \sim e^{n} \int _{-x}^{x} \frac{1}{\sqrt{2 \pi }} e^{-\frac{1}{2} u^{2}} d u
Problem 5.10.2

It is well known that infants born to mothers who smoke tend to be small and prone to a range of ailments. It is conjectured that also they look abnormal. Nurses were shown selections of photographs of babies, one half of whom had smokers as mothers; the nurses were asked to judge from a baby's appearance whether or not the mother smoked. In 1500 trials the correct answer was given 910 times. Is the conjecture plausible? If so, why?

?
Problem 5.10.3

Let XX have the Γ(1,s)\Gamma (1, s) distribution; given that X=xX = x, let YY have the Poisson distribution with parameter xx. Find the characteristic function of YY, and show that

Y−E[Y]Var⁡[Y]→DN(0,1) as s→∞ \frac{Y-\mathbb {E}\left[Y\right]}{\sqrt{\operatorname {Var}\left[Y\right]}} \xrightarrow {\mathrm{D}} N(0,1) \quad \text{ as } s \rightarrow \infty

Explain the connection with the central limit theorem.

?
Problem 5.10.4

Let X1,X2,…X_{1}, X_{2}, \ldots be independent random variables taking values in the positive integers, whose common distribution is non-arithmetic, in that gcd⁡{n:P(X1=n)>0}=1\operatorname {gcd}\left\{ n: \mathbb {P}\left(X_{1} = n\right) > 0\right\} = 1. Prove that, for all integers xx, there exist non-negative integers r=r(x),s=s(x)r = r(x), s = s(x), such that

P(X1+⋯+Xr−Xr+1−⋯−Xr+s=x)>0 \mathbb {P}\left(X_{1}+\cdots +X_{r}-X_{r+1}-\cdots -X_{r+s} = x\right) > 0
?
Problem 5.10.5

Prove the local central limit theorem for sums of random variables taking integer values. You may assume for simplicity that the summands have span 11, in that gcd⁡{∣x∣:P(X=x)>0}=1\operatorname {gcd}\left\{ \left|x\right|: \mathbb {P}\left(X = x\right) > 0\right\} = 1.

?
Problem 5.10.6

Let X1,X2,…X_{1}, X_{2}, \ldots be independent random variables having common density function f(x)=1/{2∣x∣(log⁡∣x∣)2}f(x) = 1 /\left\{ 2\left|x\right|(\log \left|x\right|)^{2}\right\} for ∣x∣<e−1\left|x\right| < e^{-1}. Show that the XiX_{i} have zero mean and finite variance, and that the density function fnf_{n} of X1+X2+⋯+XnX_{1}+X_{2}+\cdots +X_{n} satisfies fn(x)→∞f_{n}(x) \rightarrow \infty as x→0x \rightarrow 0. Deduce that the XiX_{i} do not satisfy the local limit theorem.

?
Problem 5.10.7

Let XX have the density function f(x)=2πx−3exp⁡(−{2x}−1),x>0f(x) = \sqrt{2 \pi x^{-3}} \exp \left(-\left\{ 2 x\right\}^{-1}\right), x > 0. Show that ϕ(is)=E[e−sX]=e−2s,s>0\phi (is) = \mathbb {E}\left[e^{-s X}\right] = e^{-\sqrt{2 s}}, s > 0, and deduce that XX has characteristic function

ϕ(t)={exp⁡{−(1−i)t} if t≥0exp⁡{−(1+i)∣t∣} if t≤0 \phi (t) = \begin{cases} \exp \left\{ -(1-i) \sqrt{t}\right\} & \text{ if } t \geq 0 \\ \exp \left\{ -(1+i) \sqrt{\left|t\right|}\right\} & \text{ if } t \leq 0\end{cases}
?
Remark.
?

This distribution is called the Lévy distribution.

Problem 5.10.8

Let {Xr:r≥1}\left\{ X_{r}: r \geq 1\right\} be independent with the distribution of the preceding Exercise (5.10.7). Let Un=n−1∑r=1nXrU_{n} = n^{-1} \sum_{r = 1}^{n} X_{r}, and Tn=n−1UnT_{n} = n^{-1} U_{n}. Show that:

?
(a)

P(Un<c)→0\mathbb {P}\left(U_{n} < c\right) \rightarrow 0 for any c<∞c < \infty,

(b)

TnT_{n} has the same distribution as X1X_{1}.

Problem 5.10.9

A sequence of biased coins is flipped; the chance that the rr th coin shows a head is Θr\Theta_{r}, where Θr\Theta_{r} is a random variable taking values in (0,1)(0,1). Let XnX_{n} be the number of heads after nn flips. Does XnX_{n} obey the central limit theorem when:

?
(a)

the Θr\Theta_{r} are independent and identically distributed?

(b)

Θr=Θ\Theta_{r} = \Theta for all rr, where Θ\Theta is a random variable taking values in (0,1)(0,1)?

Problem 5.10.10

In an election with two candidates, each of the vv voters is equally likely to vote for either candidate, and they vote independently of one another. Show that, when vv is large, the probability that the winner was ahead when λv\lambda v votes had been counted (where λ∈(0,1)\lambda \in (0,1)) is approximately 12+(1/π)sin⁡−1λ\frac{1}{2}+(1 / \pi ) \sin^{-1} \sqrt{\lambda }.

?
Problem 5.10.11

By considering the central limit theorem for the sum of independent Poisson-distributed random variables, show that

ne−nnnn!→12π as n→∞ \frac{\sqrt{n} e^{-n} n^{n}}{n!} \rightarrow \frac{1}{\sqrt{2 \pi }} \quad \text{ as } n \rightarrow \infty
?
Problem 5.10.12

Let ff be a mass function on {1,2,…}\left\{ 1,2, \ldots \right\} with finite mean μ\mu. Consider a large population of households with independent sizes distributed as ff. An individual A is selected uniformly at random from the entire population. Show that the probability A belongs to a household of size xx is approximately xf(x)/μx f(x) / \mu. Find the probability generating function of this distribution in terms of that of ff.

?
Problem 5.10.13

Let X1,X2,…X_{1}, X_{2}, \ldots be independent, strictly positive continuous random variables with common density function fXf_{X} and finite mean, and let Zr=Xr/SnZ_{r} = X_{r} / S_{n} where Sk=∑r=1kXrS_{k} = \sum_{r = 1}^{k} X_{r}. The ZrZ_{r} give rise to a partition of (0,1](0,1] into the intervals Ir=(Sr−1,Sr]/SnI_{r} = \left(S_{r-1}, S_{r}\right] / S_{n} for r=1,2,…,nr = 1,2, \ldots , n. Let UU be uniform on (0,1](0,1] and independent of the XrX_{r}, and let LL be the length of the interval into which UU falls. Show that LL has density function fL(z)=(z/E[Z])fZ(z)f_{L}(z) = (z / \mathbb {E}\left[Z\right]) f_{Z}(z), where Z=Z1Z = Z_{1}. Find the characteristic function of LL in terms of that of ZZ.

?
Problem 5.10.14

Let Sn=∑r=1nXrS_{n} = \sum_{r = 1}^{n} X_{r} be a continuous, symmetric random walk on R\mathbb {R} started at 00, whose jumps are independent N(0,1)N(0,1) random variables XiX_{i}. Define the area process An=∑m=1nSmA_{n} = \sum_{m = 1}^{n} S_{m}. Let Im={−1<Am<1}I_{m} = \left\{ -1 < A_{m} < 1\right\}, and show that, with probability 11, only finitely many of the ImI_{m} occur.

?
Problem 5.10.15

At Bell Labs in the early 1950s, David Hagelbarger and Claude Shannon built machines to predict whether a human coin-flipper would call heads or tails. Hagelbarger's machine (a "sequence extrapolating robot", or "SEER") was correct on 5218 trials of 9795, and Shannon's machine (a "mind-reading (?) machine") was correct on 5010 trials of 8517. In each case, what is the probability of doing at least as well by chance?

?
Remark.
?

When playing against his own machine, Shannon could beat it in around 60%60 \% of trials, in the long run.