Part V

The Law of Large Numbers

[40/63%]
Show
LaTeX
Problem 22.1

Let νn\nu_n be the number of successes in nn Bernoulli trials with success probability pp. Prove that for every function f(x)f(x) continuous on [0,1][0,1] the following convergence holds:

sup⁡p∈[0,1]∣E[f(νnn)]−f(p)∣→0 as n→∞. \sup _{p \in [0,1]} \left|\mathbb {E}\left[f\left(\frac{\nu _n}{n}\right)\right] - f(p)\right| \to 0 \text{ as } n \to \infty .
?
Remark.
?

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be a sequence of independent identically distributed random variables with E[∣ξ1∣]<∞\mathbb {E}\left[\left|\xi_1\right|\right] < \infty. Then the LLN holds: Sn/n→pE[ξ1]S_n/n \xrightarrow {p} \mathbb {E}\left[\xi_1\right] as n→∞n \to \infty.

Problem 22.2

Let f:[0,1]→Rf: [0,1] \to \mathbb {R} be a continuous function. Prove that the Bernstein polynomials

Bn(x)=∑i=0nf(in)Cnixi(1−x)n−i B_n(x) = \sum _{i=0}^{n} f\left(\frac{i}{n}\right) C_n^i x^i (1-x)^{n-i}

converge to f(x)f(x) as n→∞n \to \infty uniformly in x∈[0,1]x \in [0,1]:

sup⁡x∈[0,1]∣Bn(x)−x∣→0 as n→∞. \sup _{x \in [0,1]} \left|B_n(x) - x\right| \to 0 \text{ as } n \to \infty .
?
Problem 22.3

Let f:R+→Rf: \mathbb {R}^{+} \to \mathbb {R} be a continuous bounded function, and let KK be a compact set in [0,∞)[0,\infty ). Prove that the polynomials

Bn(x)=∑i=0∞f(in)(nx)ii!e−nx B_n(x) = \sum _{i=0}^{\infty } f\left(\frac{i}{n}\right) \frac{(nx)^i}{i!} e^{-nx}

converge to f(x)f(x) as n→∞n \to \infty uniformly in x∈Kx \in K.

?
Problem 22.4

Let f:R+→Rf: \mathbb {R}^{+} \to \mathbb {R} be a continuous bounded function, and let KK be a compact set in [0,∞)[0,\infty ). Prove that the polynomials

Bn(x)=∑i=0∞f(in+1)Cn+iixi(1+x)n+i+1 B_n(x) = \sum _{i=0}^{\infty } f\left(\frac{i}{n+1}\right) \frac{C_{n+i}^i x^i}{(1+x)^{n+i+1}}

converge to f(x)f(x) as n→∞n \to \infty uniformly in x∈Kx \in K.

?
Problem 22.5

Under the hypotheses of problem

?
(a)

22.2;

(b)

22.3;

(c)

22.4

prove that if the function ff has a continuous derivative f′f', then the derivatives of the polynomials Bn(x)B_n(x) converge uniformly to f′(x)f'(x) as n→∞n \to \infty.

Problem 22.6

Let f(x,y)f(x,y) be a function continuous on the triangle x⩾0x \geqslant 0, y⩾0y \geqslant 0, x+y⩽1x+y \leqslant 1. Prove that the Bernstein polynomials in R2\mathbb {R}^{2}

Bn(x,y)=∑i,j=0nf(in,jn)n!i! j! (n−i−j)!xiyj(1−x−y)n−i−j B_n(x,y) = \sum _{i,j=0}^{n} f\left(\frac{i}{n}, \frac{j}{n}\right) \frac{n!}{i! \, j! \, (n-i-j)!} x^i y^j (1-x-y)^{n-i-j}

converge to f(x,y)f(x,y) as n→∞n \to \infty uniformly in x,yx, y.

?
Problem 22.7

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be a sequence of independent random variables with the standard Cauchy distribution. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 22.8

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be a sequence of independent identically distributed random variables having the standard normal distribution. Set

χn2=∑i=1nξi2andτn=ξn+1χn2/n. \chi _n^2 = \sum _{i=1}^{n} \xi _i^2 \quad \text{and} \quad \tau _n = \frac{\xi _{n+1}}{\sqrt{\chi _n^2/n}}.

Find the limiting distribution of τn\tau_n as n→∞n \to \infty.

?
Problem 22.9

Let ξ1,ξ2,…\xi_1, \xi_2, \ldots be a sequence of independent identically distributed random variables with E[ξ1]=a\mathbb {E}\left[\xi_1\right] = a, Var⁡[ξ1]=σ2\operatorname {Var}\left[\xi_1\right] = \sigma^2. Prove that the sequence of random variables ηn\eta_n, defined by

ηn=ξ1+…+ξnξ12+…+ξn2, \eta _n = \frac{\xi _1 + \ldots + \xi _n}{\xi _1^2 + \ldots + \xi _n^2},

converges in probability. Find the limit.

?
Problem 22.10

Let the random variable ηn\eta_n have:

?
(a)

the Poisson distribution with parameter nn;

(b)

the binomial distribution with parameters nn and pp;

(c)

the normal distribution with parameters 00 and nn.

Determine whether the ratio ηn/n\eta_n/n has a limit in probability as n→∞n \to \infty.

Problem 23.1

Let Var⁡[ξn]<∞\operatorname {Var}\left[\xi_n\right] < \infty for all nn and Var⁡[Sn]=o(n2)\operatorname {Var}\left[S_n\right] = o(n^2) as n→∞n \to \infty. Prove that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Remark.
?

Throughout this section it is assumed that the random variables ξ1,ξ2,…\xi_1, \xi_2, \ldots are independent in the aggregate.

Problem 23.2

Let ξn\xi_n take the values n\sqrt{n}, −n-\sqrt{n}, and 00 with probabilities 1/2n1/2n, 1/2n1/2n, and 1−1/n1-1/n respectively. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.3

Let ξn\xi_n take the values 2n2^n and −2n-2^n with probability 1/21/2 each. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.4

Let ξn\xi_n take the values nn, −n-n, and 00 with probabilities:

?
(a)

1/2n21/2n^2, 1/2n21/2n^2, and 1−1/n21 - 1/n^2;

(b)

1/41/4, 1/41/4, and 1/21/2;

(c)

1/2n1/2\sqrt{n}, 1/2n1/2\sqrt{n}, and 1−1/n1 - 1/\sqrt{n};

(d)

2−n2^{-n}, 2−n2^{-n}, and 1−2−n+11 - 2^{-n+1}.

Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

Problem 23.5

Let ξn\xi_n take the values 2n2^n, −2n-2^n, and 00 with probabilities 2−(2n+1)2^{-(2n+1)}, 2−(2n+1)2^{-(2n+1)}, and 1−2−2n1-2^{-2n} respectively. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.6

Let ξn\xi_n take the values 3n3^n, −3n-3^n, and 00 with probabilities 3−(2n+2)3^{-(2n+2)}, 3−(2n+2)3^{-(2n+2)}, and 1−2⋅3−(2n+2)1 - 2 \cdot 3^{-(2n+2)} respectively. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.7

Let ξn\xi_n take the values 11 and −1-1 with probabilities (1−2−n)/2(1-2^{-n})/2 each, and the values 2n2^n and −2n-2^n with probabilities 2−n−12^{-n-1} each. Prove that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.8

Let ξn\xi_n take the values nλn^{\lambda } and −nλ-n^{\lambda } with probability 1/21/2 each. Determine for which values of λ\lambda the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.9

Let ξn\xi_n take 2n+12n+1 values 0,±Ln,±2Ln,±3Ln,…,±nLn0, \pm L_n, \pm 2L_n, \pm 3L_n, \ldots , \pm nL_n with probability 1/(2n+1)1/(2n+1) each. Find conditions on the constants LnL_n ensuring that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.10

Let ξn\xi_n take the values ana_n, −an-a_n, and 00 with probabilities pnp_n, pnp_n, and 1−2pn1-2p_n respectively. Find conditions on the constants ana_n and pnp_n ensuring that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.11

If nn is a perfect square, the random variable ξn\xi_n takes the values −n-\sqrt{n} and n\sqrt{n} with probability 1/21/2 each; otherwise ξn\xi_n takes the values −1-1 and 11 with probability 1/21/2 each. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.12

Let ξn\xi_n have the Poisson distribution with parameter αn\alpha_n, where

1n∑i=1nαi→α<∞,n→∞. \frac{1}{n} \sum _{i=1}^{n} \alpha _i \to \alpha < \infty , \quad n \to \infty .

Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.13

Let {ξn}\{ \xi_n\} be a sequence of independent identically distributed random variables, and let {an}\{ a_n\} be a bounded sequence of nonnegative numbers. Is it true that if the LLN holds for the sequence {ξn}\{ \xi_n\}, then it also holds for the sequence {ηn}\{ \eta_n\}, where ηn=anξn\eta_n = a_n \xi_n?

?
Problem 23.14

Let ξn\xi_n be uniformly distributed on [−n,n][-n, n]. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 23.15

Let ξn\xi_n have the uniform distribution on [−nα,nα][-n^{\alpha }, n^{\alpha }], α∈R\alpha \in \mathbb {R}. Determine for which values of α\alpha the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.16

Let ξn\xi_n have the binomial distribution with parameters nn and 1/nα1/n^{\alpha }, where α>0\alpha > 0. Determine for which values of α\alpha the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 23.17

Let {ξn}\{ \xi_n\} and {ηn}\{ \eta_n\} be two sequences, in each of which the random variables are independent. Suppose the series ∑n=1∞P(ξn≠ηn)\sum_{n=1}^{\infty } \mathbb {P}\left(\xi_n \neq \eta_n\right) converges. Prove that if E[ξn]=E[ηn]\mathbb {E}\left[\xi_n\right] = \mathbb {E}\left[\eta_n\right] for every nn and the LLN holds for the sequence {ξn}\{ \xi_n\}, then it also holds for the sequence {ηn}\{ \eta_n\}.

?
Problem 24.1

Let ξ\xi be a random variable. Define the random sequence ξn\xi_n by ξn=ξ\xi_n = \xi. Does the sequence {ξn}\{ \xi_n\} satisfy the LLN?

?
Problem 24.2

Bernoulli trials are performed with success probability pp. Set ξn=1\xi_n = 1 if the nn-th and (n+1)(n+1)-th trials both end in success, and ξn=0\xi_n = 0 otherwise. Does the LLN hold for the sequence {ξn}\{ \xi_n\}?

?
Problem 24.3

Let {ξn}\{ \xi_n\} be a sequence of random variables such that Var⁡[ξn]⩽c<∞\operatorname {Var}\left[\xi_n\right] \leqslant c < \infty, and ξn\xi_n is independent of ξm\xi_m whenever ∣n−m∣>1|n-m| > 1. Prove that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.4

Let {ξn}\{ \xi_n\} be a sequence of random variables such that Var⁡[ξn]⩽c<∞\operatorname {Var}\left[\xi_n\right] \leqslant c < \infty, and the covariances are negative. Prove that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.5

Let {ξn}\{ \xi_n\} be a sequence of random variables such that Var⁡[ξn]⩽c<∞\operatorname {Var}\left[\xi_n\right] \leqslant c < \infty, and the covariances rij=Cov⁡[ξi,ξj]r_{ij} = \operatorname {Cov}\left[\xi_i, \xi_j\right] satisfy rij→0r_{ij} \to 0 uniformly as ∣i−j∣→∞|i-j| \to \infty. Prove that the LLN holds for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.6

Prove that if ∣Sn∣<cn|S_n| < cn and Var⁡[Sn]>αn2\operatorname {Var}\left[S_n\right] > \alpha n^2, then the LLN does not hold for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.7

Let {ξn}\{ \xi_n\} be a sequence of independent identically distributed random variables with finite nonzero variance. Prove that the LLN does not hold for the sequence {Sn}\{ S_n\}.

?
Problem 24.8

Let {ξn}\{ \xi_n\} be a sequence of independent identically distributed random variables with finite variance. Prove that the LLN holds for the sequence {anSn}\{ a_n S_n\} if ann→0a_n \sqrt{n} \to 0 as n→∞n \to \infty.

?
Problem 24.9

Die AA has four red faces and two white faces, while die BB has two red faces and four white faces. A coin is tossed once. If it comes up heads, die AA is rolled repeatedly thereafter; if tails, only die BB is rolled. Set ξn=1\xi_n = 1 if the nn-th roll of the die shows a red face, and ξn=0\xi_n = 0 otherwise. Prove that the LLN does not hold for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.10

An urn contains bb black and rr red balls. A ball is drawn at random. It is returned to the urn, and, in addition, cc balls of the same color as the one drawn are added. A new random draw is then made from the urn (now containing b+r+cb+r+c balls), and the described procedure is repeated. Let the random variable ξn\xi_n equal 11 or 00 according to whether the nn-th ball drawn was black or red. Prove that the LLN does not hold for the sequence {ξn}\{ \xi_n\}.

?
Problem 24.11

Let {ξn}\{ \xi_n\} be a sequence of random variables for which the law of large numbers holds. Must the LLN hold for the sequence {∣ξn∣}\{ |\xi_n|\}?

?
Problem 24.12

Let {ξn}\{ \xi_n\} be a sequence of random variables with zero expectations. Does the convergence ξn→p0\xi_n \xrightarrow {p} 0 imply that the LLN holds for the sequence {ξn}\{ \xi_n\}?

?
Problem 24.13

Let the random variable ξ1\xi_1 be uniformly distributed on the set S={1,2,…,s}S = \{ 1, 2, \ldots , s\}, and let f:S→Sf: S \to S be a bijective function. Define the random sequence ξn\xi_n by ξn=f(ξn−1)\xi_n = f(\xi_{n-1}). Determine under what conditions on ff the sequence {ξn}\{ \xi_n\} satisfies the LLN.

?