Chapter 10

General Exercises

[29/100%]
Show
LaTeX
Problem 301

Using the Cauchy--Schwarz inequality show that

g(t)=log⁡E[∣X∣t] g(t) = \log \mathbb {E}\left[\left|X\right|^{t}\right]

is a convex function. Then show that [E[∣X∣t]]1/t[\mathbb {E}\left[\left|X\right|^{t}\right]]^{1/t} is an increasing function of tt.

?
Problem 302

Every real characteristic function φ0(t)\varphi_{0}(t) satisfies the inequality

1−φ0(2t)≤4(1−φ0(t)). 1 - \varphi _{0}(2t) \leq 4(1 - \varphi _{0}(t)).
?
Problem 303

Every real characteristic function φ0(t)\varphi_{0}(t) satisfies

1+φ0(2t)≥2{φ0(t)}2. 1 + \varphi _{0}(2t) \geq 2\left\{ \varphi _{0}(t)\right\} ^{2}.
?
Problem 304

If X1,X2,X3,X4X_{1}, X_{2}, X_{3}, X_{4} are jointly normal with Cov⁡[Xi,Xj]=E[XiXj]=σij\operatorname {Cov}\left[ X_{i}, X_{j} \right] = \mathbb {E}\left[X_{i} X_{j}\right] = \sigma_{ij}, show by the use of moment generating functions, that

E[X1X2X3X4]=σ12σ34+σ14σ23+σ13σ24. \mathbb {E}\left[X_{1} X_{2} X_{3} X_{4}\right] = \sigma _{12}\sigma _{34} + \sigma _{14}\sigma _{23} + \sigma _{13}\sigma _{24}.
?
Problem 305

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be a random sample from the uniform distribution in (0,1)(0, 1) and let Yn=nmin⁡(X1,X2,…,Xn)Y_{n} = n \min (X_{1}, X_{2}, \ldots , X_{n}). Using characteristic functions, show that the asymptotic distribution (n→∞n \to \infty) of YnY_{n} is the exponential e−ye^{-y}, y>0y > 0.

?
Problem 306

Let (X1,Y1),…,(Xn,Yn)(X_{1}, Y_{1}), \ldots , (X_{n}, Y_{n}) be a random sample from the bivariate normal with means 0, variances 1, and correlation ρ\rho. Let the random variable

Zj={1if (Xj−X‾)(Yj−Y‾)>0,0if (Xj−X‾)(Yj−Y‾)<0. Z_{j} = \begin{cases} 1 & \text{if } (X_{j} - \overline{X})(Y_{j} - \overline{Y}) > 0, \\ 0 & \text{if } (X_{j} - \overline{X})(Y_{j} - \overline{Y}) < 0. \end{cases}

Find E[Z‾]\mathbb {E}\left[\overline{Z}\right].

?
Problem 307

nn tickets are numbered 1 through nn. Of these, rr tickets drawn at random are the lucky ones. A lucky ticket receives an amount equal to the number it bears. What is the expected amount given on every draw? What is the variance of this amount?

?
Problem 308

In the generalized binomial with P(Xi=1)=pi\mathbb {P}\left(X_{i} = 1\right) = p_{i} (i=1,2,…,ni = 1, 2, \ldots , n), show that as n→∞n \to \infty the distribution of the number of successes X=∑i=1nXiX = \sum_{i=1}^{n} X_{i} tends to the Poisson with parameter λ\lambda where λ=lim⁡n→∞∑i=1npi\lambda = \lim_{n \to \infty } \sum_{i=1}^{n} p_{i} assuming max⁡iλi→0\max_{i} \lambda_{i} \to 0.

?
Problem 309

Let XX be the number of failures preceding the nnth success in a sequence of independent Bernoulli trials with probability of success pp. Show that if as n→∞n \to \infty, q=1−p→0q = 1-p \to 0, so that nq→λnq \to \lambda, then

P(X=k)→e−λλkk!. \mathbb {P}\left(X = k\right) \to e^{-\lambda }\frac{\lambda ^{k}}{k!}.
?
Problem 310

If the continuous random variable XX is such that for some integer k>0k > 0, kXkX has the Gamma distribution and the conditional distribution of YY given XX is Poisson, then YY has a negative binomial distribution.

?
Problem 311

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be a random sample from the Laplace distribution

f(x)=12σe−(∣x−μ∣)/σ,−∞<x<∞. f(x) = \frac{1}{2\sigma } e^{-(\left|x-\mu \right|)/\sigma }, \qquad -\infty < x < \infty .

By using characteristic functions show that the random variable

Y=1n∑j=1n∣Xj−μ∣ Y = \frac{1}{n} \sum _{j=1}^{n} \left|X_{j} - \mu \right|

is distributed as (σ/2n)χ2n2(\sigma /2n)\chi^{2}_{2n}. Hence deduce that E[Y]=σ\mathbb {E}\left[Y\right] = \sigma.

?
Problem 312

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be a random sample from a distribution with E[Xi]=0\mathbb {E}\left[X_{i}\right] = 0 and Var⁡[Xi]=1\operatorname {Var}\left[X_{i}\right] = 1. Show that

Yn=nSn∑i=1nXi2→n→∞N(0,1), Y_{n} = \frac{\sqrt{n} S_{n}}{\sum _{i=1}^{n} X_{i}^{2}} \xrightarrow {n \to \infty } N(0, 1), Zn=Sn∑i=1nXi2→n→∞N(0,1), Z_{n} = \frac{S_{n}}{\sqrt{\sum _{i=1}^{n} X_{i}^{2}}} \xrightarrow {n \to \infty } N(0, 1),

where Sn=X1+X2+⋯+XnS_{n} = X_{1} + X_{2} + \cdots + X_{n}.

?
Problem 313

Let X(1),…,X(n)X_{(1)}, \ldots , X_{(n)} be the ordered sample from a uniform distribution in (0,1)(0, 1) and Yr=X(1)+X(2)+⋯+X(r)Y_{r} = X_{(1)} + X_{(2)} + \cdots + X_{(r)}. Show that the conditional distribution of W=Yr/Y(r+1)W = Y_{r}/Y_{(r+1)} is the distribution of the sum of rr observations of a random sample from the same uniform distribution.

?
Problem 314

NN points X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} are selected at random in (0,1)(0, 1). Show that the distribution of the sum Sn=X1+X2+⋯+XnS_{n} = X_{1} + X_{2} + \cdots + X_{n} has density

fn(x)=1(n−1)!{xn−1−(n1)(x−1)n−1+⋯ } f_{n}(x) = \frac{1}{(n-1)!}\left\{ x^{n-1} - \binom {n}{1}(x-1)^{n-1} + \cdots \right\} =n(n−1)!{(n−x)n−1n−(n−11)(n−1−x)n−1n−1+⋯ }, = \frac{n}{(n-1)!}\left\{ \frac{(n-x)^{n-1}}{n} - \binom {n-1}{1}\frac{(n-1-x)^{n-1}}{n-1} + \cdots \right\} ,

where the sum extends as long as x−1,x−2,…x-1, x-2, \ldots and (n−1−x),(n−2−x),…(n-1-x), (n-2-x), \ldots are positive.

?
Problem 315

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be independent discrete variables with the same uniform distribution on the set of integers 0,1,…,m−10, 1, \ldots , m-1, i.e.,

P(X1=j)=1mforj=0,…,m−1. \mathbb {P}\left(X_{1} = j\right) = \frac{1}{m} \qquad \text{for} \quad j = 0, \ldots , m-1.

Find the probability generating function of the sum Sn=X1+⋯+XnS_{n} = X_{1} + \cdots + X_{n} and hence the probability function of SnS_{n}.

?
Problem 316

(Continuation of Problem 315.) A die is thrown three times. What is the probability that the sum of the outcomes is 10?

?
Problem 317

A chain smoker has m+1m+1 match boxes; each time he lights a cigarette he chooses one of the boxes at random. Suppose that (to begin with) every box contains NN matches. Let X1,X2,…,XmX_{1}, X_{2}, \ldots , X_{m} be the numbers of matches left in the remaining mm boxes, when:

?
(a)

a box is found empty for the first time;

(b)

any box is emptied first.

Remark.
?

The case m=1m=1 is known as the Banach match box problem (Feller, ibid, p. 157).

Problem 318

(Continuation of Problem 317.) Suppose that box CkC_{k} (k=1,…,mk = 1, \ldots , m) is chosen with probability pkp_{k}. What is the probability that CkC_{k} empties first?

?
Problem 319

Show that X1,X2,X3X_{1}, X_{2}, X_{3} with a joint discrete distribution are independent if and only if

P(X3=x3∣X2=x2,X1=x1)=P(X3=x3) \mathbb {P}\left( X_{3} = x_{3} \mid X_{2} = x_{2}, X_{1} = x_{1} \right) = \mathbb {P}\left(X_{3} = x_{3}\right)

for all (x1,x2)(x_{1}, x_{2}) with P(X1=x1,X2=x2)>0\mathbb {P}\left(X_{1} = x_{1}, X_{2} = x_{2}\right) > 0 and

P(X2=x2∣X1=x1)=P(X2=x2)for all x1 with P(X1=x1)>0. \mathbb {P}\left( X_{2} = x_{2} \mid X_{1} = x_{1} \right) = \mathbb {P}\left(X_{2} = x_{2}\right) \qquad \text{for all } x_{1} \text{ with } \mathbb {P}\left(X_{1} = x_{1}\right) > 0.
?
Problem 320

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be independent and identically distributed positive random variables with E[Xi]=μ\mathbb {E}\left[X_{i}\right] = \mu, E[Xi−1]=r\mathbb {E}\left[X_{i}^{-1}\right] = r. Let Sn=X1+X2+⋯+XnS_{n} = X_{1} + X_{2} + \cdots + X_{n}. Show that E[Sn−1]\mathbb {E}\left[S_{n}^{-1}\right] exists and

E[XiSn]=1n,i=1,…,n. \mathbb {E}\left[\frac{X_{i}}{S_{n}}\right] = \frac{1}{n}, \qquad i = 1, \ldots , n.
?
Problem 321

(Continuation of Problem 320.) Show that

E[SmSn]=mnfor m≤n,E[SmSn]=1+(m−n)μE[Sn−1]for m>n. \mathbb {E}\left[\frac{S_{m}}{S_{n}}\right] = \frac{m}{n} \quad \text{for } m \leq n, \qquad \mathbb {E}\left[\frac{S_{m}}{S_{n}}\right] = 1 + (m-n)\mu \mathbb {E}\left[S_{n}^{-1}\right] \quad \text{for } m > n.
?
Problem 322

A caterpillar is moving on the edges of a tetrahedron ABCDABCD on whose top there is glue. In a unit of time the caterpillar goes from any vertex (except DD) to any other vertex with the same probability 1/31/3. Suppose that the caterpillar at time t=0t = 0 is on the vertex AA. What is the probability that

?
(a)

the caterpillar finally gets stuck;

(b)

the caterpillar finally gets stuck coming from vertex BB?

Problem 323

A flea moves at random on a plane with leaps of constant length aa and in a random direction at each step. If it starts from the origin, let (Xn,Yn)(X_{n}, Y_{n}) be the position of the flea after nn jumps. Where

Xn=∑i=1nacos⁡θi,Yn=∑i=1nasin⁡θi. X_{n} = \sum _{i=1}^{n} a \cos \theta _{i}, \qquad Y_{n} = \sum _{i=1}^{n} a \sin \theta _{i}.

The angles θi\theta_{i} are independently uniform in (0,2π)(0, 2\pi ).

?
(a)

Find,

  1. E[Xn],E[Yn],Var⁡[Xn],Var⁡[Yn]\mathbb {E}\left[X_{n}\right], \mathbb {E}\left[Y_{n}\right], \operatorname {Var}\left[X_{n}\right], \operatorname {Var}\left[Y_{n}\right],

  2. E[Rn2]\mathbb {E}\left[R_{n}^{2}\right] where Rn2=Xn2+Yn2R_{n}^{2} = X_{n}^{2} + Y_{n}^{2}.

(b)

Show that the Xn,YnX_{n}, Y_{n} are uncorrelated but not independent.

(c)

Find the distribution of (Xn,Yn)(X_{n}, Y_{n}) for large nn (n→∞n \to \infty) and the density of RnR_{n}. What is the expected distance of the flea from the origin for large nn?

Problem 324

Let the random variables X1,…,XnX_{1}, \ldots , X_{n} have the joint density

f(x1,…,xn)=1(2π)n/2exp⁡(−12∑i=1nxi2)[1+∏i=1n(xiexp⁡(−12xi2))]. f(x_{1}, \ldots , x_{n}) = \frac{1}{(2\pi )^{n/2}} \exp \left(-\frac{1}{2}\sum _{i=1}^{n} x_{i}^{2}\right) \left[1 + \prod _{i=1}^{n}(x_{i}\exp (-\tfrac {1}{2}x_{i}^{2}))\right].

Show that any n−1n-1 of the X1,…,XnX_{1}, \ldots , X_{n} are independent normal with mean 0 and variance 1. Are the X1,…,XnX_{1}, \ldots , X_{n} jointly normal?

?
Problem 325

In Exercise 288 suppose the plane is divided into squares by equidistant lines parallel to the axes. Let 2a2a be the side of each square and 2μ2\mu the length of the needle. Find the average number of lines crossed by the needle,

?
(a)

μ>α\mu > \alpha,

(b)

when μ\mu is arbitrary.

Problem 326

Let X,YX, Y be independent χ2\chi^{2} variables each with nn degrees of freedom. Show that

Z=n2X−YXY Z = \frac{\sqrt{n}}{2} \frac{X-Y}{\sqrt{XY}}

has the Student distribution with nn degrees of freedom. Hence deduce that:

?
(a)
tn=n2(Fn,n−1Fn,n), t_{n} = \frac{\sqrt{n}}{2}\left(\sqrt{F_{n,n}} - \frac{1}{\sqrt{F_{n,n}}}\right),

where Fm,nF_{m,n} denotes an FF variable with mm and nn degrees of freedom.

(b)

If tn(a)t_{n}(a) and Fn,n(a)F_{n,n}(a) are the upper percentile points of tnt_{n} and Fn,nF_{n,n}, respectively, express one in terms of the other.

Problem 327

If for a given value λ\lambda of Λ\Lambda the random variable X(Λ)X(\Lambda ) is Poisson with parameter λ\lambda and Λ\Lambda is a random variable with a gamma density

Γ(λ)=aρΓ(ρ)λρ−1e−aλ, \Gamma (\lambda ) = \frac{a^{\rho }}{\Gamma (\rho )} \lambda ^{\rho -1}e^{-a\lambda },

show that X(Λ)X(\Lambda ) has the negative binomial distribution

pk=P(X(Λ)=k)=(−ρk)(−p)kqρ,k=0,1,…, p_{k} = \mathbb {P}\left(X(\Lambda ) = k\right) = \binom {-\rho }{k}(-p)^{k}q^{\rho }, \qquad k = 0, 1, \ldots ,

where p=(1+a)−1p = (1+a)^{-1}, q=a(a+1)−1q = a(a+1)^{-1}.

?
Problem 328

Show that for any two random variable(s) XX and YY with Var⁡[X]<∞\operatorname {Var}\left[X\right] < \infty,

Var⁡[X]=E[Var⁡[X∣Y]]+Var⁡[E[X∣Y]]. \operatorname {Var}\left[X\right] = \mathbb {E}\left[\operatorname {Var}\left[ X \mid Y \right]\right] + \operatorname {Var}\left[\mathbb {E}\left[ X \mid Y \right]\right].
?
Problem 329

Using the distribution of X(t)X_{(t)} where X(1),…,X(n)X_{(1)}, \ldots , X_{(n)} is the ordered sample from the uniform in (0,1)(0, 1), show the following relation between the incomplete BB function Ix(n1,n2)I_{x}(n_{1}, n_{2}) and the binomial distribution function:

∑k=rn(nk)pkqn−k=Ip(r,n−r+1) \sum _{k=r}^{n} \binom {n}{k} p^{k}q^{n-k} = I_{p}(r, n-r+1) =1B(r,n−r+1)∫0pxr−1(1−x)n−r dx. = \frac{1}{B(r, n-r+1)} \int _{0}^{p} x^{r-1}(1-x)^{n-r} \, dx.
?