Chapter 4

Order Statistics

[29/90%]
Show
LaTeX
Problem 4.1

Suppose that XX, YY, and ZZ have a joint density function given by

f(x,y,z)={e−(x+y+z),forx,y,z>0,0,otherwise. f(x,y,z) = \begin{cases} e^{-(x+y+z)}, & \text{for} \quad x,y,z > 0, \\ 0, & \text{otherwise.} \end{cases}

Compute P(X<Y<Z)\mathbb {P}\left(X < Y < Z\right) and P(X=Y<Z)\mathbb {P}\left(X = Y < Z\right).

?
Problem 4.2

Two points are chosen uniformly and independently on the perimeter of a circle of radius 11. This divides the perimeter into two pieces. Determine the expected value of the length of the shorter piece.

?
Problem 4.3

Let X1X_1 and X2X_2 be independent, U(0,1)U(0,1)-distributed random variables, and let YY denote the point that is closest to an endpoint. Determine the distribution of YY.

?
Problem 4.4

The statistician Piggy has to wait an amount of time T0T_0 at the post office on an occasion when she is in a great hurry. In order to investigate whether or not chance makes her wait particularly long when she is in a hurry, she checks how many visits she makes to the post office until she has to wait longer than the first time. Formally, let T1,T2,…T_1, T_2, \ldots be the successive waiting times and NN be the number of times until some Tk>T0T_k > T_0, that is,

{N=k}={Tj≤T0, 1≤j<k, Tk>T0}. \left\{ N = k\right\} = \left\{ T_j \leq T_0, \ 1 \leq j < k, \ T_k > T_0\right\} .

What is the distribution of NN under the assumption that {Tn,n≥0}\left\{ T_n, n \geq 0\right\} are i.i.d. continuous random variables? What can be said about E[N]\mathbb {E}\left[N\right]?

?
Problem 4.5

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be independent, continuous random variables with common distribution function F(x)F(x), and consider the order statistic (X(1),X(2),…,X(n))(X_{(1)}, X_{(2)}, \ldots , X_{(n)}). Compute E[F(X(n))−F(X(1))]\mathbb {E}\left[F(X_{(n)}) - F(X_{(1)})\right].

?
Problem 4.6

Let X1X_1, X2X_2, X3X_3, and X4X_4 be independent, U(0,1)U(0,1)-distributed random variables. Compute

?
(a)

P(X(3)+X(4)≤1)\mathbb {P}\left(X_{(3)} + X_{(4)} \leq 1\right),

(b)

P(X3+X4≤1)\mathbb {P}\left(X_3 + X_4 \leq 1\right).

Problem 4.7

Let X1X_1, X2X_2, X3X_3 be independent U(0,1)U(0,1)-distributed random variables, and let X(1),X(2),X(3)X_{(1)}, X_{(2)}, X_{(3)} be the corresponding order variables. Compute P(X(1)+X(3)≤1)\mathbb {P}\left(X_{(1)} + X_{(3)} \leq 1\right).

?
Problem 4.8

Suppose that X1,X2,X3,X4X_1, X_2, X_3, X_4 are independent U(0,1)U(0,1)-distributed random variables and let (X(1),X(2),X(3),X(4))(X_{(1)}, X_{(2)}, X_{(3)}, X_{(4)}) be the corresponding order statistic. Compute

?
(a)

P(X(2)+X(3)≤1)\mathbb {P}\left(X_{(2)} + X_{(3)} \leq 1\right),

(b)

P(X(2)≤3X(1))\mathbb {P}\left(X_{(2)} \leq 3 X_{(1)}\right).

Problem 4.9

Suppose that X1,X2,X3,X4X_1, X_2, X_3, X_4 are independent U(0,1)U(0,1)-distributed random variables and let (X(1),X(2),X(3),X(4))(X_{(1)}, X_{(2)}, X_{(3)}, X_{(4)}) be the corresponding order statistic. Find the distribution of

?
(a)

X(3)−X(1)X_{(3)} - X_{(1)},

(b)

X(4)−X(2)X_{(4)} - X_{(2)}.

Problem 4.10

Suppose that X1,X2,X3X_1, X_2, X_3 are independent U(0,1)U(0,1)-distributed random variables and let (X(1),X(2),X(3))(X_{(1)}, X_{(2)}, X_{(3)}) be the corresponding order statistic. Compute P(X(1)+X(2)>X(3))\mathbb {P}\left(X_{(1)} + X_{(2)} > X_{(3)}\right).

?
Remark.
?

A concrete example runs as follows: Take 3 sticks of length 11, break each of them uniformly at random, and pick one of the pieces from each stick. Find the probability that the 3 chosen pieces can be constructed into a triangle.

Problem 4.11

Suppose that X1,X2,X3X_1, X_2, X_3 are independent U(0,1)U(0,1)-distributed random variables and let (X(1),X(2),X(3))(X_{(1)}, X_{(2)}, X_{(3)}) be the corresponding order statistic. It is of course a trivial observation that we always have X(3)≥X(1)X_{(3)} \geq X_{(1)}. However,

?
(a)

Compute P(X(3)>2X(1))\mathbb {P}\left(X_{(3)} > 2 X_{(1)}\right).

(b)

Determine aa so that P(X(3)>aX(1))=1/2\mathbb {P}\left(X_{(3)} > a X_{(1)}\right) = 1/2.

Problem 4.12

Let X1,X2,X3X_1, X_2, X_3 be independent U(0,1)U(0,1)-distributed random variables, and let X(1),X(2),X(3)X_{(1)}, X_{(2)}, X_{(3)} be the ordered sample. Let 0≤a<b≤10 \leq a < b \leq 1. Compute

E[X(2)∣X(1)=a,X(3)=b]. \mathbb {E}\left[X_{(2)} \mid X_{(1)} = a, X_{(3)} = b\right].
?
Problem 4.13

Let X1,X2,…,X8X_1, X_2, \ldots , X_8 be independent Exp(1)Exp(1)-distributed random variables with order statistic (X(1),X(2),…,X(8))(X_{(1)}, X_{(2)}, \ldots , X_{(8)}). Find

E[X(7)∣X(5)=10]. \mathbb {E}\left[X_{(7)} \mid X_{(5)} = 10\right].
?
Problem 4.14

Let X1,X2,X3X_1, X_2, X_3 be independent U(0,1)U(0,1)-distributed random variables, and let X(1),X(2),X(3)X_{(1)}, X_{(2)}, X_{(3)} be the order statistic. Prove the intuitively reasonable result that X(1)X_{(1)} and X(3)X_{(3)} are conditionally independent given X(2)X_{(2)} and determine this (conditional) distribution.

?
Remark.
?

The problem thus is to determine the distribution of (X(1),X(3))∣X(2)=x(X_{(1)}, X_{(3)}) \mid X_{(2)} = x.

Problem 4.15

The random variables X1X_1, X2X_2, and X3X_3 are independent and Exp(1)Exp(1)-distributed. Compute the correlation coefficient ρX(1),X(3)\rho_{X_{(1)}, X_{(3)}}.

?
Problem 4.16

Let X1X_1 and X2X_2 be independent, Exp(a)Exp(a)-distributed random variables.

  1. Show that X(1)X_{(1)} and X(2)−X(1)X_{(2)} - X_{(1)} are independent, and determine their distributions.

  2. Compute E[X(2)∣X(1)=y]\mathbb {E}\left[X_{(2)} \mid X_{(1)} = y\right] and E[X(1)∣X(2)=x]\mathbb {E}\left[X_{(1)} \mid X_{(2)} = x\right].

?
Problem 4.17

Let X1X_1, X2X_2, and X3X_3 be independent, U(0,1)U(0,1)-distributed random variables. Compute P(X(3)>1/2∣X(1)=x)\mathbb {P}\left(X_{(3)} > 1/2 \mid X_{(1)} = x\right).

?
Problem 4.18

Suppose that X∈U(0,1)X \in U(0,1). Let X(1),X(2),…,X(n)X_{(1)}, X_{(2)}, \ldots , X_{(n)} be the order variables corresponding to a sample of nn independent observations of XX, and set

Vi=X(i)X(i+1),i=1,2,⋯ ,n−1,andVn=X(n). V_i = \frac{X_{(i)}}{X_{(i+1)}}, \quad i = 1, 2, \cdots , n-1, \quad \text{and} \quad V_n = X_{(n)}.

Show that

?
(a)

V1,V2,…,VnV_1, V_2, \ldots , V_n are independent,

(b)

Vii∈U(0,1)V_i^i \in U(0,1) for i=1,2,…,ni = 1, 2, \ldots , n.

Problem 4.19

The random variables X1,X2,…,Xn,Y1,Y2,…,YnX_1, X_2, \ldots , X_n, Y_1, Y_2, \ldots , Y_n are independent and U(0,a)U(0,a)-distributed. Determine the distribution of

Zn=n⋅log⁡(max⁡{X(n),Y(n)}min⁡{X(n),Y(n)}). Z_n = n \cdot \log \left(\frac{\max \left\{ X_{(n)}, Y_{(n)}\right\} }{\min \left\{ X_{(n)}, Y_{(n)}\right\} }\right).
?
Problem 4.20

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be independent, Exp(a)Exp(a)-distributed random variables, and set

Y1=X(1)andYk=X(k)−X(k−1),for2≤k≤n. Y_1 = X_{(1)} \quad \text{and} \quad Y_k = X_{(k)} - X_{(k-1)}, \quad \text{for} \quad 2 \leq k \leq n.
?
(a)

Show that Y1,Y2,…,YnY_1, Y_2, \ldots , Y_n are independent, and determine their distributions.

(b)

Determine E[X(n)]\mathbb {E}\left[X_{(n)}\right] and Var⁡[X(n)]\operatorname {Var}\left[X_{(n)}\right].

Problem 4.21

The purpose of this problem is to provide a probabilistic proof of the relation

∫0∞nx(1−e−x)n−1e−x dx=1+12+13+⋯+1n. \int _0^\infty nx(1 - e^{-x})^{n-1} e^{-x} \, dx = 1 + \frac{1}{2} + \frac{1}{3} + \cdots + \frac{1}{n}.

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be independent, Exp(1)Exp(1)-distributed random variables. Consider the usual order variables X(1),X(2),…,X(n)X_{(1)}, X_{(2)}, \ldots , X_{(n)}, and set

Y1=X(1)andYk=X(k)−X(k−1),k=2,3,…,n. Y_1 = X_{(1)} \quad \text{and} \quad Y_k = X_{(k)} - X_{(k-1)}, \quad k = 2, 3, \ldots , n.
?
(a)

Show that Y1,Y2,…,YnY_1, Y_2, \ldots , Y_n are independent, and determine their distributions.

(b)

Use (a) and the fact that X(n)=Y1+Y2+⋯+YnX_{(n)} = Y_1 + Y_2 + \cdots + Y_n to prove the desired formula.

Remark.
?

Remark 1. The independence of Y1,Y2,…,YnY_1, Y_2, \ldots , Y_n is not needed for the proof of the formula.

Remark 2. For a proof using properties of the Poisson process, see Subsection 8.5.4.

Problem 4.22

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be independent, Exp(1)Exp(1)-distributed random variables, and set

Zn=nX(1)+(n−1)X(2)+⋯+2X(n−1)+X(n) . Z_n = n X_{(1)} + (n-1) X_{(2)} + \cdots + 2 X_{(n-1)} + X_{(n)} \, .

Compute E[Zn]\mathbb {E}\left[Z_n\right] and Var⁡[Zn]\operatorname {Var}\left[Z_n\right].

?
Problem 4.23

The random variables X1,X2,…,XnX_1, X_2, \ldots , X_n are independent and Exp(1)Exp(1)-distributed. Set

Vn=X(n)andWn=X1+12X2+13X3+⋯+1nXn. V_n = X_{(n)} \quad \text{and} \quad W_n = X_1 + \frac{1}{2} X_2 + \frac{1}{3} X_3 + \cdots + \frac{1}{n} X_n.

Show that Vn=dWnV_n \overset {d}{=} W_n.

?
Problem 4.24

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be independent, Exp(a)Exp(a)-distributed random variables. Determine the distribution of ∑k=1nX(k)\sum_{k=1}^{n} X_{(k)}.

?
Problem 4.25

Let X1,X2,…,XnX_1, X_2, \ldots , X_n be i.i.d. random variables and let X(1),X(2),…,X(n)X_{(1)}, X_{(2)}, \ldots , X_{(n)} be the order variables. Determine

E[X1∣X(1),X(2),…,X(n)]. \mathbb {E}\left[X_1 \mid X_{(1)}, X_{(2)}, \ldots , X_{(n)}\right].
?
Problem 4.26

The number of individuals NN in a tribe is Fs(p)Fs(p)-distributed. The lifetimes of the individuals in the tribe are independent, Exp(1/a)Exp(1/a)-distributed random variables, which, further, are independent of NN. Determine the distribution of the shortest lifetime.

?
Problem 4.27

Let X1,X2,…X_1, X_2, \ldots be independent, U(0,1)U(0,1)-distributed random variables, and let N∈Po(λ)N \in Po(\lambda ) be independent of X1,X2,…X_1, X_2, \ldots. Set

V=max⁡{X1,X2,…,XN} V = \max \left\{ X_1, X_2, \ldots , X_N\right\}

(V=0V = 0 when N=0N = 0). Determine the distribution of VV, and compute E[V]\mathbb {E}\left[V\right].

?
Problem 4.28

Let X1,X2,…X_1, X_2, \ldots be Exp(θ)Exp(\theta )-distributed random variables, let N∈Po(λ)N \in Po(\lambda ), and suppose that all random variables are independent. Set

Y=max⁡{X1,X2,…,XN}withY=0 for N=0. Y = \max \left\{ X_1, X_2, \ldots , X_N\right\} \quad \text{with} \quad Y = 0 \text{ for } N = 0.

Show that Y=dmax⁡{0,V}Y \overset {d}{=} \max \left\{ 0, V\right\}, where VV has a Gumbel type distribution.

?
Remark.
?

Remark. The distribution function of the standard Gumbel distribution equals

Λ(x)=e−e−x,−∞<x<∞. \Lambda (x) = e^{-e^{-x}}, \quad -\infty < x < \infty .
Problem 4.29

Suppose that the random variables X1,X2,…X_1, X_2, \ldots are independent with common distribution function F(x)F(x). Suppose, further, that NN is a positive, integer-valued random variable with generating function g(t)g(t). Finally, suppose that NN and X1,X2,…X_1, X_2, \ldots are independent. Set

Y=max⁡{X1,X2,…,XN}. Y = \max \left\{ X_1, X_2, \ldots , X_N\right\} .

Show that

FY(y)=g(F(y)). F_Y(y) = g\left(F(y)\right).
?