Section 1

Multivariate Distributions

[27/63%]
Show
LaTeX
Problem 1.1

The density of the impact point (X,Y)(X, Y) of a circular target is given by

f(x,y)=c(R−x2+y2)forx2+y2≤R2. f(x, y) = c(R - \sqrt{x^{2} + y^{2}}) \qquad \text{for} \quad x^{2} + y^{2} \leq R^{2}.

Find, (a) the constant cc, (b) the probability pp that the impact point falls in a circle with radius a<Ra < R centered at the origin.

?
(a)
(b)
Problem 1.2

The random variables X,YX, Y satisfy the linear relation

aX−bY=c, aX - bY = c,

where a,b,ca, b, c are constants. Find, (a) the correlation ρ(X,Y)\rho (X, Y), and (b) the ratio σx/σy\sigma_{x}/\sigma_{y} of the standard deviations.

?
(a)
(b)
Problem 1.3

The dispersion (variance--covariance) matrix of a three-dimensional normal distribution is

(σij)=[52−2263−238]. (\sigma _{ij}) = \begin{bmatrix} 5 & 2 & -2 \\ 2 & 6 & 3 \\ -2 & 3 & 8 \end{bmatrix}.

If μx=μy=μz=0\mu_{x} = \mu_{y} = \mu_{z} = 0, find the density f(x,y,z)f(x, y, z) and its maximum.

?
Problem 1.4

The joint density of XX and YY is given by

f(x,y)=ye−y(x+1),x>0,y>0. f(x, y) = ye^{-y(x+1)}, \qquad x > 0, \quad y > 0.

Find, (a) the marginal densities of XX and YY, and (b) the conditional distribution function FX(x∣y)F_{X}(x \mid y) of XX given Y=yY = y.

?
(a)
(b)
Problem 1.5

Suppose that the random variable XX coincides with the random variable XiX_{i} with probability pip_{i}, that is,

P(X=Xi)=piandE[Xi]=mi,i=1,2,…. \mathbb {P}\left(X = X_{i}\right) = p_{i} \qquad \text{and} \qquad \mathbb {E}\left[X_{i}\right] = m_{i}, \qquad i = 1, 2, \ldots .

Show that

Var⁡[X]=∑ipiVar⁡[Xi]+Var⁡[M], \operatorname {Var}\left[X\right] = \sum _{i} p_{i} \operatorname {Var}\left[X_{i}\right] + \operatorname {Var}\left[M\right],

where P(M=mi)=pi\mathbb {P}\left(M = m_{i}\right) = p_{i} (i=1,2,…)(i = 1, 2, \ldots ).

?
Problem 1.6

The random vector (X,Y,Z)(X, Y, Z) has density f(x,y,z)f(x, y, z). X,Y,ZX, Y, Z can only be observed simultaneously. An observation gave the values u,v,wu, v, w without knowing the correspondence between them and X,Y,ZX, Y, Z. Find the probability that X=uX = u, Y=vY = v, and Z=wZ = w.

?
Problem 1.7

The joint distribution function F(x,y)F(x, y) of the random variables XX and YY is given by

F(x,y)=sin⁡xsin⁡y,0≤x≤π/2,0≤y≤π/2. F(x, y) = \sin x \sin y, \qquad 0 \leq x \leq \pi /2, \quad 0 \leq y \leq \pi /2.

Find, (a) the density function f(x,y)f(x, y), and (b) the dispersion matrix.

?
(a)
(b)
Problem 1.8

The normal density of a point A=(X1,X2,X3)A = (X_{1}, X_{2}, X_{3}) is given by

f(x,y,z)=1(2π)3/2σ1σ2σ3exp⁡{−12(x2σ12+y2σ22+z2σ32)}. f(x, y, z) = \frac{1}{(2\pi )^{3/2}\sigma _{1}\sigma _{2}\sigma _{3}} \exp \left\{ -\frac{1}{2}\left(\frac{x^{2}}{\sigma _{1}^{2}} + \frac{y^{2}}{\sigma _{2}^{2}} + \frac{z^{2}}{\sigma _{3}^{2}}\right)\right\} .

What is the probability that AA will fall into an ellipsoid, with principal semiaxes E1,E2,E3E_{1}, E_{2}, E_{3} along the axes Ox,Oy,OzOx, Oy, Oz, where E1,E2,E3E_{1}, E_{2}, E_{3} are the probable errors of X,Y,ZX, Y, Z, respectively, i.e.,

P(∣X∣<E1)=P(∣Y∣<E2)=P(∣Z∣<E3)=1/2. \mathbb {P}\left(\left|X\right| < E_{1}\right) = \mathbb {P}\left(\left|Y\right| < E_{2}\right) = \mathbb {P}\left(\left|Z\right| < E_{3}\right) = 1/2.
?
Problem 1.9

The vector (X,Y)(X, Y) has the uniform distribution in the ellipse

x2a2+y2b2≤1. \frac{x^{2}}{a^{2}} + \frac{y^{2}}{b^{2}} \leq 1.

Find:

?
(a)

the marginal distributions of XX and YY;

(b)

the conditional distributions of XX given that Y=yY = y, and the conditional distributions of YY given that X=xX = x;

(c)

the Cov⁡[X,Y]=σxy\operatorname {Cov}\left[ X, Y \right] = \sigma_{xy}.

Are X,YX, Y independent?

Problem 1.10

The point (X,Y,Z)(X, Y, Z) is uniformly distributed in the sphere x2+y2+z2≤R2x^{2} + y^{2} + z^{2} \leq R^{2}. Find the density of ZZ and the conditional density f(x,y∣z)f(x, y \mid z). Generalize for an nn-dimensional sphere.

?
Problem 1.11

Given fY(y)f_{Y}(y), E[X∣y]\mathbb {E}\left[ X \mid y \right], Var⁡[X∣y]\operatorname {Var}\left[ X \mid y \right], find E[X]\mathbb {E}\left[X\right] and Var⁡[X]\operatorname {Var}\left[X\right].

?
Problem 1.12

The vector (X,Y)(X, Y) has normal density

f(x,y)=ce−4x2−6xy−9y2. f(x, y) = ce^{-4x^{2} - 6xy - 9y^{2}}.

Find the densities fX(x)f_{X}(x), fY(y)f_{Y}(y), fX(x∣y)f_{X}(x \mid y), fY(y∣x)f_{Y}(y \mid x) and the constant cc.

?
Problem 1.13

Suppose that X→\overrightarrow {X} has a spherically symmetric nn-dimensional distribution, i.e., with density f(x12+⋯+xn2)f(x_{1}^{2} + \cdots + x_{n}^{2}). Prove that the density gg of the ``generalized χ2\chi^{2} variable'' U=X→′X→U = \overrightarrow {X}'\overrightarrow {X} is given by

g(u)=12Cnf(u)un/2−1, g(u) = \tfrac {1}{2}C_{n}f(u)u^{n/2-1},

where CnC_{n} is the ``surface'' area of the nn-dimensional sphere, i.e.,

Cn=2πn/2Γ(n/2). C_{n} = \frac{2\pi ^{n/2}}{\Gamma (n/2)}.
?
Problem 1.14

(Continuation of Problem 1.13.) For n=2n = 2, show that the polar coordinates (R,θ)(R, \theta ), where

X=Rcos⁡θ,Y=Rsin⁡θ, X = R\cos \theta , \qquad Y = R\sin \theta ,

are independent, θ\theta is uniformly distributed on [0,2π)[0, 2\pi ), and RR has density (cf. Exercise 221)

h(r)=2πrf(r2). h(r) = 2\pi r f(r^{2}).
?
Problem 1.15

(Continuation of Problem 1.14.) Show that the correlation coefficient based on the single observation (X,Y)(X, Y), i.e.,

r0=XYX2+Y2 r_{0} = \frac{XY}{X^{2} + Y^{2}}

has density

f(r0)=1π11−r02,−1<r0<1. f(r_{0}) = \frac{1}{\pi } \frac{1}{\sqrt{1 - r_{0}^{2}}}, \qquad -1 < r_{0} < 1.
?
Problem 1.16

(Continuation of Problem 1.15.) If X→=(X1,…,Xn)′\overrightarrow {X} = (X_{1}, \ldots , X_{n})' is N(0,In)\mathscr {N}\left(0, I_{n}\right) and X→\overrightarrow {X} is partitioned into kk subvectors X(1),…,X(k)X_{(1)}, \ldots , X_{(k)} with v1,v2,…,vkv_{1}, v_{2}, \ldots , v_{k} components, respectively, show that (X(1)′X(1),…,X(k)′X(k))/∣X∣2(X_{(1)}'X_{(1)}, \ldots , X_{(k)}'X_{(k)})/\left|X\right|^{2} has the Dirichlet distribution (see (5.11)), with density f(t1,…,tk−1)f(t_{1}, \ldots , t_{k-1}) given below.

Formula (5.11), Dirichlet distribution: for x1,…,xkx_{1}, \ldots , x_{k} with ∑i=1k+1xi=1\sum_{i=1}^{k+1} x_{i} = 1, xi≥0x_{i} \geq 0,

f(x1,…,xk)=Γ(n1+⋯+nk+1)Γ(n1)+⋯+Γ(nk+1)∏i=1k+1xini−1. f(x_{1}, \ldots , x_{k}) = \frac{\Gamma (n_{1} + \cdots + n_{k+1})}{\Gamma (n_{1}) + \cdots + \Gamma (n_{k+1})} \prod _{i=1}^{k+1} x_{i}^{n_{i}-1}.

The density f(t1,…,tk−1)f(t_{1}, \ldots , t_{k-1}) asked for here is

f(t1,…,tk−1)=Γ(n2)∏i=1kΓ(vk2)(1−t1−⋯−tk−1)(vk/2)−1∏i=1k−1ti(vi/2)−1, f(t_{1}, \ldots , t_{k-1}) = \frac{\Gamma \left(\dfrac {n}{2}\right)}{\displaystyle \prod _{i=1}^{k} \Gamma \left(\dfrac {v_{k}}{2}\right)} (1 - t_{1} - \cdots - t_{k-1})^{(v_{k}/2)-1} \prod _{i=1}^{k-1} t_{i}^{(v_{i}/2)-1}, ti≥0,∑ti<1. t_{i} \geq 0, \quad \sum t_{i} < 1.

Hence, for v1=v2=⋯=vs=1v_{1} = v_{2} = \cdots = v_{s} = 1, vs+1=n−sv_{s+1} = n - s (k=s+1)(k = s+1),

(∣X1∣,∣X2∣,…,∣Xk∣)∣X∣ \frac{(\left|X_{1}\right|, \left|X_{2}\right|, \ldots , \left|X_{k}\right|)}{\left|X\right|}

has the density

f0(v1,…,vk)=Γ(n2)2kΓ(n−k2)π(1−v12−⋯−vk2)((n−k)/2)−1,vi≥0,∑i=1kvi2<1, f_{0}(v_{1}, \ldots , v_{k}) = \frac{\Gamma \left(\dfrac {n}{2}\right) 2^{k}}{\Gamma \left(\dfrac {n-k}{2}\right)\pi } (1 - v_{1}^{2} - \cdots - v_{k}^{2})^{((n-k)/2)-1}, \qquad v_{i} \geq 0, \quad \sum _{i=1}^{k} v_{i}^{2} < 1,

and the density of (X1,…,Xk)/∣X∣≡(U1,U2,…,Uk)(X_{1}, \ldots , X_{k})/\left|X\right| \equiv (U_{1}, U_{2}, \ldots , U_{k}) is

f0(u1,…,uk)2kif∑i=1kui2<1. \frac{f_{0}(u_{1}, \ldots , u_{k})}{2^{k}} \qquad \text{if} \quad \sum _{i=1}^{k} u_{i}^{2} < 1.

This is the distribution of any kk-dimensional subvector of an nn-dimensional vector

U→=(U1,…,Un) \overrightarrow {U} = (U_{1}, \ldots , U_{n})

uniformly distributed on the (surface of the) unit sphere

x12+⋯+xn2=1. x_{1}^{2} + \cdots + x_{n}^{2} = 1.
?
Problem 1.17

(Continuation of Problem 1.16.) In general, if X→\overrightarrow {X} has a spherical distribution (see Problem 1.13), since this is invariant under rotations in nn-space, the distribution of the direction X→/∣X∣\overrightarrow {X}/\left|X\right| is the same as that of U→\overrightarrow {U} and is independent of its length ∣X∣\left|X\right| (for any spherical distribution with P(∣X∣=0)=0\mathbb {P}\left(\left|X\right| = 0\right) = 0).

Hence conclude that the results of Problem 1.16 hold if X→\overrightarrow {X} is any spherically symmetric random vector.

?
Problem 1.18

Let X,YX, Y be random variables with

E[X]=μ,E[Y]=η,Var⁡[X]=σ12,Var⁡[Y]=σ22,Cov⁡[X,Y]=σ12. \mathbb {E}\left[X\right] = \mu , \qquad \mathbb {E}\left[Y\right] = \eta , \qquad \operatorname {Var}\left[X\right] = \sigma _{1}^{2}, \qquad \operatorname {Var}\left[Y\right] = \sigma _{2}^{2}, \qquad \operatorname {Cov}\left[ X, Y \right] = \sigma _{12}.

Find an approximate formula for

E[g(X,Y)],Var⁡[g(X,Y)], \mathbb {E}\left[g(X, Y)\right], \quad \operatorname {Var}\left[g(X, Y)\right],

using the linear expansion of g(x,y)g(x, y) around (μ,η)(\mu , \eta ) (up to second-order moments). Generalize for nn random variables.

?
Problem 1.19

XX and YY are independent and identically distributed random variables with density given by

f(x)=2π1−x2,0≤x≤1. f(x) = \frac{2}{\pi \sqrt{1 - x^{2}}}, \qquad 0 \leq x \leq 1.

Using Problem 1.18 find the E[Z]\mathbb {E}\left[Z\right] and Var⁡[Z]\operatorname {Var}\left[Z\right] where

Z=arctan⁡XY. Z = \arctan \frac{X}{Y}.
?
Problem 1.20

The fundamental frequency of a chord is given by the formula

Ω=12FmL, \Omega = \frac{1}{2}\sqrt{\frac{F}{mL}},

where FF is the tension, mm is the mass of the chord, and LL is its length. If the mass is assumed to be constant and F,LF, L are random variables with E[F]=f\mathbb {E}\left[F\right] = f, E[L]=l\mathbb {E}\left[L\right] = l, Var⁡[F]=σf2\operatorname {Var}\left[F\right] = \sigma_{f}^{2}, Var⁡[L]=σl2\operatorname {Var}\left[L\right] = \sigma_{l}^{2}, and Cov⁡[F,L]=σfl\operatorname {Cov}\left[ F, L \right] = \sigma_{fl}, find an approximation for the variance of Ω\Omega.

?
Problem 1.21

Let the vector (X,Y)(X, Y) have density f(x,y)f(x, y). We define the complex variables

Z=X+iY,Zt=Zeit, Z = X + iY, \qquad Z_{t} = Ze^{it},

and Zt=ZeitZ_{t} = Ze^{it}. Prove that, in order for all ZtZ_{t} to have the same distribution, it is necessary that f(x,y)=g(x2+y2)f(x, y) = g(x^{2} + y^{2}) for some density gg (see Problem 1.13).

?
Problem 1.22

If X→\overrightarrow {X} has density ff as in Problem 1.13, show that

Y→=μ→+AX→(a nonsingular n×n constant matrix) \overrightarrow {Y} = \overrightarrow {\mu } + A\overrightarrow {X} \qquad \text{(a nonsingular }n \times n\text{ constant matrix)}

has density of the form

c∣Λ∣−1/2f((y→−μ→)′Λ−1(y→−μ→)),Λ=AA′, c\left|\Lambda \right|^{-1/2}f((\overrightarrow {y} - \overrightarrow {\mu })'\Lambda ^{-1}(\overrightarrow {y} - \overrightarrow {\mu })), \qquad \Lambda = AA',

and characteristic function of the form

eit′μψ(t′Λt)for some function ψ. e^{it'\mu }\psi (t'\Lambda t) \qquad \text{for some function } \psi .
?
Problem 1.23

Let ρij=ρ(Xi,Xj)\rho_{ij} = \rho (X_{i}, X_{j}) be the correlation coefficient between Xi,XjX_{i}, X_{j} for i,j=1,…,ni, j = 1, \ldots , n. For n=3n = 3 and ρ12=ρ13=ρ23=ρ\rho_{12} = \rho_{13} = \rho_{23} = \rho, what are the possible values that ρ\rho can take?

?
Problem 1.24

If the pp vector X→\overrightarrow {X} is N(μ,Λ)\mathscr {N}\left(\mu , \Lambda \right), show that the quadratic form

χ2=(X→−μ→)′Λ−1(X→−μ→) \chi ^{2} = (\overrightarrow {X} - \overrightarrow {\mu })'\Lambda ^{-1}(\overrightarrow {X} - \overrightarrow {\mu })

has the χp2\chi_{p}^{2} distribution, with pp degrees of freedom, and density given by (cf. Problem 1.13)

?
Problem 1.25

The entropy HH of a multivariate distribution with density f(x→)f(\overrightarrow {x}) is defined by the formula

H(f)=−E[log⁡f(X→)]=−∫⋯∫f(x→)log⁡f(x→) dx→. H(f) = -\mathbb {E}\left[\log f(\overrightarrow {X})\right] = -\int \cdots \int f(\overrightarrow {x}) \log f(\overrightarrow {x}) \, d\overrightarrow {x}.

Prove that for the normal distribution of Problem 1.24

H=log⁡[(2πe)p/2∣Λ∣−1/2]. H = \log \left[(2\pi e)^{p/2}\left|\Lambda \right|^{-1/2}\right].
?
Problem 1.26

If X→\overrightarrow {X} is N(μ,Λ)\mathscr {N}\left(\mu , \Lambda \right) with density ff, find the density gg of the random variable

Y=f(X→). Y = f(\overrightarrow {X}).
?
Problem 1.27

If X→=(X1,…,Xn)\overrightarrow {X} = (X_{1}, \ldots , X_{n}) is uniformly distributed in the simplex TT:

x1+x2+⋯+xn≤1,xi≥0,i=1,…,n, x_{1} + x_{2} + \cdots + x_{n} \leq 1, \qquad x_{i} \geq 0, \qquad i = 1, \ldots , n,

show that the density of X→\overrightarrow {X} is

f(x→)=n!forx→∈T. f(\overrightarrow {x}) = n! \qquad \text{for} \quad \overrightarrow {x} \in T.

Show that the (n−1)(n-1)-dimensional marginals are also special cases of the Dirichlet distribution (5.11).

Formula (5.11), Dirichlet distribution: for x1,…,xkx_{1}, \ldots , x_{k} with ∑i=1k+1xi=1\sum_{i=1}^{k+1} x_{i} = 1, xi≥0x_{i} \geq 0,

f(x1,…,xk)=Γ(n1+⋯+nk+1)Γ(n1)+⋯+Γ(nk+1)∏i=1k+1xini−1. f(x_{1}, \ldots , x_{k}) = \frac{\Gamma (n_{1} + \cdots + n_{k+1})}{\Gamma (n_{1}) + \cdots + \Gamma (n_{k+1})} \prod _{i=1}^{k+1} x_{i}^{n_{i}-1}.
?