Section 13

Covariance and the Correlation Coefficient

[25/68%]
Show
LaTeX
Problem 13.1

Prove that

Var⁡[ξ1+…+ξn]=∑i=1nVar⁡[ξi]+∑i≠jCov⁡[ξi,ξj]. \operatorname {Var}\left[\xi _1 + \ldots + \xi _n\right] = \sum _{i=1}^n \operatorname {Var}\left[\xi _i\right] + \sum _{i \neq j} \operatorname {Cov}\left[ \xi _i, \xi _j \right].
?
Problem 13.2

Prove that independence of the random variables ξ\xi and η\eta implies Cov⁡[ξ,η]=0\operatorname {Cov}\left[ \xi , \eta \right] = 0.

?
Problem 13.3

Prove that:

?
(a)

∣Corr⁡[ξ,η]∣⩽1\left|\operatorname {Corr}\left[ \xi , \eta \right]\right| \leqslant 1;

(b)

∣Corr⁡[ξ,η]∣=1\left|\operatorname {Corr}\left[ \xi , \eta \right]\right| = 1 if and only if the random variables ξ\xi and η\eta are linearly dependent with probability 1, i.e., there exist constants a≠0a \neq 0 and bb such that P{η=aξ+b}=1\mathbb {P}\left\{ \eta = a\xi + b\right\} = 1.

Problem 13.4

Construct an example of two dependent random variables whose correlation coefficient is zero.

?
Problem 13.5

Find Cov⁡[ξ,η]\operatorname {Cov}\left[ \xi , \eta \right] for the random variables with the distribution table given in problem:

?
(a)

12.5;

(b)

12.6.

Problem 13.6

Let the random variable ξ\xi take the values 0, 1, and −1-1 with probabilities 1/31/3, 1/21/2, and 1/61/6 respectively. Find the correlation coefficient between ξ\xi and ξ2\xi^2.

?
Problem 13.7

Let the random variables ξ\xi and η\eta be independent, with P{ξ=1}=P{ξ=−1}=1/2\mathbb {P}\left\{ \xi =1\right\} = \mathbb {P}\left\{ \xi =-1\right\} = 1/2, P{η=1}=P{η=−1}=1/4\mathbb {P}\left\{ \eta =1\right\} = \mathbb {P}\left\{ \eta =-1\right\} = 1/4, and P{η=0}=1/2\mathbb {P}\left\{ \eta =0\right\} = 1/2. Are the random variables ξη\xi \eta and η\eta:

?
(a)

independent;

(b)

uncorrelated?

Problem 13.8

Find the correlation coefficient between the number of «ones» rolled and the number of «sixes» rolled in nn rolls of a fair die.

?
Problem 13.9

A random point (ξ,η)(\xi , \eta ) has a uniform distribution in the square {(x,y):∣x∣+∣y∣⩽2}\left\{ (x, y) : \left|x\right| + \left|y\right| \leqslant \sqrt{2}\right\}.

?
(a)

Find the mean value and variance of ξ\xi.

(b)

Find the mean value and variance of η\eta.

(c)

Find Cov⁡[ξ,η]\operatorname {Cov}\left[ \xi , \eta \right].

(d)

Determine whether ξ\xi and η\eta are dependent.

Problem 13.10

A random point (ξ,η)(\xi , \eta ) has a uniform distribution in the triangle with vertices at the points (0,0)(0, 0), (2,1)(2, 1), (2,0)(2, 0).

?
(a)

Find the mean value and variance of ξ\xi.

(b)

Find the mean value and variance of η\eta.

(c)

Find Cov⁡[ξ,η]\operatorname {Cov}\left[ \xi , \eta \right].

(d)

Determine whether ξ\xi and η\eta are dependent.

Problem 13.11

A random point (ξ,η)(\xi , \eta ) is uniformly distributed inside the unit disk centered at the origin.

?
(a)

Find the expectation and variance of ζ=ξη\zeta = \xi \eta.

(b)

Find Cov⁡[ξ,η]\operatorname {Cov}\left[ \xi , \eta \right].

(c)

Determine whether ξ\xi and η\eta are dependent.

Problem 13.12

The joint distribution of the random variables ξ\xi and η\eta has density

p(x,y)={x+yfor 0⩽x⩽1, 0⩽y⩽1,0otherwise. p(x, y) = \begin{cases} x+y & \text{for } 0 \leqslant x \leqslant 1,\ 0 \leqslant y \leqslant 1, \\ 0 & \text{otherwise.} \end{cases}
?
(a)

Find the mean value and variance of ξ\xi.

(b)

Find the mean value and variance of η\eta.

(c)

Find Cov⁡[ξ,η]\operatorname {Cov}\left[ \xi , \eta \right].

Problem 13.13

Two points are thrown at random onto the segment [0,a][0, a]. Find:

?
(a)

the expectation and variance of the distance between them;

(b)

the covariance of the coordinates of the left and right points.

Problem 13.14

Find the correlation coefficient between the random variables ξ\xi and η=e−ξ\eta = e^{-\xi }, if ξ\xi has the standard normal distribution.

?
Problem 13.15

The random variables ξ\xi and η\eta are independent and normally distributed with parameters aa and σ2\sigma^2. Find:

?
(a)

the correlation coefficient of the quantities αξ+βη\alpha \xi + \beta \eta and αξ−βη\alpha \xi - \beta \eta;

(b)

their joint distribution.

Problem 13.16

Let ξ\xi be a random variable with a symmetric distribution and finite variance. Find the correlation coefficient of the random variables ξ\xi and ∣ξ∣\left|\xi \right|.

?
Problem 13.17

Let the random variables ξ1,…,ξn+m\xi_1, \ldots , \xi_{n+m} be independent, identically distributed, and have finite variance. For n>mn > m, find the correlation coefficient between the sums ξ1+…+ξn\xi_1 + \ldots + \xi_n and ξm+1+…+ξm+n\xi_{m+1} + \ldots + \xi_{m+n}.

?
Problem 13.18

Give an example of two random variables ξ\xi and η\eta such that E[ξ]\mathbb {E}\left[\xi \right] and E[η]\mathbb {E}\left[\eta \right] exist, but E[ξη]\mathbb {E}\left[\xi \eta \right] does not exist.

?
Problem 13.19

An urn contains aa white and bb black balls. kk balls are drawn from the urn simultaneously, k⩽a+bk \leqslant a+b. Find the expectation and variance of the number of white balls drawn.

?
Problem 13.20

For a group of nn people, find the expectation and variance of the number of days in the year on which no one's birthday falls.

?
Problem 13.21

nn letters are written, addressed to different recipients. There are nn envelopes with the corresponding addresses. The letters are placed into the envelopes in a random order. Find the mean value and variance of the number of letters sent to the correct address.

?
Problem 13.22

Prove that there do not exist three random variables ξ\xi, η\eta, and ζ\zeta such that the correlation coefficient of any two of them equals −1-1.

?
Problem 13.23

Let ξ1,…,ξn\xi_1, \ldots , \xi_n be random variables such that the correlation coefficient of any two of them equals the same number ρ\rho. Prove that ρ⩾−1/(n−1)\rho \geqslant -1/(n-1).

?
Problem 13.24

Let the random variables ξ\xi and η\eta have zero mean values, unit variances, and correlation coefficient ρ\rho. Show that E[max⁡(ξ2,η2)]⩽1+1−ρ2\mathbb {E}\left[\max (\xi^2, \eta^2)\right] \leqslant 1 + \sqrt{1-\rho^2}.

?
Problem 13.25

Let the random variables ξ\xi and η\eta have zero mean values, unit variances, and correlation coefficient ρ\rho, 0<ρ<10 < \rho < 1. Find all values of aa and bb for which the random variables ξ−aη\xi - a\eta and η−bξ\eta - b\xi are uncorrelated.

?