Section 5.8

Examples of characteristic functions

[17/100%]
Show
LaTeX
Problem 5.8.1

If ϕ\phi is a characteristic function, show that ϕˉ,ϕ2,∣ϕ∣2,Re⁡(ϕ)\bar{\phi }, \phi^{2},\left|\phi \right|^{2}, \operatorname {Re}(\phi ) are characteristic functions. Show that ∣ϕ∣\left|\phi \right| is not necessarily a characteristic function.

?
Problem 5.8.2

Show that

P(X≥x)≤inf⁡t≥0{e−txMX(t)} \mathbb {P}\left(X \geq x\right) \leq \inf _{t \geq 0}\left\{ e^{-t x} M_{X}(t)\right\}

where MXM_{X} is the moment generating function of XX. Deduce that, if XX has the N(0,1)N(0,1) distribution,

P(X≥x)≤e−12x2,x>0 \mathbb {P}\left(X \geq x\right) \leq e^{-\frac{1}{2} x^{2}}, \quad x > 0
?
Problem 5.8.3

Let XX have the Γ(λ,m)\Gamma (\lambda , m) distribution and let YY be independent of XX with the beta distribution with parameters nn and m−nm-n, where mm and nn are non-negative integers satisfying n≤mn \leq m. Show that Z=XYZ = X Y has the Γ(λ,n)\Gamma (\lambda , n) distribution.

?
Problem 5.8.4

Find the characteristic function of X2X^{2} when XX has the N(μ,σ2)N\left(\mu , \sigma^{2}\right) distribution.

?
Problem 5.8.5

Let X1,X2,…X_{1}, X_{2}, \ldots be independent N(0,1)N(0,1) variables. Use characteristic functions to find the distribution of:

?
(a)

X12X_{1}^{2},

(b)

∑i=1nXi2\sum_{i = 1}^{n} X_{i}^{2},

(c)

X1/X2X_{1} / X_{2},

(d)

X1X2X_{1} X_{2},

(e)

X1X2+X3X4X_{1} X_{2}+X_{3} X_{4}.

Problem 5.8.6

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be such that, for all a1,a2,…,an∈Ra_{1}, a_{2}, \ldots , a_{n} \in \mathbb {R}, the linear combination a1X1+a2X2+⋯+anXna_{1} X_{1}+ a_{2} X_{2}+\cdots +a_{n} X_{n} has a normal distribution. Show that the joint characteristic function of the XmX_{m} is exp⁡(itμ′−12tt′)\exp \left(i \mathbf{t} \mathbf{\mu }^{\prime }-\frac{1}{2} \mathbf{t} \mathbf{\mathbf{ t }^{ \prime }}\right), for an appropriate vector μ\mathbf{\mu } and matrix V\mathbf{V}. Deduce that the vector (X1,X2,…,Xn)\left(X_{1}, X_{2}, \ldots , X_{n}\right) has a multivariate normal density function so long as V\mathbf{V} is invertible.

?
Problem 5.8.7

Let XX and YY be independent N(0,1)N(0,1) variables, and let UU and VV be independent of XX and YY. Show that Z=(UX+VY)/U2+V2Z = (U X+V Y) / \sqrt{U^{2}+V^{2}} has the N(0,1)N(0,1) distribution. Formulate an extension of this result to cover the case when XX and YY have a bivariate normal distribution with zero means, unit variances, and correlation ρ\rho.

?
Problem 5.8.8

Let XX be exponentially distributed with parameter λ\lambda. Show by elementary integration that E[eitX]=λ/(λ−it)\mathbb {E}\left[e^{i t X}\right] = \lambda /(\lambda -i t).

?
Problem 5.8.9

Find the characteristic functions of the following density functions:

?
(a)

f(x)=12e−∣x∣f(x) = \frac{1}{2} e^{-\left|x\right|} for x∈Rx \in \mathbb {R}

(b)

f(x)=12∣x∣e−∣x∣f(x) = \frac{1}{2}\left|x\right| e^{-\left|x\right|} for x∈Rx \in \mathbb {R}.

Problem 5.8.10

Is it possible for X,YX, Y, and ZZ to have the same distribution and satisfy X=U(Y+Z)X = U(Y+Z), where UU is uniform on [0,1][0,1], and Y,ZY, Z are independent of UU and of one another? (This question arises in modelling energy redistribution among physical particles.)

?
Problem 5.8.11

Find the joint characteristic function of two random variables having a bivariate normal distribution with zero means. (No integration is needed.)

?
Problem 5.8.12

Sampling from the normal distribution. Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be independent random variables with the N(μ,σ2)N\left(\mu , \sigma^{2}\right) distribution, where σ>0\sigma > 0. Let

Xˉ=1n∑i=1nXi,S2=1n−1∑i=1n(Xi−Xˉσ)2 \bar{X} = \frac{1}{n} \sum _{i = 1}^{n} X_{i}, \quad S^{2} = \frac{1}{n-1} \sum _{i = 1}^{n}\left(\frac{X_{i}-\bar{X}}{\sigma }\right)^{2}

be the sample mean and variance. Show that Cov⁡[Xˉ,Xi−Xˉ]=0\operatorname {Cov}\left[\bar{X}, X_{i}-\bar{X}\right] = 0, and deduce that Xˉ\bar{X} and S2S^{2} are independent.

Show that

(n−1)S2σ2+nσ2(Xˉ−μ)2=∑i=1n(Xi−μσ)2 \frac{(n-1) S^{2}}{\sigma ^{2}}+\frac{n}{\sigma ^{2}}(\bar{X}-\mu )^{2} = \sum _{i = 1}^{n}\left(\frac{X_{i}-\mu }{\sigma }\right)^{2}

and use characteristic functions to prove that (n−1)S2/σ2(n-1) S^{2} / \sigma^{2} has the χ2(n−1)\chi^{2}(n-1) distribution.

?
Problem 5.8.13

Let the vector (X1,X2,…,Xn)\left(X_{1}, X_{2}, \ldots , X_{n}\right) have a multivariate normal distribution with zero means. Show that, for nn odd, E[X1X2⋯Xn]=0\mathbb {E}\left[X_{1} X_{2} \cdots X_{n}\right] = 0, while for n=2mn = 2 m,

E[X1X2⋯Xn]=∑r∏ir<jrE[XirXjr] \mathbb {E}\left[X_{1} X_{2} \cdots X_{n}\right] = \sum _{r} \prod _{i_{r} < j_{r}} \mathbb {E}\left[X_{i_{r}} X_{j_{r}}\right]

that is, the sum over all products of expectations of mm distinct pairs of variables.

?
Problem 5.8.14

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be independent random variables with, respectively, the exponential distribution with parameter λr\lambda_{r} for r=1,2,…,nr = 1,2, \ldots , n.

Use moment generating functions to find the density function of the sum S=X1+X2+⋯+XnS = X_{1}+X_{2}+\cdots +X_{n}. Deduce that, for any set {λr:1≤r≤n}\left\{ \lambda_{r}: 1 \leq r \leq n\right\} of distinct positive numbers,

∑r=1n∏s=1s≠rnλsλs−λr=1,∑r=1n1λr∏s=1s≠rnλsλs−λr=∑r=1n1λr \sum _{r = 1}^{n} \prod _{\substack {s = 1 \\ s \neq r}}^{n} \frac{\lambda _{s}}{\lambda _{s}-\lambda _{r}} = 1, \quad \sum _{r = 1}^{n} \frac{1}{\lambda _{r}} \prod _{\substack {s = 1 \\ s \neq r}}^{n} \frac{\lambda _{s}}{\lambda _{s}-\lambda _{r}} = \sum _{r = 1}^{n} \frac{1}{\lambda _{r}}
?
Problem 5.8.15

Let XX have the N(0,1)N(0,1) distribution, and let f:R→Rf: \mathbb {R} \rightarrow \mathbb {R} be sufficiently smooth. Show that

E[eθXf(X)]=e12θ2E[f(X+θ)] \mathbb {E}\left[e^{\theta X} f(X)\right] = e^{\frac{1}{2} \theta ^{2}} \mathbb {E}\left[f(X+\theta )\right]

and deduce that E[Xf(X)]=E[f′(X)]\mathbb {E}\left[X f(X)\right] = \mathbb {E}\left[f^{\prime }(X)\right].

?
Problem 5.8.16

Find the characteristic function of the N(0,1)N(0,1) distribution without using the methods of complex analysis. [Hint: Consider the derivative of the characteristic function, and use an appropriate theorem to differentiate through the integral.]

?
Problem 5.8.17

Let XX be a non-negative random variable with 0<μ=E[X]<∞0 < \mu = \mathbb {E}\left[X\right] < \infty. The random variable YY is said to have the size-biased XX distribution if dFY(x)=(x/μ)dFX(x)d F_{Y}(x) = (x / \mu ) d F_{X}(x) for all xx. (You may think of this as saying that fY(x)∝xfX(x)f_{Y}(x) \propto x f_{X}(x) if XX is either discrete with mass function fXf_{X}, or continuous with density function fXf_{X}.)

Show that:

?
(a)

the characteristic functions satisfy ϕY(t)=ϕX′(t)/(iμ)\phi_{Y}(t) = \phi_{X}^{\prime }(t) /(i \mu ),

(b)

when XX has the Γ(λ,r)\Gamma (\lambda , r) distribution, YY has the Γ(λ,r+1)\Gamma (\lambda , r+1) distribution,

(c)

the non-negative integer-valued random variable XX has the Poisson distribution with parameter λ\lambda if and only if YY is distributed as X+1X+1. What is the size-biased XX distribution when XX has the binomial bin⁡(n,p)\operatorname {bin}(n, p) distribution?