Section 5.7

Characteristic functions

[13/100%]
Show
LaTeX
Problem 5.7.1

Find two dependent random variables XX and YY such that ϕX+Y(t)=ϕX(t)ϕY(t)\phi_{X+Y}(t) = \phi_{X}(t) \phi_{Y}(t) for all tt.

?
Problem 5.7.2

If ϕ\phi is a characteristic function, show that Re⁡{1−ϕ(t)}≥14Re⁡{1−ϕ(2t)}\operatorname {Re}\left\{ 1-\phi (t)\right\} \geq \frac{1}{4} \operatorname {Re}\left\{ 1-\phi (2 t)\right\}, and deduce that 1−∣ϕ(2t)∣≤8{1−∣ϕ(t)∣}1-\left|\phi (2 t)\right| \leq 8\left\{ 1-\left|\phi (t)\right|\right\}.

?
Problem 5.7.3

The cumulant generating function KX(θ)K_{X}(\theta ) of the random variable XX is defined by KX(θ)=log⁡E[eθX]K_{X}(\theta ) = \log \mathbb {E}\left[e^{\theta X}\right], the logarithm of the moment generating function of XX. If the latter is finite in a neighbourhood of the origin, then KXK_{X} has a convergent Taylor expansion:

KX(θ)=∑n=1∞1n!kn(X)θn K_{X}(\theta ) = \sum _{n = 1}^{\infty } \frac{1}{n!} k_{n}(X) \theta ^{n}

and kn(X)k_{n}(X) is called the nnth cumulant (or semi-invariant) of XX.

?
(a)

Express k1(X),k2(X)k_{1}(X), k_{2}(X), and k3(X)k_{3}(X) in terms of the moments of XX.

(b)

If XX and YY are independent random variables, show that kn(X+Y)=kn(X)+kn(Y)k_{n}(X+Y) = k_{n}(X)+k_{n}(Y).

Problem 5.7.4

Let XX be N(0,1)N(0,1), and show that the cumulants of XX are k2(X)=1,km(X)=0k_{2}(X) = 1, k_{m}(X) = 0 for m≠2m \neq 2.

?
Problem 5.7.5

The random variable XX is said to have a lattice distribution if there exist aa and bb such that XX takes values in the set L(a,b)={a+bm:m=0,±1,…}L(a, b) = \left\{ a+b m: m = 0, \pm 1, \ldots \right\}. The span of such a variable XX is the maximal value of bb for which there exists aa such that XX takes values in L(a,b)L(a, b).

?
(a)

Suppose that XX has a lattice distribution with span bb. Show that ∣ϕX(2π/b)∣=1\left|\phi_{X}(2 \pi / b)\right| = 1, and that ∣ϕX(t)∣<1\left|\phi_{X}(t)\right| < 1 for 0<t<2π/b0 < t < 2 \pi / b.

(b)

Suppose that ∣ϕX(θ)∣=1\left|\phi_{X}(\theta )\right| = 1 for some θ≠0\theta \neq 0. Show that XX has a lattice distribution with span 2πk/θ2 \pi k / \theta for some integer kk.

Problem 5.7.6

Let XX be a random variable with density function ff. Show that ∣ϕX(t)∣→0\left|\phi_{X}(t)\right| \rightarrow 0 as t→±∞t \rightarrow \pm \infty.

?
Problem 5.7.7

Let X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} be independent variables, XiX_{i} being N(μi,1)N\left(\mu_{i}, 1\right), and let Y=X12+X22+⋯+Xn2Y = X_{1}^{2}+X_{2}^{2}+\cdots +X_{n}^{2}. Show that the characteristic function of YY is

ϕY(t)=1(1−2it)n/2exp⁡(itθ1−2it) \phi _{Y}(t) = \frac{1}{(1-2 i t)^{n / 2}} \exp \left(\frac{i t \theta }{1-2 i t}\right)

where θ=μ12+μ22+⋯+μn2\theta = \mu_{1}^{2}+\mu_{2}^{2}+\cdots +\mu_{n}^{2}. The random variables YY is said to have the non-central chi-squared distribution with nn degrees of freedom and non-centrality parameter θ\theta, written χ2(n;θ)\chi^{2}(n ; \theta ).

?
Problem 5.7.8

Let XX be N(μ,1)N(\mu , 1) and let YY be χ2(n)\chi^{2}(n), and suppose that XX and YY are independent. The random variable T=X/Y/nT = X / \sqrt{Y / n} is said to have the non-central tt-distribution with nn degrees of freedom and non-centrality parameter μ\mu. If UU and VV are independent, UU being χ2(m;θ)\chi^{2}(m ; \theta ) and VV being χ2(n)\chi^{2}(n), then F=(U/m)/(V/n)F = (U / m) /(V / n) is said to have the non-central FF-distribution with mm and nn degrees of freedom and non-centrality parameter θ\theta, written F(m,n;θ)F(m, n ; \theta ).

?
(a)

Show that T2T^{2} is F(1,n;μ2)F\left(1, n ; \mu^{2}\right).

(b)

Show that

E[F]=n(m+θ)m(n−2) if n>2 \mathbb {E}\left[F\right] = \frac{n(m+\theta )}{m(n-2)} \quad \text{ if } n > 2
Problem 5.7.9

Let XX be a random variable with density function ff and characteristic function ϕ\phi. Show, subject to an appropriate condition on ff, that

∫−∞∞f(x)2dx=12π∫−∞∞∣ϕ(t)∣2dt \int _{-\infty }^{\infty } f(x)^{2} d x = \frac{1}{2 \pi } \int _{-\infty }^{\infty }\left|\phi (t)\right|^{2} d t
?
Problem 5.7.10

If XX and YY are continuous random variables, show that

∫−∞∞ϕX(y)fY(y)e−itydy=∫−∞∞ϕY(x−t)fX(x)dx \int _{-\infty }^{\infty } \phi _{X}(y) f_{Y}(y) e^{-i t y} d y = \int _{-\infty }^{\infty } \phi _{Y}(x-t) f_{X}(x) d x
?
Problem 5.7.11
?
(a)

Let XX have distribution function FF and let τ\tau be such that M(τ)=E[eτX]<∞M(\tau ) = \mathbb {E}\left[e^{\tau X}\right] < \infty. Show that Fτ(x)=M(τ)−1∫−∞xeτydF(y)F_{\tau }(x) = M(\tau )^{-1} \int_{-\infty }^{x} e^{\tau y} d F(y) is a distribution function, called a 'tilted distribution' of XX, and find its moment generating function.

(b)

Suppose XX and YY are independent and E[eτX],E[eτY]<∞\mathbb {E}\left[e^{\tau X}\right], \mathbb {E}\left[e^{\tau Y}\right] < \infty. Find the moment generating function of the tilted distribution of X+YX+Y in terms of those of XX and YY.

Problem 5.7.12

Let XX and YY be independent with the distributions N(μ,σ2)N\left(\mu , \sigma^{2}\right) and N(0,σ2)N\left(0, \sigma^{2}\right), where σ2>0\sigma^{2} > 0. Show that R=X2+Y2R = \sqrt{X^{2}+Y^{2}} has density function

f(r)=rπσ2exp⁡{−μ2+r22σ2}∫0πexp⁡{rμcos⁡θσ2}dθ,r>0 f(r) = \frac{r}{\pi \sigma ^{2}} \exp \left\{ -\frac{\mu ^{2}+r^{2}}{2 \sigma ^{2}}\right\} \int _{0}^{\pi } \exp \left\{ \frac{r \mu \cos \theta }{\sigma ^{2}}\right\} d \theta , \quad r > 0

The integral may be expressed in terms of a modified Bessel function.

?
Problem 5.7.13

For each of the following joint density functions of the pair (X,Y)(X, Y), find the joint moment generating function M(s,t)=E[esX+tY]M(s, t) = \mathbb {E}\left[e^{s X+t Y}\right], and hence find Cov⁡[X,Y]\operatorname {Cov}\left[X, Y\right].

?
(a)

We have that f(x,y)=2e−x−yf(x, y) = 2 e^{-x-y} for 0<x<y<∞0 < x < y < \infty.

(b)

We have that

f(x,y)=x2+y2+c22π(2+c2)exp⁡{−12(x2+y2)},x,y∈R f(x, y) = \frac{x^{2}+y^{2}+c^{2}}{2 \pi \left(2+c^{2}\right)} \exp \left\{ -\frac{1}{2}\left(x^{2}+y^{2}\right)\right\} , \quad x, y \in \mathbb {R}