Section 2

Generating Functions

[22/73%]
Show
LaTeX
Problem 2.1

Two persons shoot at a target, each has nn shots. Using generating functions, find the probability pp that they have the same number of successes, given that each of them has a probability 0.50.5 of success (hitting the target) at each shot.

?
Problem 2.2

To obtain the title of champion in chess, an opponent has to win at least 12.512.5 points out of the maximum of 2424. In the case of a tie (12:1212:12), the defending champion maintains the title. The probability that each of the two players wins a game is the same, and equals half the probability of a tie. Find:

?
(a)

the probability pchp_{\mathrm{ch}} that the defending champion will maintain his title, as well as the probability popp_{\mathrm{op}} that the opponent will become the champion;

(b)

the probability pp that 2020 games will be played in the contest.

Problem 2.3

In a lottery, tickets are numbered from 000000000000 to 999999999999 and they are all equally probable. What is the probability pp that the sum of the digits of a chosen number be 2121?

?
Problem 2.4

Prove that the Pascal distribution, for r→∞r \to \infty and rq→λrq \to \lambda, converges to the Poisson with parameter λ\lambda.

?
Problem 2.5

Let X,Y,ZX, Y, Z be independent random variables, each taking the values 1,2,…,n1, 2, \ldots , n with the same probability (uniformly). Find P(X+Y=2Z)\mathbb {P}\left(X + Y = 2Z\right) from their joint generating function G(t1,t2,t3)G(t_{1}, t_{2}, t_{3}).

?
Problem 2.6

In Exercise 315, let

qn,k=P(Sn≤k). q_{n,k} = \mathbb {P}\left(S_{n} \leq k\right).

Find the generating function Q(t)Q(t) of qn,kq_{n,k} for a given nn and hence qn,kq_{n,k}.

?
Problem 2.7

(Continuation of Problem 2.6.) Suppose kk and mm tend to infinity so that k/m→xk/m \to x. Find the limit of qn,kq_{n,k}.

?
Problem 2.8

Find the densities of the distributions with characteristic functions

φ1(t)=1+it1+t2,φ2(t)=1−it1+t2. \varphi _{1}(t) = \frac{1+it}{1+t^{2}}, \qquad \varphi _{2}(t) = \frac{1-it}{1+t^{2}}.
?
Problem 2.9

Find the moments of the Laplace distribution with characteristic function

φ(t)=11+t2. \varphi (t) = \frac{1}{1+t^{2}}.
?
Problem 2.10

Determine the distribution with characteristic function

φ(t)=12e−it−1. \varphi (t) = \frac{1}{2e^{-it} - 1}.
?
Problem 2.11

Find the characteristic function of Y=aF(X)+bY = aF(X) + b, where XX is a continuous random variable and FF is its distribution function.

?
Problem 2.12

A vector ξ=(X1,…,Xn)\xi = (X_{1}, \ldots , X_{n}) follows the nn-dimensional normal distribution with E[Xi]=a\mathbb {E}\left[X_{i}\right] = a, Var⁡[Xi]=σ2\operatorname {Var}\left[X_{i}\right] = \sigma^{2} (i=1,…,n)(i = 1, \ldots , n) and covariances

Cov⁡[Xi,Xi+1]=ρσ2,i=1,2,…,n−1, \operatorname {Cov}\left[ X_{i}, X_{i+1} \right] = \rho \sigma ^{2}, \qquad i = 1, 2, \ldots , n-1, Cov⁡[Xi,Xj]=0for∣i−j∣>1. \operatorname {Cov}\left[ X_{i}, X_{j} \right] = 0 \qquad \text{for} \quad \left|i-j\right| > 1.

Find the characteristic function of ξ\xi.

?
Problem 2.13

Let φ(t)\varphi (t) be the characteristic function of a random variable XX with E[X2]=μ2′\mathbb {E}\left[X^{2}\right] = \mu_{2}'.

?
(a)

Prove that

ψ(t)=−1μ2′φ′′(t) \psi (t) = -\frac{1}{\mu _{2}'}\varphi ''(t)

is a characteristic function.

(b)

Conclude that

ψ0(t)=(1−t2)e−t2/2 \psi _{0}(t) = (1-t^{2})e^{-t^{2}/2}

is a characteristic function.

Problem 2.14

Show that

a(t)={1−(∣t∣/π),for ∣t∣<π,0,for ∣t∣>π, a(t) = \begin{cases} 1 - (\left|t\right|/\pi ), & \text{for } \left|t\right| < \pi , \\ 0, & \text{for } \left|t\right| > \pi , \end{cases}

is the characteristic function of a random variable XX, and determine the corresponding distribution.

?
Problem 2.15

Let X1,X2,X3X_{1}, X_{2}, X_{3} be independent N(0,1)\mathscr {N}\left(0, 1\right). Find the characteristic function of the pair Z1,Z2Z_{1}, Z_{2}, where

Z1=X2X3,Z2=X1X3. Z_{1} = X_{2}X_{3}, \qquad Z_{2} = X_{1}X_{3}.

Hence conclude the characteristic function of Z1Z_{1}. Are Z1,Z2Z_{1}, Z_{2} independent?

?
Problem 2.16

Find the distributions corresponding to the characteristic functions

φ1(t)=1cosh⁡t,φ2(t)=1sinh⁡t,φ3(t)=1cosh⁡2t. \varphi _{1}(t) = \frac{1}{\cosh t}, \qquad \varphi _{2}(t) = \frac{1}{\sinh t}, \qquad \varphi _{3}(t) = \frac{1}{\cosh ^{2} t}.
?
Problem 2.17

Show that

P(s1,s2)=p0r(1−p1s1−p2s2)−r, P(s_{1}, s_{2}) = p_{0}^{r}(1 - p_{1}s_{1} - p_{2}s_{2})^{-r},

with positive parameters and p0+p1+p2=1p_{0} + p_{1} + p_{2} = 1 is the probability generating function of a pair (X,Y)(X, Y), so that the marginal distributions of XX and YY and X+YX + Y are negative binomials.

?
Problem 2.18

Let a ``round'' consist of a sequence of Bernoulli trials before the first failure. Find the generating function and the probability function of the total number SkS_{k} of successes in kk rounds.

?
Problem 2.19

(Continuation of Problem 2.18.) Let GG be the number of successive rounds up to the nnth success (i.e., the nnth success occurs during the GGth round). Find the distribution of GG and the

E[G],Var⁡[G]. \mathbb {E}\left[G\right], \operatorname {Var}\left[G\right].
?
Problem 2.20

(Continuation of Problem 2.19.) Consider two independent sequences of Bernoulli variables with parameters p1p_{1} and p2p_{2}, respectively, or two players with ``skills'' p1p_{1} and p2p_{2}, respectively. Prove that each player will need the same number of rounds (trials) until the NNth success (a tie) with probability

(p1p2)N∑v=1∞(N+v−2v−1)(q1q2)v−1 (p_{1}p_{2})^{N} \sum _{v=1}^{\infty } \binom {N+v-2}{v-1}(q_{1}q_{2})^{v-1} =(p1p2)N(1−q1q2)1−2N∑k=0N−1(N−1k)(q1q2)k. = (p_{1}p_{2})^{N}(1 - q_{1}q_{2})^{1-2N} \sum _{k=0}^{N-1} \binom {N-1}{k}(q_{1}q_{2})^{k}.
?
Problem 2.21

Show that the characteristic function of the β\beta density (2.10) is

Γ(p+q)Γ(p)∑j=0∞Γ(p+j)(it)jΓ(p+q+j)Γ(j+1). \frac{\Gamma (p+q)}{\Gamma (p)} \sum _{j=0}^{\infty } \frac{\Gamma (p+j)(it)^{j}}{\Gamma (p+q+j)\Gamma (j+1)}.

Formula (2.10), the beta density on (0,1)(0,1) with parameters p,q>0p, q > 0:

f(x)=Γ(p+q)Γ(p)Γ(q)xp−1(1−x)q−1,0<x<1. f(x) = \frac{\Gamma (p+q)}{\Gamma (p)\Gamma (q)} x^{p-1}(1-x)^{q-1}, \qquad 0 < x < 1.
?
Problem 2.22

Show that the characteristic function of the density in Problem 1.13 is of the form φ(t12+t22+⋯+tn2)\varphi (t_{1}^{2} + t_{2}^{2} + \cdots + t_{n}^{2}) (see Problem 1.21). If

φ(t12+⋯+tn2)=∏i=1nφ(ti2),(*) \varphi (t_{1}^{2} + \cdots + t_{n}^{2}) = \prod _{i=1}^{n} \varphi (t_{i}^{2}), \tag {*}

that is, X1,X2,…,XnX_{1}, X_{2}, \ldots , X_{n} are independent, prove that X→\overrightarrow {X} is N(0,I)\mathscr {N}\left(0, I\right). In other words, a spherically symmetric random vector has independent components if and only if it is multivariate normal.

?