Chapter II

Processes with Independent Increments. Poisson and Gaussian Processes

[25/0%]
Show
LaTeX
Problem II.1

Find the covariance function of a Poisson process with constant intensity λ\lambda. Compare the answer obtained with the covariance function of the Wiener process.

?
Problem II.2

Let r=r(s,t)r = r(s, t) be a nonnegative definite function (s,t∈T(s, t \in T, where TT is some set). Does there exist a non-Gaussian process X={Xt,t∈T}X = \left\{ X_{t}, t \in T\right\} such that cov⁡(Xs,Xt)=r(s,t)\operatorname {cov}\left(X_{s}, X_{t}\right) = r(s, t) for all s,t∈Ts, t \in T ?

?
Problem II.3

Prove that if Pn(z1,…,zm)P_{n}\left(z_{1}, \ldots , z_{m}\right) is a polynomial of degree nn (in mm variables) with positive coefficients and rk(s,t)(k=1,…,m;s,t∈T)r_{k}(s, t)(k = 1, \ldots , m ; s, t \in T) are covariance functions, then Pn(r1(s,t),…,rm(s,t))P_{n}\left(r_{1}(s, t), \ldots , r_{m}(s, t)\right) is also a covariance function.

?
Problem II.4

For an L2L^{2}-process X={Xt,t∈T}X = \left\{ X_{t}, t \in T\right\} defined on (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}), denote by L2[X]L^{2}[X] the closure in the space L2(Ω,F,P)L^{2}(\Omega , \mathscr {F}, \mathbb {P}) of the linear span of all the variables XtX_{t}, t∈Tt \in T. Prove that if XX is a Gaussian process, then L2[X]L^{2}[X] is a Gaussian system, i.e., for any n∈Nn \in \mathbb {N} and any Y1,…,Yn∈L2[X]Y_{1}, \ldots , Y_{n} \in L^{2}[X] the vector (Y1,…,Yn)\left(Y_{1}, \ldots , Y_{n}\right) has a Gaussian distribution.

?
Problem II.5

(self-similarity property). Let W={W(t),t⩾0}W = \left\{ W(t), t \geqslant 0\right\} be a Wiener process and cc a positive constant. Prove that the process X={X(t)=1cW(ct),t⩾0}X = \left\{ X(t) = \frac{1}{\sqrt{c}} W(c t), t \geqslant 0\right\} is a Wiener process.

?
Problem II.6

Prove Theorem 8 by verifying the original definition of the Wiener process, i.e., prove that the process given by formula (31) has independent increments. By Doob's theorem (see Appendix 5), this process with continuous sample paths will automatically be Gaussian.

Theorem 8. Let {ξk}k⩾1\left\{ \xi_{k}\right\}_{k \geqslant 1} be a sequence of independent random variables having the standard normal distribution N(0,1)\mathscr {N}\left(0, 1\right) and defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}). The Haar functions Hk(t)H_{k}(t), t∈[0,1]t \in [0,1], k=1,2,…k = 1, 2, \ldots, are given by the formulas H1(t)≡1H_{1}(t) \equiv 1, H2(t)=1[0,1/2](t)−1(1/2,1](t)H_{2}(t) = \mathbf{1}_{[0,1 / 2]}(t)-\mathbf{1}_{(1 / 2,1]}(t), and for 2n<k⩽2n+12^{n} < k \leqslant 2^{n+1}

Hk(t)=2n/2(1In,k(t)−1Jn,k(t)), H_{k}(t) = 2^{n / 2}\left(\mathbf{1}_{I_{n, k}}(t)-\mathbf{1}_{J_{n, k}}(t)\right),

where In,k=[an,k,an,k+2−n−1]I_{n, k} = \left[a_{n, k}, a_{n, k}+2^{-n-1}\right], Jn,k=(an,k+2−n−1,an,k+2−n]J_{n, k} = \left(a_{n, k}+2^{-n-1}, a_{n, k}+2^{-n}\right], an,k=2−n(k−2n−1)a_{n, k} = 2^{-n}\left(k-2^{n}-1\right), n∈Nn \in \mathbb {N}; the Schauder functions are Sk(t)=∫0tHk(y) dyS_{k}(t) = \int_{0}^{t} H_{k}(y)\, d y, t∈[0,1]t \in [0,1], k∈Nk \in \mathbb {N}. Formula (31) is the equality

W(t,ω)=∑k=1∞ξk(ω)Sk(t),t∈[0,1], ω∈Ω,(31) W(t, \omega ) = \sum _{k=1}^{\infty } \xi _{k}(\omega ) S_{k}(t), \quad t \in [0,1], \ \omega \in \Omega , \tag {31}

and Theorem 8 asserts that W={W(t),t∈[0,1]}W = \left\{ W(t), t \in [0,1]\right\} is a Wiener process on [0,1][0,1] which, moreover, has continuous sample paths with probability one.

Definition 3. A Wiener process, or Brownian motion, is a stochastic process W={W(t),t⩾0}W = \left\{ W(t), t \geqslant 0\right\} such that

  1. W(0)=0W(0) = 0 a.s.;

  2. the process WW has independent increments;

  3. the variables W(t)−W(s)∼N(0,t−s)W(t)-W(s) \sim \mathscr {N}\left(0, t-s\right) for all 0⩽s<t<∞0 \leqslant s < t < \infty, i.e., the variables W(t)−W(s)W(t)-W(s) have the Gaussian (normal) distribution with parameters 0 and t−st-s.

Doob's theorem (Theorem 14 of Chapter V). Let a process X={Xt,t⩾0}X = \left\{ X_{t}, t \geqslant 0\right\} take values in Rm\mathbb {R}^{m} for each tt and have independent increments. If the sample paths of the process are continuous a.s., then the process Y={Yt=Xt−X0,t⩾0}Y = \left\{ Y_{t} = X_{t}-X_{0}, t \geqslant 0\right\} is Gaussian.

?
Problem II.7

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Prove that if S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} is a recurrent random walk in Rm\mathbb {R}^{m}, then for every k∈Nk \in \mathbb {N} the walk S(k)={Snk,n⩾0}S^{(k)} = \left\{ S_{n k}, n \geqslant 0\right\} is recurrent as well.

?
Problem II.8

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Let the random variable ξ1\xi_{1} have a symmetric stable distribution on R\mathbb {R} with exponent α∈(0,2]\alpha \in (0,2], i.e., let

f(t)=E[eitξ1]=e−c∣t∣α,t∈R,c>0 f(t) = \mathbb {E}\left[e^{i t \xi _{1}}\right] = e^{-c\left|t\right|^{\alpha }}, \quad t \in \mathbb {R}, \quad c > 0

Prove that such an α\alpha-stable random walk is recurrent for α⩾1\alpha \geqslant 1 and transient for α<1\alpha < 1.

?
Problem II.9

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Let S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} be a random walk in Rm(m⩾2)\mathbb {R}^{m}(m \geqslant 2) such that the components of the vector ξ1\xi_{1} are independent and have an α\alpha-stable distribution (see Exercise 8). Investigate for which values of α\alpha the random walk is recurrent and for which it is transient.

?
Problem II.10

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

The symmetrization of a random walk S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in Rm\mathbb {R}^{m} is a sequence S~={S~n,n⩾0}\widetilde{S} = \left\{ \widetilde{S}_{n}, n \geqslant 0\right\} with the same distribution as {Sn−Sn′,n⩾0}\left\{ S_{n}-S_{n}^{\prime }, n \geqslant 0\right\}, where Sn′={Sn′,n⩾0}S_{n}^{\prime } = \left\{ S_{n}^{\prime }, n \geqslant 0\right\} is an independent copy of the sequence {Sn}\left\{ S_{n}\right\} (one may assume that for this purpose an independent copy {ξn′,n⩾0}\left\{ \xi_{n}^{\prime }, n \geqslant 0\right\} of the sequence {ξn,n⩾0}\left\{ \xi_{n}, n \geqslant 0\right\} is constructed and S0′=0,Sn′=∑j=1nξj′,n∈NS_{0}^{\prime } = 0, S_{n}^{\prime } = \sum_{j = 1}^{n} \xi_{j}^{\prime }, n \in \mathbb {N}).

Prove that if the random walk S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} is recurrent, then the symmetrized random walk S~={S~n,n⩾0}\widetilde{S} = \left\{ \widetilde{S}_{n}, n \geqslant 0\right\} is recurrent as well.

?
Problem II.11

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Prove that a random walk S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in Rm\mathbb {R}^{m} is recurrent if

?
(a)

n−1Sn→P0n^{-1} S_{n} \xrightarrow {\mathbb {P}} 0 as n→∞n \rightarrow \infty, when m=1m = 1;

(b)

E[ξ1]=0\mathbb {E}\left[\xi_{1}\right] = 0 and E[∣ξ1∣2]<∞\mathbb {E}\left[\left|\xi_{1}\right|^{2}\right] < \infty, when m=2m = 2.

Construct examples showing that these sufficient conditions for recurrence are not necessary.

Problem II.12

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Definition 16. The support of an arbitrary measure λ\lambda on the Borel σ\sigma-algebra of a topological space S\mathrm{S} is the smallest closed set F⊂SF \subset \mathrm{S} such that λ(S\F)=0\lambda (\mathrm{S} \backslash F) = 0.

Let S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} be a random walk in R\mathbb {R}, where ξ1\xi_{1} has a symmetric nondegenerate distribution with bounded support. Prove that such a random walk is recurrent.

?
Problem II.13

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

Definition 16. The support of an arbitrary measure λ\lambda on the Borel σ\sigma-algebra of a topological space S\mathrm{S} is the smallest closed set F⊂SF \subset \mathrm{S} such that λ(S\F)=0\lambda (\mathrm{S} \backslash F) = 0.

Definition 17. The effective dimension of the random walk (I.9) is the dimension of the subspace of Rm\mathbb {R}^{m} generated by the linear span of the support of the measure Pξ1\mathbb {P}_{\xi_{1}}.

Prove that if the effective dimension of a random walk is at least three, then this random walk is transient.

?
Problem II.14

Consider the random walk in Rm\mathbb {R}^{m} from Example 1 of Chapter I, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors. We assume S0=0S_{0} = 0.

Example 1 of Chapter I. Let ξ0,ξ1,…\xi_{0}, \xi_{1}, \ldots be independent random vectors defined on some probability space (Ω,F,P)(\Omega , \mathscr {F}, \mathbb {P}) and taking values in the space Rm\mathbb {R}^{m} (m⩾1m \geqslant 1). The (discrete-time) stochastic process

Sn=∑j=0nξj,n∈Z+={0,1,…},(I.9) S_{n} = \sum _{j = 0}^{n} \xi _{j}, \quad n \in \mathbb {Z}_{+} = \left\{ 0,1, \ldots \right\} , \tag {I.9}

is customarily called a random walk.

Definition 13. The (random) occupation measure of the process S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\} in a Borel set BB of Rm\mathbb {R}^{m} is the quantity

μ(B)=∑n⩾01{Sn∈B} \mu (B) = \sum _{n \geqslant 0} \mathbf{1}_{\left\{ S_{n} \in B\right\} }

The intensity measure ν=ν(⋅)\nu = \nu (\cdot ) corresponding to this measure μ=μ(⋅)\mu = \mu (\cdot ) is defined by the formula

ν(B)=E[μ(B)]=∑n⩾0P(Sn∈B),B∈B(Rm) \nu (B) = \mathbb {E}\left[\mu (B)\right] = \sum _{n \geqslant 0} \mathbb {P}\left(S_{n} \in B\right), \quad B \in \mathscr {B}\left(\mathbb {R}^{m}\right)

Definition 14. Denoting by Vε(x)V_{\varepsilon }(x) the open ball in Rm\mathbb {R}^{m} with center at the point xx and radius ε>0\varepsilon > 0, we introduce the following sets:

R=⋂ε>0{x∈Rm:μ(Vε(x))=∞} — the recurrence set, M=⋂ε>0{x∈Rm:ν(Vε(x))=∞} — the mean recurrence set, A=⋂ε>0{x∈Rm:ν(Vε(x))>0} — the reachability set.  \begin{aligned} R & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \mu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the recurrence set, } \\ M & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) = \infty \right\} \text{ — the mean recurrence set, } \\ A & = \bigcap _{\varepsilon > 0}\left\{ x \in \mathbb {R}^{m}: \nu \left(V_{\varepsilon }(x)\right) > 0\right\} \text{ — the reachability set. } \end{aligned}

Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk SS in Rm\mathbb {R}^{m} defined according to (I.9), only one of the following two possibilities is realized:

  1. R=M=AR = M = A and this set is a closed subgroup of Rm\mathbb {R}^{m},

  2. R=M=∅R = M = \varnothing and ∣Sn∣→∞\left|S_{n}\right| \rightarrow \infty a.s. as n→∞n \rightarrow \infty.

Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.

We call a walk in Rm\mathbb {R}^{m} the simple symmetric random walk if

P(ξ1=ei)=P(ξ1=−ei)=(2m)−1,i=1,…,m \mathbb {P}\left(\xi _{1} = e_{i}\right) = \mathbb {P}\left(\xi _{1} = -e_{i}\right) = (2 m)^{-1}, \quad i = 1, \ldots , m

where the ii-th coordinate of the vector eie_{i} equals 1, and the other coordinates equal 0. This walk can be regarded as a model of the motion of a "particle" that, with equal probability, moves by one unit in either direction along any coordinate axis.

The result of Exercise 13 implies the well-known Pólya criterion (see [78; vol. 1, p. 374]) stating that the simple symmetric random walk in Rm\mathbb {R}^{m} is non-recurrent for m⩾3m \geqslant 3. It is also proved there ([78]) that for m=1m = 1 and m=2m = 2 such a walk is recurrent.

(compare with the result on random walks given above). Prove that the sample paths of a particle performing the simple symmetric random walk in Rm\mathbb {R}^{m} have, with probability 1, infinitely many self-intersections, i.e., with probability 1 the particle will return to positions that it occupied earlier.

?
Problem II.15

Consider the random walk in Rm\mathbb {R}^{m}, i.e., the process of partial sums S={Sn,n⩾0}S = \left\{ S_{n}, n \geqslant 0\right\}, where Sn=S0+ξ1+⋯+ξn,n⩾1S_{n} = S_{0}+\xi_{1}+\cdots +\xi_{n}, n \geqslant 1, and ξ1,ξ2,…\xi_{1}, \xi_{2}, \ldots are independent identically distributed vectors.

Prove that if P(ξ1≠0)>0\mathbb {P}\left(\xi_{1} \neq 0\right) > 0, then the one-dimensional random walk exits every strip (a,b)(a, b) with boundaries a<0<ba < 0 < b with probability one (recall that S0=0S_{0} = 0 ).

?
Problem II.16

Let X={Xt,t∈[a,b]}X = \left\{ X_{t}, t \in [a, b]\right\} be a real process that is stochastically continuous at every point t∈[a,b]t \in [a, b]. Then the process XX is uniformly stochastically continuous on [a,b][a, b], i.e. for any ε,γ>0\varepsilon , \gamma > 0 there exists Δ=Δ(ε,γ)>0\Delta = \Delta (\varepsilon , \gamma ) > 0 such that

P(∣Xt−Xs∣⩾ε)⩽γ, if ∣s−t∣⩽Δ,s,t∈[a,b].  \mathbb {P}\left(\left|X_{t}-X_{s}\right| \geqslant \varepsilon \right) \leqslant \gamma , \text{ if }\left|s-t\right| \leqslant \Delta , \quad s, t \in [a, b] \text{. }

Moreover, the process XX is bounded in probability, i.e.

lim⁡c→∞sup⁡t∈[a,b]P(∣Xt∣⩾c)=0 \lim _{c \rightarrow \infty } \sup _{t \in [a, b]} \mathbb {P}\left(\left|X_{t}\right| \geqslant c\right) = 0
?
Problem II.17

(Ottaviani's inequality). Let Y1,…,YnY_{1}, \ldots , Y_{n} be independent real random variables such that for some α∈[0,1),r⩾0\alpha \in [0,1), r \geqslant 0

P(∣Sn−Sk∣⩾r)⩽α for k=1,…,n,  \mathbb {P}\left(\left|S_{n}-S_{k}\right| \geqslant r\right) \leqslant \alpha \text{ for } k = 1, \ldots , n \text{, }

where Sk=∑j=1kYjS_{k} = \sum_{j = 1}^{k} Y_{j}. Prove that for all c⩾0c \geqslant 0

P(max⁡1⩽k⩽n∣Sk∣⩾r+c)⩽11−αP(∣Sn∣⩾c) \mathbb {P}\left(\max _{1 \leqslant k \leqslant n}\left|S_{k}\right| \geqslant r+c\right) \leqslant \frac{1}{1-\alpha } \mathbb {P}\left(\left|S_{n}\right| \geqslant c\right)
?
Problem II.18

Let a process X={Xt,t∈[0,∞)}X = \left\{ X_{t}, t \in [0, \infty )\right\} have independent increments and be stochastically continuous on [0,∞)[0, \infty ). Prove that

P(sup⁡t∈M∩[0,∞)∣Xt∣<∞)=1 \mathbb {P}\left(\sup _{t \in M \cap [0, \infty )}\left|X_{t}\right| < \infty \right) = 1

where MM is the set of dyadic rational points of the line.

?
Problem II.19

Prove that the Poisson process is stochastically continuous on [0,∞)[0, \infty ).

?
Problem II.20

Show how Lévy's formula is derived from Khinchin's formula and vice versa. What is the relation between the parameters a,νa, \nu and b,σ2,ν~b, \sigma^{2}, \widetilde{\nu } ?

Theorem 14 (Khinchin's formula; see, e.g., [39; Part 1, §16]). Let a stochastically continuous real process X={Xt,t⩾0}X = \left\{ X_{t}, t \geqslant 0\right\} have independent increments. Then for any t⩾0t \geqslant 0 and all λ∈R\lambda \in \mathbb {R} the characteristic function

E[exp(iλXt)]=exp(t(iaλ+∫−∞∞g(λ,x)ν(dx)))(41) \mathbb {E}\left[\mathrm{exp}\left(i \lambda X_{t}\right)\right] = \mathrm{exp}\left(t\left(i a \lambda +\int _{-\infty }^{\infty } g(\lambda , x) \nu (d x)\right)\right) \tag {41}

where a∈Ra \in \mathbb {R}, ν\nu is a finite measure on B(R)\mathscr {B}(\mathbb {R}) and

g(λ,x)={(exp(iλx)−1−iλsin⁡x)(1+x2)/x2,x≠0−λ2/2,x=0(42) g(\lambda , x) = \begin{cases} (\mathrm{exp}\left(i \lambda x\right)-1-i \lambda \sin x)\left(1+x^{2}\right) / x^{2}, & x \neq 0 \\ -\lambda ^{2} / 2, & x = 0 \end{cases} \tag {42}

Moreover, the representation (41) is unique, i.e. in this formula the number aa and the measure ν\nu are uniquely determined.

Theorem 15 (Lévy's formula; see, e.g., [39; Part 1, §16]). If the conditions of the previous theorem hold, then for any t⩾0t \geqslant 0 and all λ∈R\lambda \in \mathbb {R}

E[exp(iλXt)]=exp(t(ibλ−σ2λ22+∫−∞∞(eiλx−1−iλsin⁡x)ν~(dx)))(43) \mathbb {E}\left[\mathrm{exp}\left(i \lambda X_{t}\right)\right] = \mathrm{exp}\left(t\left(i b \lambda -\frac{\sigma ^{2} \lambda ^{2}}{2}+\int _{-\infty }^{\infty }\left(e^{i \lambda x}-1-i \lambda \sin x\right) \widetilde{\nu }(d x)\right)\right) \tag {43}

where b∈R,σ⩾0,ν~b \in \mathbb {R}, \sigma \geqslant 0, \widetilde{\nu } is a measure on B(R)\mathscr {B}(\mathbb {R}) (taking, generally speaking, infinite values) such that

ν~({0})=0,∫−∞∞x21+x2ν~(dx)<∞(44) \widetilde{\nu }(\left\{ 0\right\} ) = 0, \quad \int _{-\infty }^{\infty } \frac{x^{2}}{1+x^{2}} \widetilde{\nu }(d x) < \infty \tag {44}

Moreover, b,σb, \sigma and ν~\widetilde{\nu }, appearing in the representation (44), are uniquely determined.

?
Problem II.21

What does Lévy's formula look like for the process Wx(t)=x+W(t),t⩾0W_{x}(t) = x+W(t), t \geqslant 0, where W={W(t),t⩾0}W = \left\{ W(t), t \geqslant 0\right\} is a Wiener process and x∈Rx \in \mathbb {R}?

Theorem 14 (Khinchin's formula; see, e.g., [39; Part 1, §16]). Let a stochastically continuous real process X={Xt,t⩾0}X = \left\{ X_{t}, t \geqslant 0\right\} have independent increments. Then for any t⩾0t \geqslant 0 and all λ∈R\lambda \in \mathbb {R} the characteristic function

E[exp(iλXt)]=exp(t(iaλ+∫−∞∞g(λ,x)ν(dx)))(41) \mathbb {E}\left[\mathrm{exp}\left(i \lambda X_{t}\right)\right] = \mathrm{exp}\left(t\left(i a \lambda +\int _{-\infty }^{\infty } g(\lambda , x) \nu (d x)\right)\right) \tag {41}

where a∈Ra \in \mathbb {R}, ν\nu is a finite measure on B(R)\mathscr {B}(\mathbb {R}) and

g(λ,x)={(exp(iλx)−1−iλsin⁡x)(1+x2)/x2,x≠0−λ2/2,x=0(42) g(\lambda , x) = \begin{cases} (\mathrm{exp}\left(i \lambda x\right)-1-i \lambda \sin x)\left(1+x^{2}\right) / x^{2}, & x \neq 0 \\ -\lambda ^{2} / 2, & x = 0 \end{cases} \tag {42}

Moreover, the representation (41) is unique, i.e. in this formula the number aa and the measure ν\nu are uniquely determined.

Theorem 15 (Lévy's formula; see, e.g., [39; Part 1, §16]). If the conditions of the previous theorem hold, then for any t⩾0t \geqslant 0 and all λ∈R\lambda \in \mathbb {R}

E[exp(iλXt)]=exp(t(ibλ−σ2λ22+∫−∞∞(eiλx−1−iλsin⁡x)ν~(dx)))(43) \mathbb {E}\left[\mathrm{exp}\left(i \lambda X_{t}\right)\right] = \mathrm{exp}\left(t\left(i b \lambda -\frac{\sigma ^{2} \lambda ^{2}}{2}+\int _{-\infty }^{\infty }\left(e^{i \lambda x}-1-i \lambda \sin x\right) \widetilde{\nu }(d x)\right)\right) \tag {43}

where b∈R,σ⩾0,ν~b \in \mathbb {R}, \sigma \geqslant 0, \widetilde{\nu } is a measure on B(R)\mathscr {B}(\mathbb {R}) (taking, generally speaking, infinite values) such that

ν~({0})=0,∫−∞∞x21+x2ν~(dx)<∞(44) \widetilde{\nu }(\left\{ 0\right\} ) = 0, \quad \int _{-\infty }^{\infty } \frac{x^{2}}{1+x^{2}} \widetilde{\nu }(d x) < \infty \tag {44}

Moreover, b,σb, \sigma and ν~\widetilde{\nu }, appearing in the representation (44), are uniquely determined.

?
Problem II.22

Definition 18. The Skorokhod space D[0,∞)D[0, \infty ) is the collection of real functions defined on [0,∞)[0, \infty ) that are right-continuous and have finite limits from the left at every point t∈(0,∞)t \in (0, \infty ).

Functions from this space are often called càdlàg functions (from the French continue à droite, limite à gauche — right-continuous, having a limit from the left; the notation rcll\mathrm{rcll} is also used, originating from the analogous English term: right continuous, left-hand limits).

By analogy with the case m=1m = 1, one introduces the notion of a càdlàg function f:R+→Rmf: \mathbb {R}_{+} \rightarrow \mathbb {R}^{m}.

Definition 19. A stochastic process X={Xt,t⩾0}X = \left\{ X_{t}, t \geqslant 0\right\} with values in Rm\mathbb {R}^{m} is said to be a càdlàg process if its sample paths are (a.e.) càdlàg functions. A process XX has a jump at a fixed point t>0t > 0 if

P(Xt≠Xt−)>0, where Xt−(ω)=lim⁡s↑tXs(ω) \mathbb {P}\left(X_{t} \neq X_{t-}\right) > 0, \quad \text{ where } \quad X_{t-}(\omega ) = \lim _{s \uparrow t} X_{s}(\omega )

Let X={Xt,t⩾0}X = \left\{ X_{t}, t \geqslant 0\right\} be a stochastically continuous process with independent increments taking values in Rm\mathbb {R}^{m}. Prove that XX has a càdlàg modification having no jumps at fixed times (cf. Theorem 13).

Theorem 13. A process with independent increments that is stochastically continuous on [0,∞)[0, \infty ) has a modification with sample paths in the space D[0,∞)D[0, \infty ).

?
Problem II.23

Show that if one sets ε=0\varepsilon = 0 in condition (52), then the assertion of Theorem 18 , generally speaking, need not hold.

Theorem 18 (see, e.g., [12; p. 124]). Let X={X(t),t∈[a,b]}X = \left\{ X(t), t \in [a, b]\right\} be a real stochastic process such that for some α,ε>0\alpha , \varepsilon > 0 and C=C(α,ε)>0C = C(\alpha , \varepsilon ) > 0

E[∣X(t)−X(s)∣α]⩽C∣t−s∣1+ε for s,t∈[a,b].(52) \mathbb {E}\left[\left|X(t)-X(s)\right|^{\alpha }\right] \leqslant C\left|t-s\right|^{1+\varepsilon } \quad \text{ for } \quad s, t \in [a, b] . \tag {52}

Then the process XX has a continuous modification.

?
Problem II.24

Let a random field X={X(t),t∈[0,1]d}X = \left\{ X(t), t \in [0,1]^{d}\right\} with values, for each t∈Tt \in T, in a Polish space (S,ρ)(\mathrm{S}, \rho ) satisfy, for some nondecreasing positive continuous function ff on R+\mathbb {R}_{+} and p⩾1p \geqslant 1, the conditions

E[(ρ(X(t),X(s)))p]⩽fp(∥t−s∥),∫+∞f(x−p/d)dx<+∞ \begin{gathered} \mathbb {E}\left[(\rho (X(t), X(s)))^{p}\right] \leqslant f^{p}(\left\| t-s\right\| ), \\ \int ^{+\infty } f\left(x^{-p / d}\right) d x < +\infty \end{gathered}

where the integral is taken in a neighborhood of +∞+\infty. Prove that then the random field XX has a continuous modification (use Theorem 20 ).

Recall that for a set U⊂T(UU \subset T(U may coincide with T)T), where (T,δ)(T, \delta ) is a pseudometric space, an ε\varepsilon-net is a set Sε⊂TS_{\varepsilon } \subset T such that for every t∈Ut \in U there exists an element s∈Sεs \in S_{\varepsilon } for which δ(s,t)⩽ε\delta (s, t) \leqslant \varepsilon. In other words, UU is covered by the closed balls

Bε(s)={t∈T:δ(s,t)⩽ε},s∈Sε(53) B_{\varepsilon }(s) = \left\{ t \in T: \delta (s, t) \leqslant \varepsilon \right\} , \quad s \in S_{\varepsilon } \tag {53}

If UU has a finite ε\varepsilon-net, then we call a minimal ε\varepsilon-net any of its ε\varepsilon-nets Sεmin⁡(U)S_{\varepsilon }^{\min }(U) such that (Sεmin⁡(U))\left(S_{\varepsilon }^{\min }(U)\right) is minimal, where (V)(V) denotes the number of elements of a finite set VV. Put Nδ(ε,U)=#(Sεmin⁡(U))N_{\delta }(\varepsilon , U) = \# \left(S_{\varepsilon }^{\min }(U)\right), emphasizing the dependence on the pseudometric δ\delta as well.

In order to introduce more general moment conditions on the random function XX, consider a positive strictly increasing convex function ψ\psi defined on R+=[0,∞)\mathbb {R}_{+} = [0, \infty ) and such that ψ(0)⩽1\psi (0) \leqslant 1. Denote the inverse function of ψ\psi by Φ\Phi.

Theorem 20 (see [79]). Let X={X(t),t∈T}X = \left\{ X(t), t \in T\right\} be a random function with values in a Polish space ( S,ρ\mathrm{S}, \rho ) for each t∈Tt \in T, defined on some ( Ω,F,P)\Omega , \mathscr {F}, \mathbb {P}) and a pseudometric space (T,δ)(T, \delta ), such that for some M>0M > 0

E[ψ(ρ(X(t),X(s))/δ(t,s))]⩽M for s,t∈T, if δ(t,s)≠0(60) \mathbb {E}\left[\psi (\rho (X(t), X(s)) / \delta (t, s))\right] \leqslant M \quad \text{ for } \quad s, t \in T, \quad \text{ if } \quad \delta (t, s) \neq 0 \tag {60}

and ρ(X(t),X(s))=0\rho (X(t), X(s)) = 0 a.s., if δ(t,s)=0\delta (t, s) = 0. Suppose also that

∫+0Φ(Nδ(T,ε))dε<∞(61) \int _{+0} \Phi \left(N_{\delta }(T, \varepsilon )\right) d \varepsilon < \infty \tag {61}

where the integral is taken over the positive part of some neighborhood of zero. Then the random function XX has a continuous modification.

?
Problem II.25

Let (T,δ)(T, \delta ) be a pseudometric space, DU:=sup⁡{δ(s,t):s,t∈U}D_{U}: = \sup \left\{ \delta (s, t): s, t \in U\right\} the diameter of a set U⊂TU \subset T, and let the closed balls be given by the formula

Bε(s)={t∈T:δ(s,t)⩽ε}(53) B_{\varepsilon }(s) = \left\{ t \in T: \delta (s, t) \leqslant \varepsilon \right\} \tag {53}

Definition 21. A probability measure μ\mu defined on the Borel σ\sigma-algebra of the space (T,δ)(T, \delta ) is called majorizing if

sup⁡t∈T∫0∞∣ln⁡μ(Bε(t))∣1/2dε<∞(65) \sup _{t \in T} \int _{0}^{\infty }\left|\ln \mu \left(B_{\varepsilon }(t)\right)\right|^{1 / 2} d \varepsilon < \infty \tag {65}

where Bε(t)B_{\varepsilon }(t) is defined according to (53).

(see [48; p. 182]). Prove that the definition of a majorizing measure is equivalent to the following one. There exist q>1q > 1 and a sequence C={Ck,k∈N}\mathscr {C} = \left\{ \mathscr {C}_{k}, k \in \mathbb {N}\right\} of refining partitions of TT into sets of positive μ\mu-measure such that

sup⁡C∈CkDC⩽2q−k and sup⁡t∈T∑k=1∞q−k∣ln⁡μ(Ck(t))∣1/2<∞ \sup _{C \in \mathscr {C}_{k}} D_{C} \leqslant 2 q^{-k} \text{ and } \sup _{t \in T} \sum _{k = 1}^{\infty } q^{-k}\left|\ln \mu \left(C_{k}(t)\right)\right|^{1 / 2} < \infty

where Ck(t)C_{k}(t) is the (unique) set of the partition Ck\mathscr {C}_{k} that contains the point tt.

?