Processes with Independent Increments. Poisson and Gaussian Processes
[25/0%]Find the covariance function of a Poisson process with constant intensity . Compare the answer obtained with the covariance function of the Wiener process.
Let be a nonnegative definite function , where is some set). Does there exist a non-Gaussian process such that for all ?
Prove that if is a polynomial of degree (in variables) with positive coefficients and are covariance functions, then is also a covariance function.
For an -process defined on , denote by the closure in the space of the linear span of all the variables , . Prove that if is a Gaussian process, then is a Gaussian system, i.e., for any and any the vector has a Gaussian distribution.
(self-similarity property). Let be a Wiener process and a positive constant. Prove that the process is a Wiener process.
Prove Theorem 8 by verifying the original definition of the Wiener process, i.e., prove that the process given by formula (31) has independent increments. By Doob's theorem (see Appendix 5), this process with continuous sample paths will automatically be Gaussian.
Theorem 8. Let be a sequence of independent random variables having the standard normal distribution and defined on some probability space . The Haar functions , , , are given by the formulas , , and for
where , , , ; the Schauder functions are , , . Formula (31) is the equality
and Theorem 8 asserts that is a Wiener process on which, moreover, has continuous sample paths with probability one.
Definition 3. A Wiener process, or Brownian motion, is a stochastic process such that
-
a.s.;
-
the process has independent increments;
-
the variables for all , i.e., the variables have the Gaussian (normal) distribution with parameters 0 and .
Doob's theorem (Theorem 14 of Chapter V). Let a process take values in for each and have independent increments. If the sample paths of the process are continuous a.s., then the process is Gaussian.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Prove that if is a recurrent random walk in , then for every the walk is recurrent as well.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Let the random variable have a symmetric stable distribution on with exponent , i.e., let
Prove that such an -stable random walk is recurrent for and transient for .
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Let be a random walk in such that the components of the vector are independent and have an -stable distribution (see Exercise 8). Investigate for which values of the random walk is recurrent and for which it is transient.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
The symmetrization of a random walk in is a sequence with the same distribution as , where is an independent copy of the sequence (one may assume that for this purpose an independent copy of the sequence is constructed and ).
Prove that if the random walk is recurrent, then the symmetrized random walk is recurrent as well.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Prove that a random walk in is recurrent if
as , when ;
and , when .
Construct examples showing that these sufficient conditions for recurrence are not necessary.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Definition 16. The support of an arbitrary measure on the Borel -algebra of a topological space is the smallest closed set such that .
Let be a random walk in , where has a symmetric nondegenerate distribution with bounded support. Prove that such a random walk is recurrent.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
Definition 16. The support of an arbitrary measure on the Borel -algebra of a topological space is the smallest closed set such that .
Definition 17. The effective dimension of the random walk (I.9) is the dimension of the subspace of generated by the linear span of the support of the measure .
Prove that if the effective dimension of a random walk is at least three, then this random walk is transient.
Consider the random walk in from Example 1 of Chapter I, i.e., the process of partial sums , where , and are independent identically distributed vectors. We assume .
Example 1 of Chapter I. Let be independent random vectors defined on some probability space and taking values in the space (). The (discrete-time) stochastic process
is customarily called a random walk.
Definition 13. The (random) occupation measure of the process in a Borel set of is the quantity
The intensity measure corresponding to this measure is defined by the formula
Definition 14. Denoting by the open ball in with center at the point and radius , we introduce the following sets:
Theorem 10 (dichotomy theorem; see, e.g., [146; p. 137]). For a random walk in defined according to (I.9), only one of the following two possibilities is realized:
-
and this set is a closed subgroup of ,
-
and a.s. as .
Definition 15. A random walk is called recurrent if property 1) holds in Theorem 10 above, and non-recurrent (or transient) if property 2) holds.
We call a walk in the simple symmetric random walk if
where the -th coordinate of the vector equals 1, and the other coordinates equal 0. This walk can be regarded as a model of the motion of a "particle" that, with equal probability, moves by one unit in either direction along any coordinate axis.
The result of Exercise 13 implies the well-known Pólya criterion (see [78; vol. 1, p. 374]) stating that the simple symmetric random walk in is non-recurrent for . It is also proved there ([78]) that for and such a walk is recurrent.
(compare with the result on random walks given above). Prove that the sample paths of a particle performing the simple symmetric random walk in have, with probability 1, infinitely many self-intersections, i.e., with probability 1 the particle will return to positions that it occupied earlier.
Consider the random walk in , i.e., the process of partial sums , where , and are independent identically distributed vectors.
Prove that if , then the one-dimensional random walk exits every strip with boundaries with probability one (recall that ).
Let be a real process that is stochastically continuous at every point . Then the process is uniformly stochastically continuous on , i.e. for any there exists such that
Moreover, the process is bounded in probability, i.e.
(Ottaviani's inequality). Let be independent real random variables such that for some
where . Prove that for all
Let a process have independent increments and be stochastically continuous on . Prove that
where is the set of dyadic rational points of the line.
Prove that the Poisson process is stochastically continuous on .
Show how Lévy's formula is derived from Khinchin's formula and vice versa. What is the relation between the parameters and ?
Theorem 14 (Khinchin's formula; see, e.g., [39; Part 1, §16]). Let a stochastically continuous real process have independent increments. Then for any and all the characteristic function
where , is a finite measure on and
Moreover, the representation (41) is unique, i.e. in this formula the number and the measure are uniquely determined.
Theorem 15 (Lévy's formula; see, e.g., [39; Part 1, §16]). If the conditions of the previous theorem hold, then for any and all
where is a measure on (taking, generally speaking, infinite values) such that
Moreover, and , appearing in the representation (44), are uniquely determined.
What does Lévy's formula look like for the process , where is a Wiener process and ?
Theorem 14 (Khinchin's formula; see, e.g., [39; Part 1, §16]). Let a stochastically continuous real process have independent increments. Then for any and all the characteristic function
where , is a finite measure on and
Moreover, the representation (41) is unique, i.e. in this formula the number and the measure are uniquely determined.
Theorem 15 (Lévy's formula; see, e.g., [39; Part 1, §16]). If the conditions of the previous theorem hold, then for any and all
where is a measure on (taking, generally speaking, infinite values) such that
Moreover, and , appearing in the representation (44), are uniquely determined.
Definition 18. The Skorokhod space is the collection of real functions defined on that are right-continuous and have finite limits from the left at every point .
Functions from this space are often called càdlàg functions (from the French continue à droite, limite à gauche — right-continuous, having a limit from the left; the notation is also used, originating from the analogous English term: right continuous, left-hand limits).
By analogy with the case , one introduces the notion of a càdlàg function .
Definition 19. A stochastic process with values in is said to be a càdlàg process if its sample paths are (a.e.) càdlàg functions. A process has a jump at a fixed point if
Let be a stochastically continuous process with independent increments taking values in . Prove that has a càdlàg modification having no jumps at fixed times (cf. Theorem 13).
Theorem 13. A process with independent increments that is stochastically continuous on has a modification with sample paths in the space .
Show that if one sets in condition (52), then the assertion of Theorem 18 , generally speaking, need not hold.
Theorem 18 (see, e.g., [12; p. 124]). Let be a real stochastic process such that for some and
Then the process has a continuous modification.
Let a random field with values, for each , in a Polish space satisfy, for some nondecreasing positive continuous function on and , the conditions
where the integral is taken in a neighborhood of . Prove that then the random field has a continuous modification (use Theorem 20 ).
Recall that for a set may coincide with , where is a pseudometric space, an -net is a set such that for every there exists an element for which . In other words, is covered by the closed balls
If has a finite -net, then we call a minimal -net any of its -nets such that is minimal, where denotes the number of elements of a finite set . Put , emphasizing the dependence on the pseudometric as well.
In order to introduce more general moment conditions on the random function , consider a positive strictly increasing convex function defined on and such that . Denote the inverse function of by .
Theorem 20 (see [79]). Let be a random function with values in a Polish space ( ) for each , defined on some ( and a pseudometric space , such that for some
and a.s., if . Suppose also that
where the integral is taken over the positive part of some neighborhood of zero. Then the random function has a continuous modification.
Let be a pseudometric space, the diameter of a set , and let the closed balls be given by the formula
Definition 21. A probability measure defined on the Borel -algebra of the space is called majorizing if
where is defined according to (53).
(see [48; p. 182]). Prove that the definition of a majorizing measure is equivalent to the following one. There exist and a sequence of refining partitions of into sets of positive -measure such that
where is the (unique) set of the partition that contains the point .