Chapter 3.7

Markov Processes

[7/100%]
Show
LaTeX
Problem 3.7.1

Let (Xt,t∈T)\left(X_{t}, t \in T\right) be a Markov process, T⊂R+T \subset \mathbb {R}_+. Suppose that for each t∈Tt \in T a measurable function ht:(S,B)→(S′,B′)h_{t}: (\mathsf{S}, \mathscr {B}) \to (\mathsf{S}', \mathscr {B}') is given. Consider the random process Yt=(ht(Xt),t∈T)Y_{t}=\left(h_{t}\left(X_{t}\right), t \in T\right).

?
(a)

Prove that if hth_{t} is a bijection for every t∈Tt \in T (we assume that in this case ht−1h_{t}^{-1} is also measurable), then YtY_{t} is also a Markov process;

(b)

Give an example of a Markov process XtX_{t} and Borel functions hth_{t} for which the process YtY_{t} is not Markov.

Problem 3.7.2

Let (Xt,t∈T),(Yt,t∈T)\left(X_{t}, t \in T\right),\left(Y_{t}, t \in T\right) be independent Markov processes. Is it true that the process (Xt+Yt,t∈T)\left(X_{t}+Y_{t}, t \in T\right) is also Markov?

?
Problem 3.7.3

Is it true that the total number of particles Y=(Yn=X0+…+Xn,n∈Z+)Y = (Y_{n} = X_{0} + \ldots + X_{n}, n \in \mathbb {Z}_{+}) of the Galton-Watson branching process X=(Xn,n∈Z+)X = \left(X_{n}, n \in \mathbb {Z}_{+}\right) is a Markov process

?
(a)

with respect to the natural filtration of the process XX?

(b)

with respect to the natural filtration of the process YY?

Problem 3.7.4

Let (Wt,t⩾0)\left(W_{t}, t \geqslant 0\right) be a Wiener process. Is the process Xt=Wt2X_{t}=W_{t}^{2} Markov?

?
Problem 3.7.5

Let (Wt,t⩾0)\left(W_{t}, t \geqslant 0\right) be a Wiener process, and let τx=min⁡{t:Wt=x}\tau_{x}=\min \left\{ t : W_{t}=x\right\} for x⩾0x \geqslant 0. Prove that the process τ=(τx,x⩾0)\tau =\left(\tau_{x}, x \geqslant 0\right) is Markov.

?
Problem 3.7.6

Let (Wt,t⩾0)\left(W_{t}, t \geqslant 0\right) be a Wiener process. Compute its transition density.

?
Problem 3.7.7

Let (Xn,n⩾0)\left(X_{n}, n \geqslant 0\right) be independent random variables with the uniform distribution on the set {−1,0,1}\left\{ -1,0,1\right\}. Consider the process

Yn=X0X1+X1X2+…+Xn−1Xn Y_{n}=X_{0} X_{1}+X_{1} X_{2}+\ldots +X_{n-1} X_{n}

Prove that XnX_{n} is a martingale with respect to the filtration

F=(σ(X1,…,Xn),n∈Z+), \mathbb {F}=\left(\sigma \left(X_{1}, \ldots , X_{n}\right), n \in \mathbb {Z}_{+}\right),

but is not a Markov process with respect to it.

?