Chapter 20

Markov properties

[9/0%]
LaTeX
Problem 20.1

Suppose that S\mathcal{S} is a locally compact separable metric space and C0C_{0} is the set of continuous functions on S\mathcal{S} that vanish at infinity. To say a continuous function ff vanishes at infinity means that given ε>0\varepsilon >0 there exists a compact set KK such that ∣f(x)∣<ε\left|f(x)\right|<\varepsilon if x∉Kx \notin K. Show that if Assumption 20.1 is replaced by the assumptions that Ptf∈C0P_{t} f \in C_{0} whenever f∈C0f \in C_{0} and Ptf→fP_{t} f \rightarrow f uniformly as t→0t \rightarrow 0 whenever f∈C0f \in C_{0}, then the conclusion of Theorem 20.9 still holds.

?
Problem 20.2

Suppose (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a Markov process with respect to a filtration {Ft}\left\{ \mathcal{F}_{t}\right\}. Suppose that Et⊂Ft\mathcal{E}_{t} \subset \mathcal{F}_{t} for each tt and that XtX_{t} is Et\mathcal{E}_{t} measurable for each tt. Show that (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a Markov process with respect to the filtration {Et}\left\{ \mathcal{E}_{t}\right\}.

?
Problem 20.3

Give an example of a Markov process that is not a strong Markov process.

Hint: Let the state space be [0,∞)[0, \infty ) and starting from x∈(0,∞)x \in (0, \infty ), let XX move deterministically at constant speed to the right. Starting at 0 , let XX wait an exponential length of time, and then begin moving at constant speed to the right.

?
Problem 20.4

Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be Brownian motion and let {Ft}\left\{ \mathcal{F}_{t}\right\} be the minimal augmented filtration. Suppose B∈∨t≥0FtB \in \vee_{t \geq 0} \mathcal{F}_{t} and for some s>0s>0 is of the form   1B=  1A∘θs\; \mathbb {1}_{B}=\; \mathbb {1}_{A} \circ \theta_{s}. Show that if BB is a P[x]\mathbb {P}[x]-null set for some xx, then it is a P[x]\mathbb {P}[x]-null set for every xx.

?
Problem 20.5

Let PtP_{t} be transition probabilities for a Poisson process with parameter λ\lambda. These are defined in Exercise 19.3. Show that Assumption 20.1 holds.

?
Problem 20.6

Suppose (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a Markov process with transition probabilities Pt,fP_{t}, f is a bounded Borel measurable function, t0>0t_{0}>0, and we define Mt=Pt0−tf(Xt)M_{t}=P_{t_{0}-t} f\left(X_{t}\right) for t≤t0t \leq t_{0}. Show that (Mt,t≤t0)\left(M_{t}, t \leq t_{0}\right) is a P[x]\mathbb {P}[x]-martingale for each xx.

?
Problem 20.7

Use the Blumenthal 0−10-1 law to show that if WW is a one-dimensional Brownian motion and T=inf⁡{t>0:Wt>0}T=\inf \left\{ t>0: W_{t}>0\right\} is the first time Brownian motion hits (0,∞)(0, \infty ), then P(T=0)=1\mathbb {P}\left(T=0\right)=1.

?
Problem 20.8

Let AA be a Borel subset of a metric space S\mathcal{S}. Let TA=inf⁡{t:Xt∈A}T_{A}=\inf \left\{ t: X_{t} \in A\right\}, where (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a strong Markov process. Show that Px(TA=0)\mathbb {P}_{x}\left(T_{A}=0\right) is either 0 or 1 for each xx.

?
Problem 20.9

Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be a strong Markov process and let AA be a Borel subset of S\mathcal{S}. We define ArA^{r} by setting Ar={x:Px(TA=0)=1}A^{r}=\left\{ x: \mathbb {P}_{x}\left(T_{A}=0\right)=1\right\}, where TAT_{A} is the first hitting time of AA. Thus ArA^{r} is the set of points that are regular for AA. Prove that for each xx,

Px(XTA∈A∪Ar)=1. \mathbb {P}_{x}\left(X_{T_{A}} \in A \cup A^{r}\right)=1 .
?