Chapter 22

Transformations of Markov processes

[7/0%]
LaTeX
Problem 22.1

Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be a one-dimensional Brownian motion, LtxL_{t}^{x} the local time of Brownian motion at xx, and mm a positive finite measure on R\mathbb {R}. Show that At=∫Ltxm(dx)A_{t}=\int L_{t}^{x} m(d x) is an additive functional.

?
Problem 22.2

We consider the space-time process. Let Vt=V0+tV_{t}=V_{0}+t. The process VtV_{t} is simply the process that increases deterministically at unit speed. Thus VtV_{t} can represent time. If (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a Markov process, show that ((Xt,Vt),P[(x,v)])\left(\left(X_{t}, V_{t}\right), \mathbb {P}[(x, v)]\right) is also a Markov process. Is ((Xt,Vt),P[(x,v)])\left(\left(X_{t}, V_{t}\right), \mathbb {P}[(x, v)]\right) necessarily a strong Markov process if (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a strong Markov process?

For some applications, one lets Vt=V0−tV_{t}=V_{0}-t, and one thinks of time running backwards. Space-time processes are useful when considering parabolic partial differential equations.

?
Problem 22.3

Suppose (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) is a strong Markov process and ff is a non-negative invariant function for (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right). Write Qx\mathbb {Q}^{x} for Pfx\mathbb {P}_{f}^{x}. Suppose gg is a non-negative invariant function for (Xt,Qx)\left(X_{t}, \mathbb {Q}^{x}\right). Show that fgf g is a non-negative invariant function for (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) and that Qgx=Pfgx\mathbb {Q}_{g}^{x}=\mathbb {P}_{f g}^{x}.

?
Problem 22.4

Suppose AA and BB are additive functionals for a Markov process and AA and BB have continuous paths. Prove that if Ex[At]=Ex[Bt]\mathbb {E}_{x}\left[A_{t}\right]=\mathbb {E}_{x}\left[B_{t}\right] for all xx and tt, then

Px(At≠Bt for some t≥0)=0 \mathbb {P}_{x}\left(A_{t} \neq B_{t} \text{ for some } t \geq 0\right)=0

for all xx.

Hint: Show At−BtA_{t}-B_{t} is a martingale.

?
Problem 22.5

Suppose AA and BB are additive functionals with continuous paths and suppose Ex[A∞]=Ex[B∞]<∞\mathbb {E}_{x}\left[A_{\infty }\right]=\mathbb {E}_{x}\left[B_{\infty }\right]<\infty for each xx. Show

Px(At≠Bt for some t≥0)=0 \mathbb {P}_{x}\left(A_{t} \neq B_{t} \text{ for some } t \geq 0\right)=0

for each xx.

Hint: If f(x)=Ex[A∞]f(x)=\mathbb {E}_{x}\left[A_{\infty }\right], then

\mean[x][A∞∣Ft]−At=\meanXtA∞=f(Xt) \mean [x]\left[A_{\infty } \mid \mathcal{F}_{t}\right]-A_{t}=\mean ^{X_{t}} A_{\infty }=f\left(X_{t}\right)

and similarly with BB in place of AA. Then A−BA-B is a P[x]\mathbb {P}[x] martingale for each xx.

?
Problem 22.6

Let AA be an additive functional with continuous paths. Suppose there exists K>0K>0 such that Ex[A∞]≤K\mathbb {E}_{x}\left[A_{\infty }\right] \leq K for each xx. Prove that there exists a constant cc depending only on KK such that

E[ecA∞]<∞,x∈S. \mathbb {E}\left[e^{c A_{\infty }}\right]<\infty , \quad x \in \mathcal{S} .
?
Problem 22.7

Here is an argument that the law of a Brownian motion conditioned to have a maximum at a certain level is a Bessel process of order 3.

Let WW be a one-dimensional Brownian motion killed on hitting 0. Let St=sup⁡s≤tWsS_{t}=\sup_{s \leq t} W_{s} be the maximum. By Exercise 19.1, X=(W,S)X=(W, S) is a Markov process. Determine the law of XX for t≤Lt \leq L, where LL is the last time XX hits the diagonal. To define LL more precisely, let D={(w,s):w=s,w>0}D=\left\{ (w, s): w=s, w>0\right\} and L=sup⁡{t≥0:Xt∈D}L=\sup \left\{ t \geq 0: X_{t} \in D\right\}. LL is finite, a.s., because WW will hit 0 in finite time with probability one.

?