Chapter 21

Applications of the Markov properties

[8/0%]
LaTeX
Problem 21.1

Suppose d=2,(Xt,P[x])d=2,\left(X_{t}, \mathbb {P}[x]\right) is a two-dimensional Brownian motion, and r>0r>0. Imitate the argument of Proposition 21.1 but with h(x)=log⁡(∣x∣)h(x)=\log \left(\left|x\right|\right) to show that Px(Xt hits B(0,r))=1\mathbb {P}_{x}\left(X_{t} \text{ hits } B(0, r)\right)=1 when ∣x∣>r\left|x\right|>r. Then use the strong Markov property to show that there are times Ti→∞T_{i} \rightarrow \infty with XTi∈B(0,r)X_{T_{i}} \in B(0, r). That is, two-dimensional Brownian motion is neighborhood recurrent.

?
Problem 21.2

In the proof of Lemma 21.4, justify each inequality in (21.6).

Lemma 21.4: Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be a strong Markov process with state space S\mathcal{S}. For all x∈Sx \in \mathcal{S} and all λ≥0\lambda \geq 0,

Px(sup⁡s≤td(Xs,x)≥λ)≤2sup⁡s≤tsup⁡y∈SPy(d(Xs,X0)≥λ/2). \mathbb {P}_{x}\left(\sup _{s \leq t} d\left(X_{s}, x\right) \geq \lambda \right) \leq 2 \sup _{s \leq t} \sup _{y \in \mathcal{S}} \mathbb {P}_{y}\left(d\left(X_{s}, X_{0}\right) \geq \lambda / 2\right).

From the proof: writing F(t,λ)=sup⁡s≤tsup⁡y∈SPy(d(Xs,X0)≥λ)F(t, \lambda )=\sup_{s \leq t} \sup_{y \in \mathcal{S}} \mathbb {P}_{y}\left(d\left(X_{s}, X_{0}\right) \geq \lambda \right) and S=inf⁡{t:d(Xt,X0)≥λ}S=\inf \left\{ t: d\left(X_{t}, X_{0}\right) \geq \lambda \right\}, then by the strong Markov property,

Px(sup⁡s≤td(Xs,x)≥λ)≤Px(d(Xt,x)≥λ/2)+Px(S<t,d(Xt,X0)≤λ/2)≤F(t,λ/2)+\mean[x][PXS(d(Xt−S,X0)≥λ/2)]≤2F(t,λ/2).(21.6) \begin{aligned} \mathbb {P}_{x}\left(\sup _{s \leq t} d\left(X_{s}, x\right) \geq \lambda \right) & \leq \mathbb {P}_{x}\left(d\left(X_{t}, x\right) \geq \lambda / 2\right)+\mathbb {P}_{x}\left(S<t, d\left(X_{t}, X_{0}\right) \leq \lambda / 2\right) \\ & \leq F(t, \lambda / 2)+\mean [x]\left[\mathbb {P}_{X_{S}}\left(d\left(X_{t-S}, X_{0}\right) \geq \lambda / 2\right)\right] \\ & \leq 2 F(t, \lambda / 2). \tag {21.6} \end{aligned}
?
Problem 21.3

Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be a Poisson process with parameter aa and let FF be defined by (21.5). Show F(t,1/2)/tF(t, 1 / 2) / t does not converge to 0 as t→0t \rightarrow 0.

?
Problem 21.4

Suppose d≥3,(Xt,P[x])d \geq 3,\left(X_{t}, \mathbb {P}[x]\right) is a dd-dimensional Brownian motion, and

Uf(x)=Ex[∫0∞f(Xs)ds] U f(x)=\mathbb {E}_{x}\left[\int _{0}^{\infty } f\left(X_{s}\right) d s\right]

Show that if ff is bounded and measurable with compact support, then UfU f is continuous and ∣Uf(x)∣→0\left|U f(x)\right| \rightarrow 0 as ∣x∣→∞\left|x\right| \rightarrow \infty. Show that if f∈C2f \in C^{2} with compact support, then UfU f is C2C^{2}. Show that 12ΔUf=−f\frac{1}{2} \Delta U f=-f.

?
Problem 21.5

Let WtW_{t} be a Brownian motion and ff a continuous function. Prove that if f(Wt)f\left(W_{t}\right) is a submartingale, then ff must be convex.

?
Problem 21.6

Prove the maximum principle for harmonic functions. This says that if hh is harmonic in a bounded domain DD, then

sup⁡x∈Dˉ∣h(x)∣≤sup⁡x∈∂D∣h(x)∣.  \sup _{x \in \bar{D}}\left|h(x)\right| \leq \sup _{x \in \partial D}\left|h(x)\right| \text{. }
?
Problem 21.7

If WW is a dd-dimensional Brownian motion started at 0 , find E[T]\mathbb {E}\left[T\right], where TT is the first time WW exits the ball of radius rr centered at the origin.

Hint: Use the fact that ∣Wt∣2−dt\left|W_{t}\right|^{2}-d t is a martingale.

?
Problem 21.8

Let f:R→Rf: \mathbb {R} \rightarrow \mathbb {R} be a bounded function with ∣f(x)−f(y)∣≤∣x−y∣\left|f(x)-f(y)\right| \leq \left|x-y\right| for all x,y∈Rx, y \in \mathbb {R}. Let Dε={(x,y)∈R2:f(x)<y<f(x)+ε}D_{\varepsilon }=\left\{ (x, y) \in \mathbb {R}^{2}: f(x)<y<f(x)+\varepsilon \right\} for ε∈(0,1)\varepsilon \in (0,1). Let (Xt,P[x])\left(X_{t}, \mathbb {P}[x]\right) be a two-dimensional Brownian motion and let τε=inf⁡{t:Xt∉Dε}\tau_{\varepsilon }=\inf \left\{ t: X_{t} \notin D_{\varepsilon }\right\}. Prove that there exists a constant cc not depending on ε\varepsilon such that E0[τε]≤cε2\mathbb {E}_{0}\left[\tau_{\varepsilon }\right] \leq c \varepsilon^{2}.

Hint: By Exercise 21.7 the expected time for two-dimensional Brownian motion to leave a ball of radius 2ε2 \varepsilon is less than cε2c \varepsilon^{2}. Then use the strong Markov property repeatedly at the times SiS_{i}, where SiS_{i} is the first time after time Si−1S_{i-1} that Brownian motion has moved at least 2ε2 \varepsilon from XSi−1X_{S_{i-1}}.

?