Brownian bridge and empirical processes

[27/67%]
Show
LaTeX

Let B0(t)≡B(t)−tB(1),0≤t≤1B_{0}(t) \equiv B(t)-t B(1), 0 \leq t \leq 1 (where {B(t):t≥0}\left\{ B(t): t \geq 0\right\} is SBM) be the Brownian bridge. Find the distribution of X(t)≡(1+t)B0(t1+t)X(t) \equiv (1+t) B_{0}\left(\frac{t}{1+t}\right), t≥0t \geq 0.

?

Let XX be a Brownian bridge. (This will be studied further in Section 35.2.) This means that XX is a mean zero Gaussian process with

Cov⁡[Xs,Xt]=s∧t−st,0≤s,t≤1 \operatorname {Cov}\left[ X_{s}, X_{t} \right]=s \wedge t-s t, \quad 0 \leq s, t \leq 1

Identify the reproducing kernel Hilbert space for XX.

?

Prove that the finite-dimensional distributions of ZnZ_{n} in Theorem 35.10 converge to those of a Brownian bridge.

Setup: let Xi,i=1,…,nX_{i}, i=1, \ldots , n, be i.i.d. random variables uniformly distributed on [0,1][0,1], let Fn(t)=1n∑i=1n  1[0,t](Xi)F_{n}(t)=\frac{1}{n} \sum_{i=1}^{n} \; \mathbb {1}_{[0, t]}\left(X_{i}\right) be the empirical process, and let

Zn(t)=n(Fn(t)−t)=1n∑i=1n(  1[0,t](Xi)−t). Z_{n}(t)=\sqrt{n}\left(F_{n}(t)-t\right)=\frac{1}{\sqrt{n}} \sum _{i=1}^{n}\left(\; \mathbb {1}_{[0, t]}\left(X_{i}\right)-t\right).

Theorem 35.10: The ZnZ_{n} converge weakly to a Brownian bridge with respect to the topology of D[0,1]D[0,1].

?

If Wt0W_{t}^{0} is a Brownian bridge, prove that Yt=W1−t0Y_{t}=W_{1-t}^{0} is also a Brownian bridge.

?

Let t0<1t_{0}<1. The SDE (35.5) has a unique solution when X0=0X_{0}=0 is replaced by X0=xX_{0}=x. Let P[x]\mathbb {P}[x] be the law of the solution when X0=xX_{0}=x and let ZtZ_{t} be the canonical process. Show that (Zt,P[x])\left(Z_{t}, \mathbb {P}[x]\right) is not a Markov process.

?

This exercise asks you to prove that the Poisson process conditioned to be equal to nn at time 1 has the same law as nn times the empirical process. Here is the precise statement. Suppose PtP_{t} is a Poisson process with parameter λ>0\lambda >0. Let Q\mathbb {Q} be the law of {Pt,t∈[0,1]}\left\{ P_{t}, t \in [0,1]\right\} conditioned so that P1=nP_{1}=n. Thus Q\mathbb {Q} is a probability on D[0,1]D[0,1] with

Q(P∈A)=P(P∈A∣P1=n). \mathbb {Q}(P \in A)=\mathbb {P}\left( P \in A \mid P_{1}=n \right) .

Since (P1=n)\left(P_{1}=n\right) is an event with positive probability, there is no difficulty defining these conditional probabilities. Prove that Q\mathbb {Q} is also the law of {nFn(t),t∈[0,1]}\left\{ n F_{n}(t), t \in [0,1]\right\}, where FnF_{n} is defined in Section 35.3.

?

Prove that the Brownian bridge (see the definition in §9\S 9 of Chapter V) is an inhomogeneous Markov process.

Definition from §9\S 9 of Chapter V: W0W^{0} is the Brownian bridge, defined as the process W0(t)={W(t)−tW(1),t∈[0,1]}W^{0}(t) = \left\{ W(t)-t W(1), t \in [0,1]\right\}, where W={W(t),t∈[0,1]}W = \left\{ W(t), t \in [0,1]\right\} is a Wiener process on the interval [0,1][0,1].

?

Using the Itô formula, prove that the solution of the (one-dimensional) equation

dXt=β−XtT−tdt+dWt,t∈[0,T),X0=α(109) d X_{t} = \frac{\beta -X_{t}}{T-t} d t+d W_{t}, \quad t \in [0, T), \quad X_{0} = \alpha \tag {109}

is the process

Xt=α(1−t/T)+βt/T+(T−t)∫0tdWsT−s(110) X_{t} = \alpha (1-t / T)+\beta t / T+(T-t) \int _{0}^{t} \frac{d W_{s}}{T-s} \tag {110}
?

Let XtX_{t} be the solution of the (one-dimensional) equation

dXt=β−XtT−tdt+dWt,t∈[0,T),X0=α(109) d X_{t} = \frac{\beta -X_{t}}{T-t} d t+d W_{t}, \quad t \in [0, T), \quad X_{0} = \alpha \tag {109}

(continuation of Exercise 23). Prove that Xt→βX_{t} \rightarrow \beta a.s. as t→T−t \rightarrow T-. Thus, the solution of equation (109) is a Brownian bridge over the interval [0,T][0, T] with pinned endpoints X0=αX_{0} = \alpha and XT=βX_{T} = \beta. The standard Brownian bridge is obtained for T=1T = 1 and α=β=0\alpha = \beta = 0.

?

Show that the autocovariance function of the Brownian bridge is c(s,t)=min⁡{s,t}−st,0≤s,t≤1c(s, t) = \min \left\{ s, t\right\} -s t, 0 \leq s, t \leq 1.

?

Let WW be a standard Wiener process, and let W^(t)=W(t)−tW(1)\widehat{W}(t) = W(t)-t W(1). Show that {W^(t):0≤t≤1}\left\{ \widehat{W}(t): 0 \leq t \leq 1\right\} is a Brownian bridge.

?

If WW is a Wiener process with W(0)=0W(0) = 0, show that W~(t)=(1−t)W(t/(1−t))\widetilde{W}(t) = (1-t) W(t /(1-t)) for 0≤t<10 \leq t < 1, W~(1)=0\widetilde{W}(1) = 0, defines a Brownian bridge.

Deduce, with help from Corollary (13.4.14), that the probability of the Brownian bridge ever rising above the height m>0m > 0 is e−2m2e^{-2 m^{2}}.

?

Let 0<s<t<10 < s < t < 1. Show that the probability that the Brownian bridge has no zeros in the interval (s,t)(s, t) is (2/π)cos⁡−1(t−s)/[t(1−s)](2 / \pi ) \cos^{-1} \sqrt{(t-s) /[t(1-s)]}.

?

Let WW be a standard Wiener process. Find the conditional joint density function of W(t2)W\left(t_{2}\right) and W(t3)W\left(t_{3}\right) given that W(t1)=W(t4)=0W\left(t_{1}\right) = W\left(t_{4}\right) = 0, where t1<t2<t3<t4t_{1} < t_{2} < t_{3} < t_{4}.

Show that the conditional correlation of W(t2)W\left(t_{2}\right) and W(t3)W\left(t_{3}\right) is

ρ=(t4−t3)(t2−t1)(t4−t2)(t3−t1) \rho = \sqrt{\frac{\left(t_{4}-t_{3}\right)\left(t_{2}-t_{1}\right)}{\left(t_{4}-t_{2}\right)\left(t_{3}-t_{1}\right)}}
?

Let U1,U2,…U_{1}, U_{2}, \ldots be independent random variables with the uniform distribution on [0,1][0,1]. Let Ij(x)I_{j}(x) be the indicator function of the event {Uj≤x}\left\{ U_{j} \leq x\right\}, and define

Fn(x)=1n∑j=1nIj(x),0≤x≤1 F_{n}(x) = \frac{1}{n} \sum _{j = 1}^{n} I_{j}(x), \quad 0 \leq x \leq 1

The function FnF_{n} is called the 'empirical distribution function' of the UjU_{j}.

?
(a)

Find the mean and variance of Fn(x)F_{n}(x), and prove that n(Fn(x)−x)→DY(x)\sqrt{n}\left(F_{n}(x)-x\right) \xrightarrow {\mathrm{D}} Y(x) as n→∞n \rightarrow \infty, where Y(x)Y(x) is normally distributed.

(b)

What is the (multivariate) limit distribution of a collection of random variables of the form {n(Fn(xi)−xi):1≤i≤k}\left\{ \sqrt{n}\left(F_{n}\left(x_{i}\right)-x_{i}\right): 1 \leq i \leq k\right\}, where 0≤x1<x2<⋯<xk≤10 \leq x_{1} < x_{2} < \cdots < x_{k} \leq 1?

(c)

Show that the autocovariance function of the asymptotic finite-dimensional distributions of n(Fn(x)−x)\sqrt{n}\left(F_{n}(x)-x\right), in the limit as n→∞n \rightarrow \infty, is the same as that of the process Z(t)=W(t)−tW(1)Z(t) = W(t)-t W(1), 0≤t≤10 \leq t \leq 1, where WW is a standard Wiener process. The process ZZ is called a 'Brownian bridge' or 'tied-down Brownian motion'.

Let w(t)w(t) be a standard Wiener process. Find the covariance function of the random process w(0)(t)=w(t)−tw(1)w^{(0)}(t) = w(t) - tw(1), considered on the time interval t∈[0,1]t \in [0, 1].

?

Let w(t)w(t) be a standard Wiener process. Find the covariance function of the random process w(0)(t)=(1−t)w(t/(1−t))w^{(0)}(t) = (1-t)w(t/(1-t)), t∈[0,1)t \in [0, 1), w(0)(1)=0w^{(0)}(1) = 0.

?

Let (Bt,t∈[0,1])\left(B_{t}, t \in [0,1]\right) be a Gaussian process with zero mean function and covariance function r(s,t)=min⁡(t1,t2)−t1t2r(s, t)=\min (t_1, t_2)-t_1 t_2.

?
(a)

Prove that such a process exists;

(b)

Prove that the process

W~s:=(s+1)Bss+1,  s≥0 \tilde{W}_s := (s+1)B_{\frac{s}{s+1}}, \; s \geq 0

is a Wiener process.

(c)

Is BtB_t a process with independent increments?

Remark.
?

The process (Bt)(B_t) is called a Brownian bridge, since its largest variance is attained at the point 12\frac{1}{2}, and at the endpoints of the interval [0,1][0,1] it is a.s. equal to zero.

Let wtw_{t} be a Wiener process. Find the joint density of the values wuw_{u} and wvw_{v}, 0<u<v<10 < u < v < 1, given that w1=0w_{1} = 0.

?

Let wtw_{t} be a Wiener process. Find the covariance of the values wsw_{s} and wt,s<t<1w_{t}, s < t < 1, given that w1=0w_{1} = 0.

?

Let wtw_{t} be a Wiener process. Find the correlation function of the process wt(0)=wt−tw1w_{t}^{(0)} = w_{t}-t w_{1}, considered on the segment 0⩽t⩽10 \leqslant t \leqslant 1 (the conditional Wiener process).

?

Let wt(0),0⩽t⩽1w_{t}^{(0)}, \quad 0 \leqslant t \leqslant 1, be the conditional Wiener process defined in the previous problem. Prove that the process wˉt=(1+t)w1/(1+t)(0),t⩾0,\bar{w}_{t} = (1 + t) w_{1 /(1+t)}^{(0)}, \quad t \geqslant 0, is a Wiener process.

?

Let wtw_{t} be a Wiener process. Find the conditional density of wt,t1<t<t2w_{t}, t_{1} < t < t_{2}, given that

wt1=A,wt2=B. w_{t_{1}} = A, \quad w_{t_{2}} = B .
?

Let wtw_{t} be a Wiener process. Find the distribution function and density of the random variable max⁡0⩽s⩽1ws\max_{0 \leqslant s \leqslant 1} w_{s}, given that w1=0w_{1} = 0.

?

Let wtw_{t} be a Wiener process. Find the distribution function of the random variable sup⁡0⩽t⩽1∣wt∣\sup_{0 \leqslant t \leqslant 1}\left|w_{t}\right|, given that w1=0w_{1} = 0.

?

Let (B(t))t⩾0(B(t))_{t \geqslant 0} be a BM1B M^{1}.

?
(a)

Find the density of the random vector (B(s),B(t))(B(s), B(t)) where 0<s<t<∞0 < s < t < \infty.

(b)

(Brownian bridge) Find the conditional density of the vector (B(s),B(t))(B(s), B(t)), 0<s<t<10 < s < t < 1 under the condition B(1)=0B(1) = 0, and use this to determine E[B(s)B(t)∣B(1)=0]\mathbb {E}\left[B(s) B(t) \mid B(1) = 0\right].

(c)

Let 0<t1<t2<t3<t4<∞0 < t_{1} < t_{2} < t_{3} < t_{4} < \infty. Determine the conditional density of the bi - variate random variable (B(t2),B(t3))\left(B\left(t_{2}\right), B\left(t_{3}\right)\right) given that B(t1)=B(t4)=0B\left(t_{1}\right) = B\left(t_{4}\right) = 0. What is the conditional correlation of B(t2)B\left(t_{2}\right) and B(t3)B\left(t_{3}\right) ?

Let B=(Bt)t∈[0,1]B = \left(B_{t}\right)_{t \in [0,1]} be a BM1\mathrm{BM}^{1} and set W=(Wt)t∈[0,1]W = \left(W_{t}\right)_{t \in [0,1]} where Wt:=Bt−tB1W_{t}: = B_{t} - t B_{1}.

?
(a)

Show that WW is a mean zero Gaussian process and find its covariance function.

(b)

Let 0=t0<t1<⋯<tn<10 = t_{0} < t_{1} < \cdots < t_{n} < 1. Show that the law of (Wt1,…,Wtn)\left(W_{t_{1}}, \ldots , W_{t_{n}}\right) has a density p(x1,…,xn)p\left(x_{1}, \ldots , x_{n}\right) which is of the form

2πgt1(x1)⋅gt2−t1(x2−x1)⋅…⋅gtn−tn−1(xn−1−xn)⋅g1−tn(xn) \sqrt{2 \pi } g_{t_{1}}\left(x_{1}\right) \cdot g_{t_{2} - t_{1}}\left(x_{2} - x_{1}\right) \cdot \ldots \cdot g_{t_{n} - t_{n - 1}}\left(x_{n - 1} - x_{n}\right) \cdot g_{1 - t_{n}}\left(x_{n}\right)

where gt(x)=(2π)−1/2exp⁡(−x2/2t)g_{t}(x) = (2 \pi )^{ - 1 / 2} \exp \left( - x^{2} / 2 t\right) is the density of N(0,t)\mathrm{N}(0, t).

(c)

Show that the law of (Wt1,…,Wtn)\left(W_{t_{1}}, \ldots , W_{t_{n}}\right) coincides with the law of (Bt1,…,Btn)\left(B_{t_{1}}, \ldots , B_{t_{n}}\right) conditioned that B1=0B_{1} = 0. Compare this with Exercise 2.9(b).

(d)

Show that the processes WW and W′:=(W1−t)t∈[0,1]W^{\prime }: = \left(W_{1 - t}\right)_{t \in [0,1]} have the same probability law.

References

[AtLa06] Athreya K.B., Lahiri S.N. Measure Theory and Probability Theory. Springer, 2006.
[Bas11] Bass R.F. Stochastic Processes. Cambridge University Press, 2011.
[БуШи05] Булинский А.В., Ширяев А.Н. Теория случайных процессов. ФИЗМАТЛИТ, 2005.
[GrSt20] Grimmett G.R., Stirzaker D.R. Probability and Random Processes. 4th ed., Oxford University Press, 2020.
[КоФо03] Коршунов Д.А., Фосс С.Г. Сборник задач и упражнений по теории вероятностей. 2-е изд., Новосибирский государственный университет, 2003.
[ЖРШ16] Жуковский М.Е., Родионов И.В., Шабанов Д.А. Основы теории случайных процессов. МФТИ, 2016.
[ПУУ86] Прохоров А.В., Ушаков В.Г., Ушаков Н. Задачи по теории вероятностей. Наука. Главная редакция физико-математической литературы, 1986.
[Sch21] Schilling R.L. Brownian Motion: A Guide to Random Processes and Stochastic Calculus. 3rd ed., De Gruyter, 2021.