Almost Sure

25 October 09

Integrating with respect to Brownian motion

Filed under: Stochastic Calculus — George Lowther @ 9:01 PM
Tags: , , ,

In this post I attempt to give a rigorous definition of integration with respect to Brownian motion (as introduced by Itô in 1944), while keeping it as concise as possible. The stochastic integral can also be defined for a much more general class of processes called semimartingales. However, as Brownian motion is such an important special case which can be handled directly, I start with this as the subject of this post. If {\{X_s\}_{s\ge 0}} is a standard Brownian motion defined on a probability space {(\Omega,\mathcal{F},\mathop{\mathbb P})} and {\alpha_s} is a stochastic process, the aim is to define the integral

\displaystyle  \int_0^t\alpha_s\,dX_s.


In ordinary calculus, this can be approximated by Riemann sums, which converge for continuous integrands whenever the integrator {X} is of finite variation. This leads to the Riemann-Stietjes integral and, generalizing to measurable integrands, the Lebesgue-Stieltjes integral. Unfortunately this method does not work for Brownian motion which, as discussed in my previous post, has infinite variation over all nontrivial compact intervals.

The standard approach is to start by writing out the integral explicitly for piecewise constant integrands. If there are times {0=t_0\le t_1\le\cdots\le t_n=t} such that {\alpha_s=\alpha_{t_{k-1}}} for each {s\in(t_{k-1},t_k)} then the integral is given by the summation,

\displaystyle  \int_0^t\alpha\,dX = \sum_{k=1}^n\alpha_{t_{k-1}}(X_{t_k}-X_{t_{k-1}}).


We could try to extend to more general integrands by approximating by piecewise constant processes but, as mentioned above, Brownian motion has infinite variation paths and this will diverge in general.

Fortunately, when working with random processes, there are a couple of observations which improve the chances of being able to consistently define the integral. They are

  • The integral is not a single real number, but is instead a random variable defined on the probability space. It therefore only has to be defined up to a set of zero probability and not on every possible path of {X}.
  • Rather than requiring limits of integrals to converge for each path of {X} (e.g., dominated convergence), the much weaker convergence in probability can be used.

These observations are still not enough, and the main insight is to only look at integrands which are adapted. That is, the value of {\alpha_t} can only depend on {X} through its values at prior times. This condition is met in most situations where we need to use stochastic calculus, such as with (forward) stochastic differential equations. To make this rigorous, for each time {t\ge 0} let {\mathcal{F}_t} be the sigma-algebra generated by {X_s} for all {s\le t}. This is a filtration ({\mathcal{F}_s\subseteq\mathcal{F}_t} for {s\le t}), and {(\Omega,\mathcal{F},\{\mathcal{F}_t\}_{t\ge 0},\mathop{\mathbb P})} is referred to as a filtered probability space. Then, {\alpha} is adapted if {\alpha_t} is {\mathcal{F}_t}-measurable for all times {t}. Piecewise constant and left-continuous processes, such as {\alpha} in (2), which are also adapted are commonly referred to as simple processes.

However, as with standard Lebesgue integration, we must further impose a measurability property. A stochastic process {\alpha} can be viewed as a map from the product space {{\mathbb R}_+\times\Omega} to the real numbers, given by {(t,\omega)\mapsto\alpha_t(\omega)}. It is said to be jointly measurable if it is measurable with respect to the product sigma-algebra {\mathcal{B}({\mathbb R}_+)\otimes\mathcal{F}}, where {\mathcal{B}} refers to the Borel sigma-algebra. Finally, it is called progressively measurable, or just progressive, if its restriction to {[0,t]\times\Omega} is {\mathcal{B}([0,t])\otimes\mathcal{F}_t}-measurable for each positive time {t}. It is easily shown that progressively measurable processes are adapted, and the simple processes introduced above are progressive.

With these definitions, the stochastic integral of a progressively measurable process {\alpha} with respect to Brownian motion {X} is defined whenever {\int_0^t\alpha^2ds<\infty} almost surely (that is, with probability one). The integral (1) is a random variable, defined uniquely up to sets of zero probability by the following two properties.

  • The integral agrees with the explicit formula (2) for simple integrands.
  • If {\alpha^n} and {\alpha} are progressive processes such that {\int_0^t(\alpha^n-\alpha)^2\,ds} tends to zero in probability as {n\rightarrow\infty}, then

    \displaystyle  \int_0^t\alpha^n\,dX\rightarrow\int_0^t\alpha\,dX,


    where, again, convergence is in probability.

I now briefly sketch the proof that the stochastic integral does indeed exist and is uniquely defined by these two properties. The starting point is the Itô isometry. If {\alpha} a simple integrand, as defined above, then the property of Brownian motion that {X_{t_k}-X_{t_{k-1}}} has mean 0 and variance {t_k-t_{k-1}} independently of {\mathcal{F}_{t_{k-1}}} gives

\displaystyle  \mathop{\mathbb E}\left[\left(\int_0^t\alpha\,dX\right)^2\right]=\mathop{\mathbb E}\left[\int_0^t\alpha^2\,ds\right].


This shows shows that stochastic integration is an isometry between the respective {L^2} spaces. More precisely, it is an isometry from the set of simple processes under the {L^2([0,t]\times\Omega,\mathcal{B}\otimes\mathcal{F},\mu\otimes\mathop{\mathbb P})} norm (here, {\mu} denotes the Lebesgue integral on {[0,t]}) to {L^2(\Omega,\mathcal{F},\mathop{\mathbb P})}. So, it has a unique continuous linear extension to the closure of the simple processes. This uniquely defines the integral for progressively measurable integrands such that the right hand side of (4) is finite, as long as it can be shown that they can be approximated by a sequence of simple integrands {\alpha^n} such that {\mathop{\mathbb E}[\int_0^t(\alpha^n-\alpha)^2\,ds]} tends to zero. In fact, this is achieved by the following approximations

\displaystyle  \alpha^n_s=\left\{\begin{array}{ll} 0,&\textrm{if }s\le t/n,\\ n\int_{t(k-1)/n}^{tk/n}\alpha_u\,du,&\textrm{if }tk/n< s\le t(k+1)/n\textrm{ for }1\le k<n. \end{array}\right.


We still need to extend to the case where {\int_0^t\alpha^2\,ds} is finite almost surely, rather than requiring it to be integrable. This can be done by applying a localization technique to the Itô isometry: If {\tau} is the first time at which {\int_0^\tau\alpha^2\,ds=K^2}, for some constant {K}, then the Itô isometry (4) applied to {1_{(0,\tau]}\alpha},

\displaystyle  \mathop{\mathbb E}\left[\left(\int_0^{\tau\wedge t}\alpha\,dX\right)^2\right]=\mathop{\mathbb E}\left[\int_0^{\tau\wedge t}\alpha^2\,ds\right]=\mathop{\mathbb E}\left[K^2\wedge\int_0^t\alpha^2\,ds\right].

Applying the Markov inequality to this gives the following bounds on probabilities.

\displaystyle  \begin{array}{l} \displaystyle \mathop{\mathbb P}\left(\left|\int_0^{\tau\wedge t}\alpha\,dX\right|\ge K\right)\le K^{-2}\mathop{\mathbb E}\left[K^2\wedge\int_0^t\alpha^2\,ds\right].\\ \displaystyle \mathop{\mathbb P}\left(\tau<t\right)\le K^{-2}\mathop{\mathbb E}\left[K^2\wedge\int_0^t\alpha^2\,ds\right]. \end{array}

Combining these gives us the following inequality

\displaystyle  \mathop{\mathbb P}\left(\left|\int_0^t\alpha\,dX\right|\ge K\right)\le 2K^{-2}\mathop{\mathbb E}\left[K^2\wedge\int_0^t\alpha^2\,ds\right],

which shows that the stochastic integral is continuous in the following sense. If {\int_0^t(\alpha-\alpha^n)^2ds} converges to zero in probability, then convergence of the integrals (3) also holds in probability. Furthermore, if {\int_0^t\alpha^2\,ds} is finite almost surely, then (4) gives such an approximating sequence of simple integrands. Then by uniqueness of continuous extensions of linear maps, it follows that the defining properties given above do indeed uniquely specify the stochastic integral.


1 Comment »

  1. Hi George, I have a question regarding the final paragraph. How exactly does (4) give an “approximating sequence of simple integrands”?

    Also, this definition of the integral for a.s. finite integrands is not done in Karatzas/Shreve and Revuz/Yor. In those books, the integral is defined over [0,\tau^n] , where (\tau^n)_{n \ge 1} is a localising sequence. It’s not so clear to me that the definitions coincide…

    Many thanks for your blog.

    Comment by KBell — 13 September 12 @ 1:10 PM | Reply

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at