# Almost Sure

## 26 September 16

### Do Convex and Decreasing Functions Preserve the Semimartingale Property?

Some years ago, I spent considerable effort trying to prove the hypothesis below. After failing at this, I spent time trying to find a counterexample, but also with no success. I did post this as a question on mathoverflow, but it has so far received no conclusive answers. So, as far as I am aware, the following statement remains unproven either way.

Hypothesis H1 Let ${f\colon{\mathbb R}_+\times{\mathbb R}\rightarrow{\mathbb R}}$ be such that ${f(t,x)}$ is convex in x and right-continuous and decreasing in t. Then, for any semimartingale X, ${f(t,X_t)}$ is a semimartingale.

It is well known that convex functions of semimartingales are themselves semimartingales. See, for example, the Ito-Tanaka formula. More generally, if ${f(t,x)}$ was increasing in t rather than decreasing, then it can be shown without much difficulty that ${f(t,X_t)}$ is a semimartingale. Consider decomposing ${f(t,X_t)}$ as

 $\displaystyle f(t,X_t)=\int_0^tf_x(s,X_{s-})\,dX_s+V_t,$ (1)

for some process V. By convexity, the right hand derivative of ${f(t,x)}$ with respect to x always exists, and I am denoting this by ${f_x}$. In the case where f is twice continuously differentiable then the process V is given by Ito’s formula which, in particular, shows that it is a finite variation process. If ${f(t,x)}$ is convex in x and increasing in t, then the terms in Ito’s formula for V are all increasing and, so, it is an increasing process. By taking limits of smooth functions, it follows that V is increasing even when the differentiability constraints are dropped, so ${f(t,X_t)}$ is a semimartingale. Now, returning to the case where ${f(t,x)}$ is decreasing in t, Ito’s formula is only able to say that V is of finite variation, and is generally not monotonic. As limits of finite variation processes need not be of finite variation themselves, this does not say anything about the case when f is not assumed to be differentiable, and does not help us to determine whether or not ${f(t,X_t)}$ is a semimartingale.

Hypothesis H1 can be weakened by restricting to continuous functions of continuous martingales.

Hypothesis H2 Let ${f\colon{\mathbb R}_+\times{\mathbb R}\rightarrow{\mathbb R}}$ be such that ${f(t,x)}$ is convex in x and continuous and decreasing in t. Then, for any continuous martingale X, ${f(t,X_t)}$ is a semimartingale.

As continuous martingales are special cases of semimartingales, hypothesis H1 implies H2. In fact, the reverse implication also holds so that hypotheses H1 and H2 are equivalent.

Hypotheses H1 and H2 can also be recast as a simple real analysis statement which makes no reference to stochastic processes.

Hypothesis H3 Let ${f\colon{\mathbb R}_+\times{\mathbb R}\rightarrow{\mathbb R}}$ be such that ${f(t,x)}$ is convex in x and decreasing in t. Then, ${f=g-h}$ where ${g(t,x)}$ and ${h(t,x)}$ are convex in x and increasing in t.

## 14 September 16

### Failure of the Martingale Property For Stochastic Integration

If X is a cadlag martingale and ${\xi}$ is a uniformly bounded predictable process, then is the integral

 $\displaystyle Y=\int\xi\,dX$ (1)

a martingale? If ${\xi}$ is elementary this is one of most basic properties of martingales. If X is a square integrable martingale, then so is Y. More generally, if X is an ${L^p}$-integrable martingale, any ${p > 1}$, then so is Y. Furthermore, integrability of the maximum ${\sup_{s\le t}\lvert X_s\rvert}$ is enough to guarantee that Y is a martingale. Also, it is a fundamental result of stochastic integration that Y is at least a local martingale and, for this to be true, it is only necessary for X to be a local martingale and ${\xi}$ to be locally bounded. In the general situation for cadlag martingales X and bounded predictable ${\xi}$, it need not be the case that Y is a martingale. In this post I will construct an example showing that Y can fail to be a martingale. (more…)

## 11 September 16

### The Optimality of Doob’s Maximal Inequality

One of the most fundamental and useful results in the theory of martingales is Doob’s maximal inequality. Use ${X^*_t\equiv\sup_{s\le t}\lvert X_s\rvert}$ to denote the running (absolute) maximum of a process X. Then, Doob’s ${L^p}$ maximal inequality states that, for any cadlag martingale or nonnegative submartingale X and real ${p > 1}$,

 $\displaystyle \lVert X^*_t\rVert_p\le c_p \lVert X_t\rVert_p$ (1)

with ${c_p=p/(p-1)}$. Here, ${\lVert\cdot\rVert_p}$ denotes the standard Lp-norm, ${\lVert U\rVert_p\equiv{\mathbb E}[U^p]^{1/p}}$.

An obvious question to ask is whether it is possible to do any better. That is, can the constant ${c_p}$ in (1) be replaced by a smaller number. This is especially pertinent in the case of small p, since ${c_p}$ diverges to infinity as p approaches 1. The purpose of this post is to show, by means of an example, that the answer is no. The constant ${c_p}$ in Doob’s inequality is optimal. We will construct an example as follows.

Example 1 For any ${p > 1}$ and constant ${1 \le c < c_p}$ there exists a strictly positive cadlag ${L^p}$-integrable martingale ${\{X_t\}_{t\in[0,1]}}$ with ${X^*_1=cX_1}$.

For X as in the example, we have ${\lVert X^*_1\rVert_p=c\lVert X_1\rVert_p}$. So, supposing that (1) holds with any other constant ${\tilde c_p}$ in place of ${c_p}$, we must have ${\tilde c_p\ge c}$. By choosing ${c}$ as close to ${c_p}$ as we like, this means that ${\tilde c_p\ge c_p}$ and ${c_p}$ is indeed optimal in (1). (more…)

## 6 September 16

### The Maximum Maximum of Martingales with Known Terminal Distribution

In this post I will be concerned with the following problem — given a martingale X for which we know the distribution at a fixed time, and we are given nothing else, what is the best bound we can obtain for the maximum of X up until that time? This is a question with a long history, starting with Doob’s inequalities which bound the maximum in the ${L^p}$ norms and in probability. Later, Blackwell and Dubins (3), Dubins and Gilat (5) and Azema and Yor (1,2) showed that the maximum is bounded above, in stochastic order, by the Hardy-Littlewood transform of the terminal distribution. Furthermore, this bound is the best possible in the sense that there do exists martingales for which it can be attained, for any permissible terminal distribution. Hobson (7,8) considered the case where the starting law is also known, and this was further generalized to the case with a specified distribution at an intermediate time by Brown, Hobson and Rogers (4). Finally, Henry-Labordère, Obłój, Spoida and Touzi (6) considered the case where the distribution of the martingale is specified at an arbitrary set of times. In this post, I will look at the case where only the terminal distribution is specified. This leads to interesting constructions of martingales and, in particular, of continuous martingales with specified terminal distributions, with close connections to the Skorokhod embedding problem.

I will be concerned with the maximum process of a cadlag martingale X,

$\displaystyle X^*_t=\sup_{s\le t}X_s,$

which is increasing and adapted. We can state and prove the bound on ${X^*}$ relatively easily, although showing that it is optimal is more difficult. As the result holds more generally for submartingales, I state it in this case, although I am more concerned with martingales here.

Theorem 1 If X is a cadlag submartingale then, for each ${t\ge0}$ and ${x\in{\mathbb R}}$,

 $\displaystyle {\mathbb P}\left(X^*_t\ge x\right)\le\inf_{y < x}\frac{{\mathbb E}\left[(X_t-y)_+\right]}{x-y}.$ (1)

Proof: We just need to show that the inequality holds for each ${y < x}$, and then it immediately follows for the infimum. Choosing ${y < x^\prime < x}$, consider the stopping time

$\displaystyle \tau=\inf\{s\ge0\colon X_s\ge x^\prime\}.$

Then, ${\tau \le t}$ and ${X_\tau\ge x^\prime}$ whenever ${X^*_t \ge x}$. As ${f(z)\equiv(z-y)_+}$ is nonnegative and increasing in z, this means that ${1_{\{X^*_t\ge x\}}}$ is bounded above by ${f(X_{\tau\wedge t})/f(x^\prime)}$. Taking expectations,

$\displaystyle {\mathbb P}\left(X^*_t\ge x\right)\le{\mathbb E}\left[f(X_{\tau\wedge t})\right]/f(x^\prime).$

Since f is convex and increasing, ${f(X)}$ is a submartingale so, using optional sampling,

$\displaystyle {\mathbb P}\left(X^*_t\ge x\right)\le{\mathbb E}\left[f(X_t)\right]/f(x^\prime).$

Letting ${x^\prime}$ increase to ${x}$ gives the result. ⬜

The bound stated in Theorem 1 is also optimal, and can be achieved by a continuous martingale. In this post, all measures on ${{\mathbb R}}$ are defined with respect to the Borel sigma-algebra.

Theorem 2 If ${\mu}$ is a probability measure on ${{\mathbb R}}$ with ${\int\lvert x\rvert\,d\mu(x) < \infty}$ and ${t > 0}$ then there exists a continuous martingale X (defined on some filtered probability space) such that ${X_t}$ has distribution ${\mu}$ and (1) is an equality for all ${x\in{\mathbb R}}$.

## 31 August 10

### Zero-Hitting and Failure of the Martingale Property

For nonnegative local martingales, there is an interesting symmetry between the failure of the martingale property and the possibility of hitting zero, which I will describe now. I will also give a necessary and sufficient condition for solutions to a certain class of stochastic differential equations to hit zero in finite time and, using the aforementioned symmetry, infer a necessary and sufficient condition for the processes to be proper martingales. It is often the case that solutions to SDEs are clearly local martingales, but is hard to tell whether they are proper martingales. So, the martingale condition, given in Theorem 4 below, is a useful result to know. The method described here is relatively new to me, only coming up while preparing the previous post. Applying a hedging argument, it was noted that the failure of the martingale property for solutions to the SDE ${dX=X^c\,dB}$ for ${c>1}$ is related to the fact that, for ${c<1}$, the process hits zero. This idea extends to all continuous and nonnegative local martingales. The Girsanov transform method applied here is essentially the same as that used by Carlos A. Sin (Complications with stochastic volatility models, Adv. in Appl. Probab. Volume 30, Number 1, 1998, 256-268) and B. Jourdain (Loss of martingality in asset price models with lognormal stochastic volatility, Preprint CERMICS, 2004-267).

Consider nonnegative solutions to the stochastic differential equation

 $\displaystyle \setlength\arraycolsep{2pt} \begin{array}{rl} &\displaystyle dX=a(X)X\,dB,\smallskip\\ &\displaystyle X_0=x_0, \end{array}$ (1)

where ${a\colon{\mathbb R}_+\rightarrow{\mathbb R}}$, B is a Brownian motion and the fixed initial condition ${x_0}$ is strictly positive. The multiplier X in the coefficient of dB ensures that if X ever hits zero then it stays there. By time-change methods, uniqueness in law is guaranteed as long as a is nonzero and ${a^{-2}}$ is locally integrable on ${(0,\infty)}$. Consider also the following SDE,

 $\displaystyle \setlength\arraycolsep{2pt} \begin{array}{rl} &\displaystyle dY=\tilde a(Y)Y\,dB,\smallskip\\ &\displaystyle Y_0=y_0,\smallskip\\ &\displaystyle \tilde a(y) = a(y^{-1}),\ y_0=x_0^{-1} \end{array}$ (2)

Being integrals with respect to Brownian motion, solutions to (1) and (2) are local martingales. It is possible for them to fail to be proper martingales though, and they may or may not hit zero at some time. These possibilities are related by the following result.

Theorem 1 Suppose that (1) and (2) satisfy uniqueness in law. Then, X is a proper martingale if and only if Y never hits zero. Similarly, Y is a proper martingale if and only if X never hits zero.

## 2 June 10

### Failure of Pathwise Integration for FV Processes

Figure 1: A non-pathwise stochastic integral of an FV Process

The motivation for developing a theory of stochastic integration is that many important processes — such as standard Brownian motion — have sample paths which are extraordinarily badly behaved. With probability one, the path of a Brownian motion is nowhere differentiable and has infinite variation over all nonempty time intervals. This rules out the application of the techniques of ordinary calculus. In particular, the Stieltjes integral can be applied with respect to integrators of finite variation, but fails to give a well-defined integral with respect to Brownian motion. The Ito stochastic integral was developed to overcome this difficulty, at the cost both of restricting the integrand to be an adapted process, and the loss of pathwise convergence in the dominated convergence theorem (convergence in probability holds intead).

However, as I demonstrate in this post, the stochastic integral represents a strict generalization of the pathwise Lebesgue-Stieltjes integral even for processes of finite variation. That is, if V has finite variation, then there can still be predictable integrands ${\xi}$ such that the integral ${\int\xi\,dV}$ is undefined as a Lebesgue-Stieltjes integral on the sample paths, but is well-defined in the Ito sense. (more…)

## 1 June 10

### Stochastic Calculus Examples and Counterexamples

Filed under: Examples and Counterexamples,Stochastic Calculus — George Lowther @ 3:00 PM
Tags: ,

I have been posting my stochastic calculus notes on this blog for some time, and they have now reached a reasonable level of sophistication. The basics of stochastic integration with respect to local martingales and general semimartingales have been introduced from a rigorous mathematical standpoint, and important results such as Ito’s lemma, the Ito isometry, preservation of the local martingale property, and existence of solutions to stochastic differential equations have been covered.

I will now start to also post examples demonstrating results from stochastic calculus, as well as counterexamples showing how the methods can break down when the required conditions are not quite met. As well as knowing precise mathematical statements and understanding how to prove them, I generally feel that it can be just as important to understand the limits of the results and how they can break down. Knowing good counterexamples can help with this. In stochastic calculus, especially, many statements have quite subtle conditions which, if dropped, invalidate the whole result. In particular, measurability and integrability conditions are often required in subtle ways. Knowing some counterexamples can help to understand these issues. (more…)

## 25 October 09

### Integrating with respect to Brownian motion

Filed under: Stochastic Calculus — George Lowther @ 9:01 PM
Tags: , , ,

In this post I attempt to give a rigorous definition of integration with respect to Brownian motion (as introduced by Itô in 1944), while keeping it as concise as possible. The stochastic integral can also be defined for a much more general class of processes called semimartingales. However, as Brownian motion is such an important special case which can be handled directly, I start with this as the subject of this post. If ${\{X_s\}_{s\ge 0}}$ is a standard Brownian motion defined on a probability space ${(\Omega,\mathcal{F},\mathop{\mathbb P})}$ and ${\alpha_s}$ is a stochastic process, the aim is to define the integral

 $\displaystyle \int_0^t\alpha_s\,dX_s.$ (1)

In ordinary calculus, this can be approximated by Riemann sums, which converge for continuous integrands whenever the integrator ${X}$ is of finite variation. This leads to the Riemann-Stietjes integral and, generalizing to measurable integrands, the Lebesgue-Stieltjes integral. Unfortunately this method does not work for Brownian motion which, as discussed in my previous post, has infinite variation over all nontrivial compact intervals.

The standard approach is to start by writing out the integral explicitly for piecewise constant integrands. If there are times ${0=t_0\le t_1\le\cdots\le t_n=t}$ such that ${\alpha_s=\alpha_{t_{k-1}}}$ for each ${s\in(t_{k-1},t_k)}$ then the integral is given by the summation,

 $\displaystyle \int_0^t\alpha\,dX = \sum_{k=1}^n\alpha_{t_{k-1}}(X_{t_k}-X_{t_{k-1}}).$ (2)

We could try to extend to more general integrands by approximating by piecewise constant processes but, as mentioned above, Brownian motion has infinite variation paths and this will diverge in general.

Fortunately, when working with random processes, there are a couple of observations which improve the chances of being able to consistently define the integral. They are

• The integral is not a single real number, but is instead a random variable defined on the probability space. It therefore only has to be defined up to a set of zero probability and not on every possible path of ${X}$.
• Rather than requiring limits of integrals to converge for each path of ${X}$ (e.g., dominated convergence), the much weaker convergence in probability can be used.

These observations are still not enough, and the main insight is to only look at integrands which are adapted. That is, the value of ${\alpha_t}$ can only depend on ${X}$ through its values at prior times. This condition is met in most situations where we need to use stochastic calculus, such as with (forward) stochastic differential equations. To make this rigorous, for each time ${t\ge 0}$ let ${\mathcal{F}_t}$ be the sigma-algebra generated by ${X_s}$ for all ${s\le t}$. This is a filtration (${\mathcal{F}_s\subseteq\mathcal{F}_t}$ for ${s\le t}$), and ${(\Omega,\mathcal{F},\{\mathcal{F}_t\}_{t\ge 0},\mathop{\mathbb P})}$ is referred to as a filtered probability space. Then, ${\alpha}$ is adapted if ${\alpha_t}$ is ${\mathcal{F}_t}$-measurable for all times ${t}$. Piecewise constant and left-continuous processes, such as ${\alpha}$ in (2), which are also adapted are commonly referred to as simple processes.

However, as with standard Lebesgue integration, we must further impose a measurability property. A stochastic process ${\alpha}$ can be viewed as a map from the product space ${{\mathbb R}_+\times\Omega}$ to the real numbers, given by ${(t,\omega)\mapsto\alpha_t(\omega)}$. It is said to be jointly measurable if it is measurable with respect to the product sigma-algebra ${\mathcal{B}({\mathbb R}_+)\otimes\mathcal{F}}$, where ${\mathcal{B}}$ refers to the Borel sigma-algebra. Finally, it is called progressively measurable, or just progressive, if its restriction to ${[0,t]\times\Omega}$ is ${\mathcal{B}([0,t])\otimes\mathcal{F}_t}$-measurable for each positive time ${t}$. It is easily shown that progressively measurable processes are adapted, and the simple processes introduced above are progressive.

With these definitions, the stochastic integral of a progressively measurable process ${\alpha}$ with respect to Brownian motion ${X}$ is defined whenever ${\int_0^t\alpha^2ds<\infty}$ almost surely (that is, with probability one). The integral (1) is a random variable, defined uniquely up to sets of zero probability by the following two properties.

• The integral agrees with the explicit formula (2) for simple integrands.
• If ${\alpha^n}$ and ${\alpha}$ are progressive processes such that ${\int_0^t(\alpha^n-\alpha)^2\,ds}$ tends to zero in probability as ${n\rightarrow\infty}$, then
 $\displaystyle \int_0^t\alpha^n\,dX\rightarrow\int_0^t\alpha\,dX,$ (3)

where, again, convergence is in probability.

Blog at WordPress.com.