Almost Sure

6 January 19

Essential Suprema

Filed under: Probability Theory — George Lowther @ 2:00 PM
Tags: ,

Given a sequence {X_1,X_2,\ldots} of real-valued random variables defined on a probability space {(\Omega,\mathcal F,{\mathbb P})}, it is a standard result that the supremum

\displaystyle  \setlength\arraycolsep{2pt} \begin{array}{rl} &\displaystyle X\colon\Omega\rightarrow{\mathbb R}\cup\{\infty\},\smallskip\\ &\displaystyle X(\omega)=\sup_nX_n(\omega). \end{array}

is measurable. To ensure that this is well-defined, we need to allow X to have values in {{\mathbb R}\cup\{\infty\}}, so that {X(\omega)=\infty} whenever the sequence {X_n(\omega)} is unbounded above. The proof of this fact is simple. We just need to show that {X^{-1}((-\infty,a])} is in {\mathcal F} for all {a\in{\mathbb R}}. Writing,

\displaystyle  X^{-1}((-\infty,a])=\bigcap_nX_n^{-1}((-\infty,a]),

the properties that {X_n} are measurable and that the sigma-algebra {\mathcal F} is closed under countable intersections gives the result.

The measurability of the suprema of sequences of random variables is a vital property, used throughout probability theory. However, once we start looking at uncountable collections of random variables things get more complicated. Given a, possibly uncountable, collection of random variables {\mathcal S}, the supremum {S=\sup\mathcal S} is,

\displaystyle  S(\omega)=\sup\left\{X(\omega)\colon X\in\mathcal S\right\}. (1)

However, there are a couple of reasons why this is often not a useful construction:

  • The supremum need not be measurable. For example, consider the probability space {\Omega=[0,1]} with {\mathcal F} the collection of Borel or Lebesgue subsets of {\Omega}, and {{\mathbb P}} the standard Lebesgue measure. For any {a\in[0,1]} define the random variable {X_a(\omega)=1_{\{\omega=a\}}} and, for a subset A of {[0,1]}, consider the collection of random variables {\mathcal S=\{X_a\colon a\in A\}}. Its supremum is

    \displaystyle  S(\omega)=1_{\{\omega\in A\}}

    which is not measurable if A is a non-measurable set (e.g., a Vitali set).

  • Even if the supremum is measurable, it might not be a useful quantity. Letting {X_a} be the random variables on {(\Omega,\mathcal F,{\mathbb P})} constructed above, consider {\mathcal S=\{X_a\colon a\in[0,1]\}}. Its supremum is the constant function {S=1}. As every {X\in\mathcal S} is almost surely equal to 0, it is almost surely bounded above by the constant function {Y=0}. So, the supremum {S=1} is larger than we may expect, and is not what we want in many cases.

The essential supremum can be used to correct these deficiencies, and has been important in several places in my notes. See, for example, the proof of the debut theorem for right-continuous processes. So, I am posting this to use as a reference. Note that there is an alternative use of the term `essential supremum’ to refer to the smallest real number almost surely bounding a specified random variable, which is the one referred to by Wikipedia. This is different from the use here, where we look at a collection of random variables and the essential supremum is itself a random variable.

The essential supremum is really just the supremum taken within the equivalence classes of random variables under the almost sure ordering. Consider the equivalence relation {X\cong Y} if and only if {X=Y} almost surely. Writing {[X]} for the equivalence class of X, we can consider the ordering given by {[X]\le[Y]} if {X\le Y} almost surely. Then, the equivalence class of the essential supremum of a collection {\mathcal S} of random variables is the supremum of the equivalence classes of the elements of {\mathcal S}. In order to avoid issues with unbounded sets, we consider random variables taking values in the extended reals {\bar{\mathbb R}={\mathbb R}\cup\{\pm\infty\}}.

Definition 1 An essential supremum of a collection {\mathcal S} of {\bar{\mathbb R}}-valued random variables,

\displaystyle  S = {\rm ess\,sup\,}\mathcal{S}

is the least upper bound of {\mathcal{S}}, using the almost-sure ordering on random variables. That is, S is an {\bar{\mathbb R}}-valued random variable satisfying

  • upper bound: {S\ge X} almost surely, for all {X\in\mathcal S}.
  • minimality: for all {\bar{\mathbb R}}-valued random variables Y satisfying {Y\ge X} almost surely for all {X\in\mathcal S}, we have {Y\ge S} almost surely.

(more…)

Advertisements

22 May 17

The Gaussian Correlation Inequality

When I first created this blog, the subject of my initial post was the Gaussian correlation conjecture. Using {\mu_n} to denote the standard n-dimensional Gaussian probability measure, the conjecture states that the inequality

\displaystyle  \mu_n(A\cap B)\ge\mu_n(A)\mu_n(B)

holds for all symmetric convex subsets A and B of {{\mathbb R}^n}. By symmetric, we mean symmetric about the origin, so that {-x} is in A if and only {x} is in A, and similarly for B. The standard Gaussian measure by definition has zero mean and covariance matrix equal to the nxn identity matrix, so that

\displaystyle  d\mu_n(x)=(2\pi)^{-n/2}e^{-\frac12x^Tx}\,dx,

with {dx} denoting the Lebesgue integral on {{\mathbb R}^n}. However, if it holds for the standard Gaussian measure, then the inequality can also be shown to hold for any centered (i.e., zero mean) Gaussian measure.

At the time of my original post, the Gaussian correlation conjecture was an unsolved mathematical problem, originally arising in the 1950s and formulated in its modern form in the 1970s. However, in the period since that post, the conjecture has been solved! A proof was published by Thomas Royen in 2014 [7]. This seems to have taken some time to come to the notice of much of the mathematical community. In December 2015, Rafał Latała, and Dariusz Matlak published a simplified version of Royen’s proof [4]. Although the original proof by Royen was already simple enough, it did consider a generalisation of the conjecture to a kind of multivariate gamma distribution. The exposition by Latała and Matlak ignores this generality and adds in some intermediate lemmas in order to improve readability and accessibility. Since then, the result has become widely known and, recently, has even been reported in the popular press [10,11]. There is an interesting article on Royen’s discovery of his proof at Quanta Magazine [12] including the background information that Royen was a 67 year old German retiree who supposedly came up with the idea while brushing his teeth one morning. Dick Lipton and Ken Regan have recently written about the history and eventual solution of the conjecture on their blog [5]. As it has now been shown to be true, I will stop referring to the result as a `conjecture’ and, instead, use the common alternative name — the Gaussian correlation inequality.

In this post, I will describe some equivalent formulations of the Gaussian correlation inequality, or GCI for short, before describing a general method of attacking this problem which has worked for earlier proofs of special cases. I will then describe Royen’s proof and we will see that it uses the same ideas, but with some key differences. (more…)

Create a free website or blog at WordPress.com.