The Lebesgue-Radon-Nikodym theorem and how von Neumann proved it

An introduction

If one wants to learn the fundamental theorem of Calculus in the sense of Lebesgue integral, properties of measures have to be taken into account. In elementary calculus, one may consider something like

where $f$ is differentiable, say, everywhere on an interval. Now we restrict $f$ to be a differentiable and nondecreasing real function defined on $I=[a,b]$. There we got a one-to-one function defined by

For measurable sets $E\in \mathfrak{M}$, it can be seen that if $m(E)=0$, we have $m(g(E))=0$. Moreover, $g(E)\in \mathfrak{M}$, and $g$ is one-to-one. Therefore we can define a measure like

If we have a relation

(in fact, this is the Radon-Nikodym theorem we will prove later), the fundamental theorem of calculus for $f$ becomes somewhat clear since if $E=[a,x]$, we got $g(E)=[a+f(a),x+f(x)]$, thus we got

which trivially implies

the function $h$ looks like to be $g^{\prime }=f^{\prime }+1$.

We are not proving the fundamental theorem here. But this gives rise to a question. Is it possible to find a function such that

one may write as

or, more generally, a measure $\mu$ with respect to another measure $\lambda$? Does this $\mu$ exist with respect to $\lambda$? Does this $h$ exist? Lot of questions. Luckily the Lebesgue decomposition and Radon-Nikodym theorem make it possible.

Notations

Let $\mu$ be a positive measure on a $\sigma$-algebra $\mathfrak{M}$, let $\lambda$ be any arbitrary measure (positive or complex) defined on $\mathfrak{M}$.

We write

if $\lambda (E)=0$ for every $E\in \mathfrak{M}$ for which $\mu (E)=0$. (You may write $\mu \ll m$ in the previous section.) We say $\lambda$ is absolutely continuous with respect to $\mu$.

Another relation between measures worth consideration is being mutually singular. If we have $\lambda (E)=\lambda (A\cap E)$ for every $E\in \mathfrak{M}$, we say $\lambda$ is concentrated on $A$.

If we now have two measures ${\mu }_1$ and ${\mu }_2$, two disjoint sets $A$ and $B$ such that ${\mu }_1$ is concentrated on $A$, ${\mu }_2$ is concentrated on $B$, we say ${\mu }_1$ and ${\mu }_2$ are mutually singular, and write

The Theorem of Lebesgue-Radon-Nikodym

Let $\mu$ be a positive $\sigma$-finite measure on $\mathfrak{M}$, and $\lambda$ a complex measure on $\mathfrak{M}$.

• There exists a unique pair of complex measures ${\lambda }_{ac}$ and ${\lambda }_s$ on $\mathfrak{M}$ such that

$$\lambda ={\lambda }_{ac}+{\lambda }_s{\lambda }_{ac}\ll \mu {\lambda }_s\perp \mu$$

• There is a unique $h\in L^1(\mu )$ such that

$${\lambda }_{ac}(E)={\int }_{E}hd\mu$$

for every $E\in \mathfrak{M}$.

The unique pair $({\lambda }_{ac},{\lambda }_s)$ is called the Lebesgue decomposition; the existence of $h$ is called the Radon-Nikodym theorem, and $h$ is called the Radon-Nikodym derivative. One also writes $d{\lambda }_{ac}=hd\mu$ or $\frac{d{\lambda }_{ac}}{d\mu }=h$ in this situation.

These are two separate theorems, but von Neumann gave the idea to prove these two at one stroke.

If we already have $\lambda \ll \mu$, then ${\lambda }_s=0$ and the Radon-Nikodym derivative shows up in the natural of things.

Also, one cannot ignore the fact that $m$ the Lebesgue measure is $\sigma$-finite.

Proof explained

Step 1 - Construct a bounded functional

We are going to employ Hilbert space technique in this proof. Precisely speaking, we are going to construct a bounded linear functional to find another function, namely $g$, which is the epicentre of this proof.

The boundedness of $\lambda$ is clear since it’s complex, but $\mu$ is only assumed to be $\sigma$-finite. Therefore we need some adjustment onto $\mu$.

1.1 Replacing $\mu$ with a finite measure

If $\mu$ is a positive $\sigma$-finite measure on a $\sigma$-algebra $\mathfrak{M}$ in a set $X$, then there is a function $w$ such that $w\in L^1(\mu )$ and $0<w(x)<1$ for every $x\in X$.

The $\sigma$-finiteness of $\mu$ denotes that, there exist some sets $E_n$ such that

and that $\mu (E_n)<\mathrm{\infty }$ for all $n$.

Define

(you can also say that $w_n=\frac{1}{2^n(1+\mu (E_n))}{\chi }_{E_n}$), then we have

satisfies $0<w<1$ for all $x$. With $w$, we are able to define a new measure, namely

The fact that $\tilde{\mu }(E)$ is a measure can be validated by considering ${\int }_{E}wd\mu ={\int }_X{\chi }_{E}wd\mu$. It’s more important that $\tilde{\mu }(E)$ is bounded and $\tilde{\mu }(E)=0$ if and only if $\mu (E)=0$. The second one comes from the strict positivity of $w$. For the first one, notice that

1.2 A bounded linear functional associated with $\lambda$

Since $\lambda$ is complex, without loss of generality, we are able to assume that $\lambda$ is a positive bounded measure on $\mathfrak{M}$. By 1.1, we are able to obtain a positive bounded measure by

Following the construction of Lebesgue measure, we have

for all nonnegative measurable function $f$. Also, notice that $\lambda \le \phi$, we have

for $f\in L^2(\phi )$ by Schwarz inequality.

Since $\phi (X)<\mathrm{\infty }$, we have

to be a bounded linear functional on $L^2(\phi )$.

Step 2 - Find the associated function with respect to $\lambda$

Since $L^2(\phi )$ is a Hilbert space, every bounded linear functional on a Hilbert space $H$ is given by an inner product with an element in $H$. That is, by the completeness of $L^2(\phi )$, there exists a function $g$ such that

The properties of $L^2$ space shows that $g$ is determined almost everywhere with respect to $\phi$.

For $E\in \mathfrak{M}$, we got

which implies $0\le g\le 1$ for almost every $x$ with respect to $\phi$. Therefore we are able to assume that $0\le g\le 1$ without ruining the identity. The proof is in the bag once we define $A$ to be the set where $0\le g<1$ and $B$ the set where $g=1$.

Step 3 - Generate ${\lambda }_{ac}$ and ${\lambda }_s$ and the Radon-Nikodym derivative at one stroke

We claim that $\lambda (A\cap E)$ and $\lambda (B\cap E)$ form the decomposition we are looking for, ${\lambda }_{ac}$ and ${\lambda }_s$, respectively. Namely, ${\lambda }_{ac}=\lambda (A\cap E)$, ${\lambda }_s=\lambda (B\cap E)$.

Proving ${\lambda }_s\perp \mu$

If we combine $\mathrm{\Lambda }f=(f,g)$ and $\phi =\lambda +\tilde{\mu }$ together, we have

Put $f={\chi }_B$, we have

Since $w$ is strictly positive, we see that $\mu (B)=0$. Notice that $A\cap B=\varnothing$ and $A\cup B=X$. For $E\in \mathfrak{M}$, we write $E=E_A\cup E_B$, where $E_A\subset A$ and $E_B\subset B$. Therefore

Therefore $\mu$ is concentrated on $A$.

For ${\lambda }_s$, observe that

Hence ${\lambda }_s$ is concentrated on $B$. This observation shows that ${\lambda }_s\perp \mu$.

Proving ${\lambda }_{ac}\ll \mu$ by the Radon-Nikodym derivative

The relation that ${\lambda }_{ac}\ll \mu$ will be showed by the existence of the Radon-Nikodym derivative.

If we replace $f$ by

where $E\in \mathfrak{M}$, we have

Notice that

Define $h_n=g(1+g+g^2+\cdots +g^n)w$, we see that on $A$, $h_n$ converges monotonically to

By monotone convergence theorem, we got

for every $E\in \mathfrak{M}$.

The measurable function $h$ is the desired Radon-Nikodym derivative once we show that $h\in L^1(\mu )$. Replacing $E$ with $X$, we see that

Clearly, if $\mu (E)=0$, we have

which shows that

as desired.

Step 3 - Generalization onto complex measures

By far we have proved this theorem for positive bounded measure. For real bounded measure, we can apply the proceeding case to the positive and negative part of it. For all complex measures, we have

where ${\lambda }_1$ and ${\lambda }_2$ are real.

Step 4 - Uniqueness of the decomposition

If we have two Lebesgue decompositions of the same measure, namely $({\lambda }_{ac},{\lambda }_s)$ and $({\lambda }_{ac}^{\prime },{\lambda }_s^{\prime })$, we shall show that

By the definition of the decomposition we got

with ${\lambda }_{ac}-{\lambda }_{ac}^{\prime }\ll \mu$ and ${\lambda }_s^{\prime }-{\lambda }_s\perp \mu$. This implies that ${\lambda }_s^{\prime }-{\lambda }_s\ll \mu$ as well.

Since ${\lambda }_s^{\prime }-{\lambda }_s\perp \mu$, there exists a set with $\mu (A)=0$ on which ${\lambda }_s^{\prime }-{\lambda }_s$ is concentrated; the absolute continuity shows that ${\lambda }_s^{\prime }(E)-{\lambda }_s(E)=0$ for all $E\subset A$. Hence ${\lambda }_s^{\prime }-{\lambda }_s$ is concentrated on $X-A$. Therefore we got $({\lambda }_s^{\prime }-{\lambda }_s)\perp ({\lambda }_s^{\prime }-{\lambda }_s)$, which forces ${\lambda }_s^{\prime }-{\lambda }_s=0$. The uniqueness is proved.

(Following the same process one can also show that ${\lambda }_{ac}\perp {\lambda }_s$.)