Motivation

Before going to it, we are going to give several motivations to define the Riemann-Stieltjes integral, which can be considered as an generalization of Riemann integral, the one everyone learns in their Calculus class.

When talking about $\int_a^b fdg$, one may simply think about $\int_a^b fg’dx$. But is it even necessary that $g$ is differentiable? What would happen if $g$ is simply continuous, or even not continuous? Further, given that $g$ is differentiable, can we prove that

in a general way(without assuming $f$ is differentiable)?

Another motivation comes from probability theory. Oftentimes one need to consider discrete case ($\sum$) and continuous case ($\int$) separately. One may say that integral is the limit of summation, but it would be weird to write $\int$ as $\lim\sum$ every time. However, if we have a way to write a sum, for example the expected value of a discrete variable, as an integral, things would be easier. Of course, we don’t want to write such a sum as another sum by adding up the integral on several disjoint segments. That would be weirder.

If you have learned measure theory, you will know that Lebesgue integral does not perfectly cover Riemann integral. For example, $\int_{0}^{\infty}\frac{\sin{x}}{x}dx$ is not integrable in the sense of Lebesgue but Riemann. We cannot treat Lebesgue integral as a generalization of Riemann integral. In this blog post however, we are showing a direct generalization of Riemann integral.

We are trying our best to prevent ourselves from using $\sup$, $\inf$, and differentiation theory. But $\varepsilon-\delta$ language is heavily used here, so make sure that you are good at it.

Riemann-Stieltjes Integral

By a partition $P$ on $[a,b]$ we mean a sequence of numbers $(x_n)$ such that

and we associate its size by

Let $f$, $g$ be bounded real function on $[a,b]$ (again, no continuity or differentiability required). Given a partition $P$ and numbers $c_k$ with $x_k \leq c_k \leq x_{k+1}$, we define the Riemann-Stieltjes sum (RS-sum) by

We say that the limit

exists if there exists some $L \in \mathbb{R}$ such that give $\varepsilon>0$, there exists $\delta>0$ such that whenever $\sigma(P)<\delta$, we have

In this case, we say $f$ is RS(g)-integrable, and the limit is denoted by

This is the so-called Riemann-Stieltjes integral. When $g(x)=x$, we get Riemann integral naturally.

Remarks: Further generalization still available

This integral method can be generalized to Banach space. Let $f$, $g$ be bounded maps of $[a,b]$ into Banach spaces $E$, $F$ respectively. Assume we have a product $E \times F \to G$ denoted by $(u,v) \mapsto uv$ with $\lVert uv \rVert \leq \lVert u \rVert \lVert v \rVert$. Then by replacing the absolute value by norm, still we get the Riemann-Stieltjes integral, although in this case we have

and $G$ is not necessary to be $\mathbb{R}$. This is different from Bochner integral, since no measure theory evolved here.

Linearity with respect to $f$ and $g$

First, we shall show that RS(g)-integrable functions form a vector space. To do this, it suffices to show that

and

are linear. This follows directly from the definition of RS-sum. Let’s see the result.

Suppose we have

Then we have the following identities for $\alpha \in I$.

  1. $\int_a^b \alpha fdg=\alpha I$.
  2. $\int_a^b (f+h)dg=I+J$.
  3. $\int_a^bfd(g+u)=I+K$.
  4. $\int_a^b fd(\alpha g)=\alpha I$.

Proof. We shall show 2 for example. Other three identities follows in the same way.

Notice that the existence of the limit of RS-sum depends only on the size of $P$. For $\varepsilon>0$, there exists some $\delta_1,\delta_2>0$ such that

when $\sigma(P)<\delta_1$ and $\sigma(P)<\delta_2$ respectively. By picking $\delta=\min(\delta_1,\delta_2)$, we see for $\sigma(P)<\delta$, we have

Integration by parts but no differentiation

$f \in RS(g)$ if and only if $g \in RS(f)$. In this case, we also have integration by parts:

You may not believe it, but differentiation does not play any role here, as promised at the beginning.

Proof. Using the summation by parts (by Abel), we have

By writing

we have

where

Consider the partition $Q$ by

we have $x_0,x_1,\cdots,x_{n-1},x_k$ to be intermediate points, and

Since $0 < \sigma(Q) \leq 2\sigma(P) \leq 4\sigma(Q)$, when $\sigma(P) \to 0$, we also have $\sigma(Q) \to 0$ and vice versa. Suppose now $\int_a^b gdf$ exists, we have.

And integration by parts follows.

Suppose $\int_a^bfdg$ exists, then

The proposition is proved. $\square$

The flexibility of Riemann-Stieltjes integral

As said before, we want to represent both continuous and discrete case using integral. For measure theory, we have Lebesgue measure and counting measure. But in some cases, this can be done using Riemann-Stieltjes integral as well. Ordinary Riemann integral and finite or infinite series are both special cases of Riemann-Stieltjes integral.

From integral to series (discrete case)

To do this, we need the unit step function by

If $a<s<b$, $f$ is bounded on $[a,b]$ and continuous at $s$, by putting $g(x)=I(x-s)$, we have

Proof. A simple verification shows that $\int_a^b fdg=\int_s^b fdg$ (by unwinding the RS-sum, one see immediately that $g(x_k)=0$ for all $x_k\leq s$, therefore the partition before $s$ has no tribute to the value of the integral). Now consider the partition $P$ by

We see

As $x_1 \to s$, we have $c_0 \to s$, since $f$ is continuous at $s$, we have $f(c_0) \to f(s)$ as desired. $\square$

By the linearity of RS integral, it’s easy to generalize this to the case of finite linear combination. Namely, for $g(x)=\sum_{k=1}^{n}c_nI(x-s_n)$, we have

But now we are discussing the infinite case.

Suppose $c_n \geq 0$ for all $n$ and $\sum_n c_n$ converges, $(s_n)$ is a sequence of distinct points in $(a,b)$, and

Let $f$ be continuous on $[a,b]$. Then

Proof. First it’s easy to see that $g(x)$ converges for every $x$, and is monotonic with $g(a)=0$, $g(b)=\sum_n c_n$. For given $\varepsilon>0$, there exists some $N$ such that

Put

we have

By putting $M=\sup|f(x)|$, we see

The inequality holds since $g_2(b)-g_2(a)<\varepsilon$. Since $M$ is finite, when $N \to \infty$, we have the desired result.

Transformed into ordinary Riemann integral (continuous case)

Finally we are discussing some differentiation. The following theorem shows the connection between RS integral and Riemann integral.

Let $f$ be continuous and suppose that $g$ is real differentiable on $[a,b]$ while $g’$ is Riemann integrable as well, then $f \in RS(g)$ and

Proof. By mean value theorem, for each $k$, we have

The RS-sum can be written as

Since $g’$ is Riemann integrable, we have

given that $|S(P,g’,x)-\int_a^b g’dx|<\varepsilon$. Therefore

where $M=\sup|f(x)|<\infty$ ($f$ is assumed to be bounded.) . Also notice that $fg’$ is integrable since $f$ is continuous. Therefore

Therefore,

which proves the theorem. $\square$

To sum up, given $\varepsilon>0$, there exists some $\delta>0$ such that if $\sigma(P)<\delta$, we have

and

After some estimation, we get