Chapter 3 The Generator
One operator runs through most of what follows, and it repays meeting on its own before it appears in disguise four times. For a diffusion it is , and Itô’s lemma says precisely that is the drift of . Everything else in this chapter is a consequence: pricing runs backwards on functions of the state, densities run its adjoint forwards, and the two are related by integration by parts and nothing more. Later chapters derive both equations separately and at length. They are the same object, and knowing that in advance turns four derivations into one.
3.1 Itô’s Lemma, Read as a Definition
Chapter 2 established that continuous martingale noise has only one source: a continuous local martingale is an integral against Brownian motion, and there is nothing else on offer. What it did not establish is that a price may be written that way at all — that needs the price to be a semimartingale, which follows from no-arbitrage rather than from continuity, and chapter 4 is where it is obtained. Taking both, together with a drift that accumulates at a rate, a continuous arbitrage-free price is
and this chapter takes that form as given. Itô’s lemma then says that for smooth ,
| (3.1) |
The bracket has a name.
Definition 3.1 (Infinitesimal generator).
The generator of the diffusion is the operator
| (3.2) |
With that, (3.1) reads , and since the stochastic integral has no drift:
Remark (The one sentence to remember).
is the drift of .
Equivalently, and this is the definition that does not presuppose Itô’s lemma,
| (3.3) |
the rate at which the expectation of starts to move from a state . Itô’s lemma is then the statement that for a diffusion this limit is (3.2), which is a computation rather than a definition, and once done it need not be done again.
Remark (The limit is a definition only where it exists).
Equation (3.3) is written as though it always makes sense, and it does not. The set of for which the limit exists — uniformly, in the sense the theory requires — is called the domain of the generator, written , and it is a genuine restriction rather than a technicality to be waved past. Two examples, failing in different ways.
Roughness. Take standard Brownian motion and , and evaluate (3.3) at the origin. Since ,
The limit does not exist, so is not in the domain, and is not a hard quantity to evaluate at the origin — it does not exist.111both the closed form and the divergence, checked. This is not a curiosity, because a call payoff has exactly this kink at the strike. What saves the pricing equation of chapter 5 is that it never asks for applied to the payoff. The payoff enters as the terminal condition , and the equation is solved backwards from it. For every the solution is , a bounded function convolved with a Gaussian density, and that is infinitely differentiable however rough the function was: the semigroup smooths instantly, and the kink exists only at the single instant . So is applied to , which is in its domain, and never to the data that started it off.
The one place the kink is still visible is numerical, where the payoff is evaluated on a finite set of points rather than integrated against a density. The grid quadrature measured in chapter 19 wobbles for exactly this reason as its node count changes: the strike falls in a different place between nodes each time, and there is no smoothing left to hide it.
Growth. Now take , which is smooth everywhere, so the formal expression (3.2) is perfectly well defined at every point. What fails is the expectation:
So does not exist for , and no amount of care with the limit at zero repairs it.222checked, with the exponents combined --- evaluating and the density separately overflows one and underflows the other. The domain therefore has to control growth as well as smoothness, which is why the natural space to work in is bounded continuous functions rather than all of .
The domain is also where boundary behaviour lives.
Definition 3.2 (Absorbing and reflecting barriers).
Let be a diffusion on and . The barrier at is absorbing if the path stops on arrival, for all , and reflecting if the path is turned back instantly, spending zero time at the origin and immediately re-entering .
Both occur. A default intensity or an equity price that is wiped out has an absorbing zero — chapter 16 is built on it, since a defaulted name does not recover — and so does a knocked-out barrier option, whose value is zero from the moment the barrier is touched. A short rate floored at zero which is meant to keep trading has a reflecting one, as does any process constrained to a range for reasons that do not stop it.
Remark (The same , two domains).
The coefficients cannot tell these apart: and are the same function of in both cases, and the difference is entirely a condition at the boundary — which is to say, a domain.
For a reflecting barrier the condition is . A one-sided derivative at the origin would be multiplied by a drift the path is not allowed to follow, and requiring it to vanish is what makes the two sides of the reflection agree.
For an absorbing barrier the process at does not move, so for every and (3.3) gives : the condition is on , not on . If instead the process is killed at the boundary — sent to a cemetery state where every payoff is worth zero, which is what a knock-out does — the natural space is functions with . The two coincide whenever the payoff is worth nothing at the barrier, which in the financial applications it is, and that is why the distinction is easy to miss.
Every statement below is a statement about , and we will stop saying so.
Example 3.1 (Two generators worth recognising).
Geometric Brownian motion, , has
which is every term of the Black-Scholes equation except the and the discounting. Chapter 5 will assemble it.
Theorem 3.3 (Dynkin’s formula).
Let and let be a stopping time with . Then
| (3.4) |
Proof.
Integrate from to :
The last term has zero expectation, and that is the only step needing an argument. A stochastic integral is a local martingale always and a martingale only when its integrand is square integrable over the interval; with in the domain, is bounded, so
by the hypothesis on , and the Itô isometry of chapter 1 turns that into a finite second moment. So the integral is a true martingale, stopped at it still has expectation zero, and (3.4) follows. ∎
Remark (Where the hypothesis on earns its keep).
Dropping does not merely weaken (3.4); it makes it false. Let be standard Brownian motion, , so , and let be the first time reaches . Then is finite almost surely, always, and (3.4) would read .
What has gone wrong is exactly the step above: for that stopping time, the local martingale is not a martingale, and its expectation is not preserved. This is the same failure that appears in chapter 14 as a Riccati solution exploding and in chapter 4 as a doubling strategy.
Almost every expectation computed in these notes is (3.4) with a particular chosen to make simple — often zero, in which case is a martingale and the expectation is just .
Remark (Finding a martingale is choosing with ).
This converts a search into an equation. A function of the state is a martingale exactly when it is in the kernel of the generator, so hunting for martingales — which is what pricing does — is solving .
Chapter 4’s risk neutral measure will be the statement that discounted prices are martingales, which is the statement that they satisfy for the appropriately adjusted . That is the whole of the pricing equation, and it is already visible here.
3.2 The Semigroup
Fix and let the starting point vary. Define
| (3.5) |
Proposition 3.4 (The semigroup property is the Markov property).
For bounded measurable and , .
Proof.
By the tower property, conditioning on ,
The Markov property is the statement that the inner conditional expectation depends on only through , and equals what the same expectation would be for a process started afresh at and run for time — that is, . Substituting,
The middle step is the whole content. The semigroup identity is not a consequence of being Markov that one derives; it is what being Markov says, rewritten with the conditioning replaced by composition of operators. Everything that follows in this chapter is available for Markov processes and unavailable otherwise, and chapter 10’s rough volatility models are outside it for precisely this reason.
Proposition 3.5 (The backward equation).
For ,
| (3.6) |
Proof.
Both equalities come from proposition 3.4 and (3.3), differing only in which side the increment is taken on. Writing the difference quotient with the extra time at the front,
as , by the definition of applied to the function . Taking it at the back instead,
the limit passing through because is a contraction on bounded functions,
since an average of values of cannot exceed the largest value takes anywhere. So uniform convergence of the argument gives uniform convergence of the image. ∎
The two readings of (3.6) are the two ways of computing an expectation, and the chapter’s last section is about the difference between them. The first evolves the function; the second evolves the starting point.
Structure (The generator is a velocity and the semigroup is a flow).
Equation (3.6) is an ordinary differential equation for an operator-valued function of time, with initial condition . Its solution is written
and the notation is more than decoration even though it is formal.
The family is a one-parameter semigroup of operators, and is its derivative at the identity. That is exactly the relationship between a Lie group and its algebra: a rotation by angle is for an angular velocity , and knowing — one matrix, at one instant — determines the whole family of rotations. Here knowing — coefficients, at one instant — determines the whole evolution. This is why a chapter on an operator is a chapter about a process, and it is the same identification chapter 12 needs when the criterion for a finite dimensional realisation turns out to be a condition on a Lie algebra.
Where the analogy strains is that is unbounded: it involves two derivatives, and differentiation makes functions larger without limit. So the power series for does not converge in any straightforward sense, and the identification cannot be established by writing it down.
Remark (What makes the exponential legitimate).
The theorem repairing that is the Hille-Yosida theorem.
The difficulty is that cannot be defined by its series. Hille-Yosida instead characterises which unbounded operators generate a semigroup, and does it through the resolvent — an object that is bounded where is not, because inverting a differential operator is integrating, and integrating smooths. The statement is that generates a contraction semigroup precisely when it is densely defined, closed, and its resolvent satisfies for every .
Two things follow. The exponential notation is a theorem rather than an abbreviation — something has to be checked, and for the diffusions in these notes it holds. And the resolvent, which appears here as a technical device, is the Laplace transform of the semigroup,
which is to say it is the price of a perpetual cashflow discounted at rate . Perpetuities are the objects on which an unbounded generator becomes bounded, and that is not a coincidence: discounting is what makes an infinite horizon finite.
Remark (What this buys).
Two things immediately. The first equality in (3.6) is the backward equation and the second is a statement that the generator commutes with its own semigroup, which is why one may evolve either the function or the starting point and get the same answer — the subject of the next section.
The second is a way of reading the model classes to come. If maps some finite-dimensional family of functions into itself, then does too, and computing for in that family reduces to a finite system of ordinary differential equations. That single observation is why affine models are solvable, and chapter 14 is devoted to it.
3.3 The Adjoint, and Why There Are Two Equations
So far has acted on functions of the state. Densities are not functions of the state in the same sense — they are the things one integrates functions against — and the operator that moves them is not .
Definition 3.6 (Adjoint).
Under the pairing , the adjoint is the operator satisfying
| (3.7) |
for every in the domain of and every in the domain of .
Calculation 3.7 (Computing it, boundary terms included).
Integrate by parts on an interval , keeping every term. Once for the first order piece,
and twice for the second, which leaves two boundary terms because each integration produces one:
Collecting, (3.7) holds with
| (3.8) |
provided the boundary terms cancel:
| (3.9) |
The bracket in (3.9) is not clutter, and the quantity named under it is the reason.
Definition 3.8 (Probability flux).
The flux of a density is
| (3.10) |
so that .
Remark (What the boundary terms are for).
Writing as the derivative of a flux makes the forward equation a conservation law: says probability is neither created nor destroyed, only transported, and is the rate at which it moves past a point. Chapter 9 makes use of exactly this form.
The boundary terms then have a reading rather than being a nuisance to assume away. On the whole line with decaying and bounded, both terms vanish and (3.8) holds as stated. On a bounded interval they do not vanish by themselves, and requiring them to cancel is precisely a boundary condition — at the ends for a reflecting barrier, for an absorbing one. So the pair carries the boundary behaviour in the condition that makes them adjoint, which is the concrete form of the remark above that a domain, not a formula, distinguishes two processes with the same coefficients.
The flux says what the two barriers of the previous section are doing, in one quantity. Integrating the forward equation over ,
when vanishes at infinity. A reflecting barrier has and the total is conserved: nothing crosses. An absorbing barrier has , probability leaving through the origin and not returning, so is the density of the paths that have survived and integrates to less than one. And since the mass lost by time is exactly , the outward flux at the barrier is the density of the first passage time — the object chapter 16 calls the default density and prices from.
Chapter 14 needs the zero-flux case specifically. Setting pointwise and solving is what produces the stationary density there, and the reason it can be done in one dimension is visible in (3.10): a flux with zero divergence on a line must be constant, and a constant flux that vanishes at either end vanishes everywhere. In two dimensions a divergence-free flux may circulate instead, which is the whole of that chapter’s obstruction to reversibility.
Structure (It is the same flux as in physics).
The word is not an analogy. is the continuity equation, the same statement that carries charge in electromagnetism and mass in fluid dynamics, and it is derived the same way: whatever leaves a region has to cross its boundary, which in higher dimensions is the divergence theorem and in one dimension is the that integration by parts produced above. Quantum mechanics calls the corresponding object for the probability current, and means by it exactly what (3.10) means.
The two terms are the two classical fluxes. The drift term is convective transport, density carried along by a velocity field, the of a fluid. The second term is diffusive transport down a gradient, which is Fick’s law for a solute and Fourier’s law for heat, with in the role of the diffusion constant. A Fokker-Planck equation is an advection-diffusion equation, and a Feynman-Kac problem with a discount rate is one with a sink term.
The boundaries transfer too. A reflecting barrier is an insulated wall, no heat crossing it, a Neumann condition. An absorbing barrier is a perfect sink held at zero concentration, a Dirichlet condition, and the flux at it is the rate of arrival — the same computation that gives a first passage density gives the heat flowing into a cold wall.
Two places in the dictionary need care. The first is that sits inside the derivative, where the physical Fick’s law puts the diffusion constant outside. For constant there is no difference; for state-dependent there is, and it is the same question as the Itô against Stratonovich choice of chapter 1 — physics knows it as the Itô-Stratonovich dilemma and has to settle it by asking what the noise is a model of. The next remark is about that difference from the operator side.
The second is the two-dimensional obstruction just mentioned. In stationarity , so the flux is divergence-free — and a divergence-free field need not vanish. It may circulate, exactly as a magnetostatic field does around a current. Reversibility is the condition that the stationary flux is not merely divergence-free but zero; what stands between the two is the circulating part that the Helmholtz decomposition isolates, and on a line there is nowhere for it to live. Above one dimension there is, and an irreversible stationary diffusion is one with a vortex in it.
Remark (Inside or outside is the whole difference).
Put (3.2) and (3.8) side by side. The coefficients are the same, the derivatives are the same, and the only difference is that in they sit outside the derivatives and in they sit inside. Integration by parts is the operation that moves them, and that is the entire content of the relationship.
The difference is not cosmetic, because and depend on : , and the second term is real. Getting it wrong gives an equation that does not conserve probability, and a test makes the failure explicit rather than leaving it as a warning.
That is all the adjoint is. And it immediately gives the equation the density satisfies, at no further cost.
Calculation 3.9 (The forward equation, in two lines).
Let be the density of . Differentiating the pairing two ways and using (3.7),
the third equality being the definition of the generator. This holds for every test function , so the two right hand arguments agree:
| (3.11) |
Under its own name this is the Fokker-Planck, or forward Kolmogorov, equation. Chapter 9 puts it to work; there is nothing left to derive there.
The two equations that occupy later chapters are now both visible, and are one statement seen from two sides:
| Acts on | Equation | |
|---|---|---|
| Backward, | functions of the state | |
| Forward, | densities |
The first is Feynman-Kac, derived in chapter 5 and used to price. The second is (3.11), which chapter 9 uses to obtain Dupire’s formula. Neither derivation needs to be read as new once this table is understood; each is (3.7) with the specific coefficients substituted.
Remark (The duality, in words that a desk uses).
An expectation can be computed in two ways. Evolve the payoff backwards to today and pair it with today’s density, or evolve the density forwards to expiry and pair it with the payoff. By (3.7) these agree exactly, and the choice is one of convenience:
| (3.12) |
Which is more convenient depends on what is being varied. One payoff and many starting points — an option, revalued as the market moves — wants the backward equation. Many payoffs and one starting point — a whole strike surface, today — wants the forward one, since a single forward solve prices every strike at once. That is why chapter 9 reaches for the forward equation and chapter 5 for the backward.