Stochastic Differential Equations
Consider a diffusion process
We are interested in two questions about this process:
- Given a target G at the final time T, what is the expected propability of reaching the target starting from the point x, under the evolution above.
- Given an initial density p, what is the density at the final time T, under the evolution above.
The first question can be generalized to the expected value of a target function uT(x)
Contents |
Kolmogorov backward equation
The answer to the first question is provided by the Kolmogorov backward equation.
,
subject to the final condition
- u(x,T) = uT(x).
This is derived using Ito's lemma.
This equation can be derived from the Feynman-Kac formula by noting that the hit probability is the same as the expected value of us(x) over all paths that originate from state x at time t:
Kolmogorov forward equation
The second question is answered by the Kolmogorov forward equation, or Fokker–Planck equation. It describes the time evolution of the probability density function of the position of a particle,
with initial condition
- p(x,0) = p0(x).
Adjoint Equations
These equations are Adjoint_Processes, in the sense that if we define
we have
which follows from integration by parts.
- We are ignoring boundary terms, by assuming, for example, that we are in the periodic setting.
In particular, we have for any u,p satisfying the forward and backwards equations
since the operators are adjoints.