Method of characteristics

In mathematics, the method of characteristics is a technique for solving partial differential equations. Typically, it applies to first-order equations, though in general characteristic curves can also be found for hyperbolic and parabolic partial differential equation. The method is to reduce a partial differential equation (PDE) to a family of ordinary differential equations (ODE) along which the solution can be integrated from some initial data given on a suitable hypersurface.

Characteristics of first-order partial differential equation

For a first-order PDE, the method of characteristics discovers so called characteristic curves along which the PDE becomes an ODE. Once the ODE is found, it can be solved along the characteristic curves and transformed into a solution for the original PDE.

For the sake of simplicity, we confine our attention to the case of a function of two independent variables x and y for the moment. Consider a quasilinear PDE of the form

$a(x,y,z){\frac {\partial z}{\partial x}}+b(x,y,z){\frac {\partial z}{\partial y}}=c(x,y,z).$ (1)

Suppose that a solution z is known, and consider the surface graph z = z(x,y) in R³. A normal vector to this surface is given by

$\left({\frac {\partial z}{\partial x}}(x,y),{\frac {\partial z}{\partial y}}(x,y),-1\right).\,$

As a result, equation (1) is equivalent to the geometrical statement that the vector field

$(a(x,y,z),b(x,y,z),c(x,y,z))\,$

is tangent to the surface z = z(x,y) at every point, for the dot product of this vector field with the above normal vector is zero. In other words, the graph of the solution must be a union of integral curves of this vector field. These integral curves are called the characteristic curves of the original partial differential equation and follow as the solutions of the characteristic equations:

${\begin{aligned}{\frac {dx}{dt}}&=a(x,y,z),\\[8pt]{\frac {dy}{dt}}&=b(x,y,z),\\[8pt]{\frac {dz}{dt}}&=c(x,y,z).\end{aligned}}$

A parametrization invariant form of the Lagrange–Charpit equations is:

${\frac {dx}{a(x,y,z)}}={\frac {dy}{b(x,y,z)}}={\frac {dz}{c(x,y,z)}}.$

Linear and quasilinear cases

Consider now a PDE of the form

$\sum _{i=1}^{n}a_{i}(x_{1},\dots ,x_{n},u){\frac {\partial u}{\partial x_{i}}}=c(x_{1},\dots ,x_{n},u).$

For this PDE to be linear, the coefficients a_i may be functions of the spatial variables only, and independent of u. For it to be quasilinear, a_i may also depend on the value of the function, but not on any derivatives. The distinction between these two cases is inessential for the discussion here.

For a linear or quasilinear PDE, the characteristic curves are given parametrically by

$(x_{1},\dots ,x_{n},u)=(x_{1}(s),\dots ,x_{n}(s),u(s))$

$u(\mathbf {X} (s))=U(s)$

such that the following system of ODEs is satisfied

${\frac {dx_{i}}{ds}}=a_{i}(x_{1},\dots ,x_{n},u)$ (2)

${\frac {du}{ds}}=c(x_{1},\dots ,x_{n},u).$ (3)

Equations (2) and (3) give the characteristics of the PDE.

Proof for quasilinear case

In the quasilinear case, the use of the method of characteristics is justified by Grönwall's inequality. The above equation may be written as $$\mathbf {a} (\mathbf {x} ,u)\cdot \nabla u(\mathbf {x} )=c(\mathbf {x} ,u)$$ We must distinguish between the solutions to the ODE and the solutions to the PDE, which we do not know are equal a priori. Letting capital letters be the solutions to the ODE we find $$\mathbf {X} '(s)=\mathbf {a} (\mathbf {X} (s),U(s))$$ $$U'(s)=c(\mathbf {X} (s),U(s))$$ Examining $\Delta (s)=|u(\mathbf {X} (s))-U(s)|^{2}$, we find, upon differentiating that $$\Delta '(s)=2{\big (}u(\mathbf {X} (s))-U(s){\big )}{\Big (}\mathbf {X} '(s)\cdot \nabla u(\mathbf {X} (s))-U'(s){\Big )}$$ which is the same as $$\Delta '(s)=2{\big (}u(\mathbf {X} (s))-U(s){\big )}{\Big (}\mathbf {a} (\mathbf {X} (s),U(s))\cdot \nabla u(\mathbf {X} (s))-c(\mathbf {X} (s),U(s)){\Big )}$$ We cannot conclude the above is 0 as we would like, since the PDE only guarantees us that this relationship is satisfied for $u(\mathbf {x} )$, $\mathbf {a} (\mathbf {x} ,u)\cdot \nabla u(\mathbf {x} )=c(\mathbf {x} ,u)$, and we do not yet know that $U(s)=u(\mathbf {X} (s))$. However, we can see that $$\Delta '(s)=2{\big (}u(\mathbf {X} (s))-U(s){\big )}{\Big (}\mathbf {a} (\mathbf {X} (s),U(s))\cdot \nabla u(\mathbf {X} (s))-c(\mathbf {X} (s),U(s))-{\big (}\mathbf {a} (\mathbf {X} (s),u(\mathbf {X} (s)))\cdot \nabla u(\mathbf {X} (s))-c(\mathbf {X} (s),u(\mathbf {X} (s))){\big )}{\Big )}$$ since by the PDE, the last term is 0. This equals $$\Delta '(s)=2{\big (}u(\mathbf {X} (s))-U(s){\big )}{\Big (}{\big (}\mathbf {a} (\mathbf {X} (s),U(s))-\mathbf {a} (\mathbf {X} (s),u(\mathbf {X} (s))){\big )}\cdot \nabla u(\mathbf {X} (s))-{\big (}c(\mathbf {X} (s),U(s))-c(\mathbf {X} (s),u(\mathbf {X} (s))){\big )}{\Big )}$$ By the triangle inequality, we have $$|\Delta '(s)|\leq 2{\big |}u(\mathbf {X} (s))-U(s){\big |}{\Big (}{\big \|}\mathbf {a} (\mathbf {X} (s),U(s))-\mathbf {a} (\mathbf {X} (s),u(\mathbf {X} (s))){\big \|}\ \|\nabla u(\mathbf {X} (s))\|+{\big |}c(\mathbf {X} (s),U(s))-c(\mathbf {X} (s),u(\mathbf {X} (s))){\big |}{\Big )}$$ Assuming $\mathbf {a} ,c$ are at least $C^{1}$, we can bound this for small times. Choose a neighborhood $\Omega$ around $\mathbf {X} (0),U(0)$ small enough such that $\mathbf {a} ,c$ are locally Lipschitz. By continuity, $(\mathbf {X} (s),U(s))$ will remain in $\Omega$ for small enough $s$. Since $U(0)=u(\mathbf {X} (0))$, we also have that $(\mathbf {X} (s),u(\mathbf {X} (s)))$ will be in $\Omega$ for small enough $s$ by continuity. So, $(\mathbf {X} (s),U(s))\in \Omega$ and $(\mathbf {X} (s),u(\mathbf {X} (s)))\in \Omega$ for $s\in [0,s_{0}]$. Additionally, $\|\nabla u(\mathbf {X} (s))\|\leq M$ for some $M\in \mathbb {R}$ for $s\in [0,s_{0}]$ by compactness. From this, we find the above is bounded as $$|\Delta '(s)|\leq C|u(\mathbf {X} (s))-U(s)|^{2}=C|\Delta (s)|$$ for some $C\in \mathbb {R}$. It is a straightforward application of Grönwall's Inequality to show that since $\Delta (0)=0$ we have $\Delta (s)=0$ for as long as this inequality holds. We have some interval $[0,\varepsilon )$ such that $u(X(s))=U(s)$ in this interval. Choose the largest $\varepsilon$ such that this is true. Then, by continuity, $U(\varepsilon )=u(\mathbf {X} (\varepsilon ))$. Provided the ODE still has a solution in some interval after $\varepsilon$, we can repeat the argument above to find that $u(X(s))=U(s)$ in a larger interval. Thus, so long as the ODE has a solution, we have $u(X(s))=U(s)$.

Fully nonlinear case

Consider the partial differential equation

$F(x_{1},\dots ,x_{n},u,p_{1},\dots ,p_{n})=0$ (4)

where the variables p_i are shorthand for the partial derivatives

$p_{i}={\frac {\partial u}{\partial x_{i}}}.$

Let (x_i(s),u(s),p_i(s)) be a curve in R²ⁿ⁺¹. Suppose that u is any solution, and that

$u(s)=u(x_{1}(s),\dots ,x_{n}(s)).$

Along a solution, differentiating (4) with respect to s gives

$\sum _{i}(F_{x_{i}}+F_{u}p_{i}){\dot {x}}_{i}+\sum _{i}F_{p_{i}}{\dot {p}}_{i}=0$

${\dot {u}}-\sum _{i}p_{i}{\dot {x}}_{i}=0$

$\sum _{i}({\dot {x}}_{i}dp_{i}-{\dot {p}}_{i}dx_{i})=0.$

The second equation follows from applying the chain rule to a solution u, and the third follows by taking an exterior derivative of the relation $du-\sum _{i}p_{i}\,dx_{i}=0$. Manipulating these equations gives

${\dot {x}}_{i}=\lambda F_{p_{i}},\quad {\dot {p}}_{i}=-\lambda (F_{x_{i}}+F_{u}p_{i}),\quad {\dot {u}}=\lambda \sum _{i}p_{i}F_{p_{i}}$

where λ is a constant. Writing these equations more symmetrically, one obtains the Lagrange–Charpit equations for the characteristic

${\frac {{\dot {x}}_{i}}{F_{p_{i}}}}=-{\frac {{\dot {p}}_{i}}{F_{x_{i}}+F_{u}p_{i}}}={\frac {\dot {u}}{\sum p_{i}F_{p_{i}}}}.$

Geometrically, the method of characteristics in the fully nonlinear case can be interpreted as requiring that the Monge cone of the differential equation should everywhere be tangent to the graph of the solution.

Example

As an example, consider the advection equation (this example assumes familiarity with PDE notation, and solutions to basic ODEs).

$a{\frac {\partial u}{\partial x}}+{\frac {\partial u}{\partial t}}=0$

where $a$ is constant and $u$ is a function of $x$ and $t$. We want to transform this linear first-order PDE into an ODE along the appropriate curve; i.e. something of the form

${\frac {d}{ds}}u(x(s),t(s))=F(u,x(s),t(s)),$

where $(x(s),t(s))$ is a characteristic line. First, we find

${\frac {d}{ds}}u(x(s),t(s))={\frac {\partial u}{\partial x}}{\frac {dx}{ds}}+{\frac {\partial u}{\partial t}}{\frac {dt}{ds}}$

by the chain rule. Now, if we set ${\frac {dx}{ds}}=a$ and ${\frac {dt}{ds}}=1$ we get

$a{\frac {\partial u}{\partial x}}+{\frac {\partial u}{\partial t}}$

which is the left hand side of the PDE we started with. Thus

${\frac {d}{ds}}u=a{\frac {\partial u}{\partial x}}+{\frac {\partial u}{\partial t}}=0.$

So, along the characteristic line $(x(s),t(s))$, the original PDE becomes the ODE $u_{s}=F(u,x(s),t(s))=0$. That is to say that along the characteristics, the solution is constant. Thus, $u(x_{s},t_{s})=u(x_{0},0)$ where $(x_{s},t_{s})\,$ and $(x_{0},0)$ lie on the same characteristic. Therefore, to determine the general solution, it is enough to find the characteristics by solving the characteristic system of ODEs:

• ${\frac {dt}{ds}}=1$, letting $t(0)=0$ we know $t=s$,
• ${\frac {dx}{ds}}=a$, letting $x(0)=x_{0}$ we know $x=as+x_{0}=at+x_{0}$,
• ${\frac {du}{ds}}=0$, letting $u(0)=f(x_{0})$ we know $u(x(t),t)=f(x_{0})=f(x-at)$.

In this case, the characteristic lines are straight lines with slope $a$, and the value of $u$ remains constant along any characteristic line.

Characteristics of linear differential operators

Let X be a differentiable manifold and P a linear differential operator

$P:C^{\infty }(X)\to C^{\infty }(X)$

of order k. In a local coordinate system xⁱ,

$P=\sum _{|\alpha |\leq k}P^{\alpha }(x){\frac {\partial }{\partial x^{\alpha }}}$

in which α denotes a multi-index. The principal symbol of P, denoted σ_P, is the function on the cotangent bundle T^∗X defined in these local coordinates by

$\sigma _{P}(x,\xi )=\sum _{|\alpha |=k}P^{\alpha }(x)\xi _{\alpha }$

where the ξ_i are the fiber coordinates on the cotangent bundle induced by the coordinate differentials dxⁱ. Although this is defined using a particular coordinate system, the transformation law relating the ξ_i and the xⁱ ensures that σ_P is a well-defined function on the cotangent bundle.

The function σ_P is homogeneous of degree k in the ξ variable. The zeros of σ_P, away from the zero section of T^∗X, are the characteristics of P. A hypersurface of X defined by the equation F(x) = c is called a characteristic hypersurface at x if

$\sigma _{P}(x,dF(x))=0.$

Invariantly, a characteristic hypersurface is a hypersurface whose conormal bundle is in the characteristic set of P.

Qualitative analysis of characteristics

Characteristics are also a powerful tool for gaining qualitative insight into a PDE.

One can use the crossings of the characteristics to find shock waves for potential flow in a compressible fluid. Intuitively, we can think of each characteristic line implying a solution to $u$ along itself. Thus, when two characteristics cross, the function becomes multi-valued resulting in a non-physical solution. Physically, this contradiction is removed by the formation of a shock wave, a tangential discontinuity or a weak discontinuity and can result in non-potential flow, violating the initial assumptions.

Characteristics may fail to cover part of the domain of the PDE. This is called a rarefaction, and indicates the solution typically exists only in a weak, i.e. integral equation, sense.

The direction of the characteristic lines indicates the flow of values through the solution, as the example above demonstrates. This kind of knowledge is useful when solving PDEs numerically as it can indicate which finite difference scheme is best for the problem.

See also

• Method of quantum characteristics

References

• Courant, Richard; Hilbert, David (1962), Methods of Mathematical Physics, Volume II, Wiley-Interscience
• Demidov, S. S. (1982). "The study of partial differential equations of the first order in the 18th and 19th centuries". Archive for History of Exact Sciences. 26 (4). Springer Science and Business Media LLC: 325–350. doi:10.1007/bf00418753. ISSN 0003-9519.
• Evans, Lawrence C. (1998), Partial Differential Equations, Providence: American Mathematical Society, ISBN 0-8218-0772-2
• John, Fritz (1991). Partial Differential Equations (4th ed.). New York: Springer Science & Business Media. ISBN 978-0-387-90609-6.
• Zauderer, Erich (2006). Partial Differential Equations of Applied Mathematics. Wiley. doi:10.1002/9781118033302. ISBN 978-0-471-69073-3.* Polyanin, A. D.; Zaitsev, V. F.; Moussiaux, A. (2002), Handbook of First Order Partial Differential Equations, London: Taylor & Francis, ISBN 0-415-27267-X
• Pinchover, Yehuda; Rubinstein, Jacob (2005). An Introduction to Partial Differential Equations. Cambridge University Press. doi:10.1017/cbo9780511801228. ISBN 978-0-511-80122-8.
• Polyanin, A. D. (2002), Handbook of Linear Partial Differential Equations for Engineers and Scientists, Boca Raton: Chapman & Hall/CRC Press, ISBN 1-58488-299-9
• Sarra, Scott (2003), "The Method of Characteristics with applications to Conservation Laws", Journal of Online Mathematics and Its Applications
• Streeter, VL; Wylie, EB (1998), Fluid mechanics (International 9th Revised ed.), McGraw-Hill Higher Education
• Zachmanoglou, E. C.; Thoe, Dale W. (1986). Introduction to Partial Differential Equations with Applications. New York: Courier Corporation. ISBN 0-486-65251-3.

External links

• Prof. Scott Sarra tutorial on Method of Characteristics
• Prof. Alan Hood tutorial on Method of Characteristics