Skip to content

8. Differential equations: Part 2

The second lecture on differential equations consists of three parts, each with their own video:

Total video length: 1 hour 9 minutes

and at the end of the lecture notes, there is a set of corresponding exercises:


8.1. Higher order linear differential equations

8.1.1 Definitions

In the previous lecture, we focused on first order linear differential equations and systems of such equations. In this lecture, we switch focus to DE's which involve higher derivatives of the function that we would like to solve for. To facilitate this shift, we are going to change notation.

Change of notation

In the previous lecture, we wrote differential equations for . In this lecture we will write DE's of , where is the unknown function and is the independent variable. For this purpose, we make the following definitions,

In the new notation, a linear -th order differential equation with constant coefficients reads

Linear combination of solutions are still solutions

Note that, like it was the case for first order linear DE's, the property of linearity once again means that if and are both solutions, and and are constants,

then a linear combination of the solutions is also a solution.

8.1.2 Mapping to a linear system of first-order DEs

In order to solve a higher order linear DE, we will present a trick that makes it possible to map the problem of solving a single -th order linear DE into a related problem of solving a system of first order linear DE's.

To begin, define:

Then, the differential equation can be re-written as

Notice that these equations together form a linear first order system, of which the first equations are trivial. Note that this trick can be used to reduce any system of -th order linear DE's to a larger system of first order linear DE's.

Since we already discussed the method of solution for first order linear systems, we will outline the general solution to this system. As before, the general solution will be the linear combination of linearly independent solutions , , which make up a basis for the solution space. Thus, the general solution has the form

Wronskian

To check that the solutions form a basis, it is sufficient to verify

The determinant in the preceding line is called the Wronskian or Wronski determinant.

8.1.3. General solution

To determine particular solutions, we need to find the eigenvalues of

It is possible to show that

in which is the characteristic polynomial of the system matrix ,

Proof of

As we demonstrate below, the proof relies on the co-factor expansion technique for calculating a determinant.

In the second last line of the proof, we indicated that the method of co-factor expansion demonstrated above is repeated an additional times. This completes the proof.

With the characteristic polynomial, it is possible to write the differential equation as

To determine solutions, we need to find such that . By the fundamental theorem of algebra, we know that can be written as

In the previous equation are the k roots of the equations, and is the multiplicity of each root. Note that the multiplicities satisfy .

If the multiplicity of each eigenvalue is one, then solutions which form the basis are then given as:

If there are eigenvalues with multiplicity greater than one, the the solutions which form the basis are given as

Proof that basis solutions to are given by

In order to prove that basis solutions to the differential equation rewritten using the characteristic polynomial into the form are given by a general formula, taking into account the multiplicity of each eigenvalue: let us first recollect some definitions:

  1. A linear -th order differential equation with constant coefficients reads

  2. The general solution will be a linear combination of linearly independent solutions , , which make up a basis for the solution space. Thus, the general solution has the form:

  3. The key to finding the suitable basis is to rewrite the DEG in terms of its basis solutions using the properties of the characteristic polynomial and the differential operator as its variable: and thus, in the general form using the fundamental theorem of algebra:

  4. The solutions to this equation are given as: and for each eigenvalue with multiplicity greater than one, , there is a subset of size with solutions corresponding to that eigenvalue; These solve the differential equation above in the general form:

  5. The solutions given above can form the basis if their Wronskian is non-zero on an interval (it may vanish at isolated points); and correspondingly, if any eigenvalue has a multiplicity higher than one: Computation of the Wronskian can quickly become a tedious task in general. In this case, we can easily observe that the basis functions are linearly independent, because is not possible to obtain any of the solutions from a linear combination of the others!

    For example, cannot be obtained from

Example: Second order homogeneous linear DE with constant coefficients

Consider the equation

The characteristic polynomial of this equation is

There are three cases for the possible solutions, depending upon the value of E.

Case 1: For ease of notation, define for some constant . The characteristic polynomial can then be factored as

Following our formulation for the solution, the two basis functions for the solution space are

Alternatively, the trigonometric functions can serve as basis functions, since they are linear combinations of and which remain linearly independent,

Case 2: This time, define , for constant . The characteristic polynomial can then be factored as

The two basis functions for this solution are then

Case 3: In this case, there is a repeated eigenvalue (equal to ), since the characteristic polynomial reads

Hence, the basis functions for the solution space read

8.2. Partial differential equations: Separation of variables

8.2.1. Definitions and examples

A partial differential equation (PDE) is an equation involving a function of two or more independent variables and derivatives of said function. These equations are classified similarly to ordinary differential equations (the subject of our earlier study). For example, they are called linear if no terms such as

occur. A PDE can be classified as -th order according to the highest derivative order of either variable occurring in the equation. For example, the equation

is a order equation because of the third derivative with respect to x in the equation.

To begin with a context, we demonstrate that PDEs are of fundamental importance in physics, especially in quantum physics. In particular, the Schrödinger equation, which is of central importance in quantum physics, is a partial differential equation with respect to time and space. This equation is essential because it describes the evolution in time and space of the entire description of a quantum system , which is known as the wave function.

For a free particle in one dimension, the Schrödinger equation is

When we studied ODEs, an initial condition was necessary in order to fully specify a solution. Similarly, in the study of PDEs an initial condition is required but now also boundary conditions are required. Going back to the intuitive discussion from the lecture on ODEs, each of these conditions is necessary in order to specify an integration constant that occurs in solving the equation. In partial differential equations at least one such constant will arise from the time derivative and likewise at least one from the spatial derivative.

For the Schrödinger equation, we could supply the initial conditions together with the boundary conditions

This particular set of boundary conditions corresponds to a particle in a box, a situation which is used as the base model for many derivations in quantum physics.

Another example of a partial differential equation common in physics is the Laplace equation

In quantum physics, Laplace's equation is important for the study of the hydrogen atom. In three dimensions and using spherical coordinates, the solutions to Laplace's equation are special functions called spherical harmonics. In the context of the hydrogen atom, these functions describe the wave function of the system and a unique spherical harmonic function corresponds to each distinct set of quantum numbers.

In the study of PDEs, there are no comprehensive overall treatment methods to the same extent as there is for ODEs. There are several techniques which can be applied to solving these equations and the choice of technique must be tailored to the equation at hand. Hence, we focus on some specific examples that are common in physics.

8.2.2. Separation of variables

Let us focus on the one-dimensional Schrödinger equation of a free particle:

To attempt a solution, we will make a separation ansatz,

Separation ansatz

The separation ansatz is a restrictive ansatz, not a fully general one. In general, for such a treatment to be valid, an equation and the boundary conditions given with it have to fulfill certain properties. In this course however, you will only be asked to use this technique when it is suitable.

General procedure for the separation of variables:

  1. Substituting the separation ansatz into the PDE,

    Notice that in the above equation the derivatives on and can each be written as ordinary derivatives, , . This is so because each one is a function of only one variable.

  2. Next, divide both sides of the equation by ,

    In the previous line we concluded that each part of the equation must be equal to a constant, which we defined as . This follows because the left hand side of the equation only has a dependence on the spatial coordinate , whereas the right hand side only has dependence on the time coordinate . If we have two functions and such that , then .

  3. The constant we defined, , is called a separation constant. With it, we can break the spatial and time dependent parts of the equation into two separate equations,

To summarize, this process has broken one partial differential equation into two ordinary differential equations of different variables. In order to do this, we needed to introduce a separation constant, which remains to be determined.

8.2.3. Boundary and eigenvalue problems

Continuing on with the Schrödinger equation example from the previous section, let us focus on the spatial part

This has the form of an eigenvalue equation, in which is the eigenvalue, is the linear operator and is the eigenfunction.

Notice that this ordinary differential equation is specified along with its boundary conditions. Note that in contrast to an initial value problem, a boundary value problem does not always have a solution. For example, in the figure below, regardless of the initial slope, the curves never reach when .

image

For boundary value problems like this, there are only solutions for particular eigenvalues . Coming back to the example, it turns out that solutions only exist for .

This can be shown quickly, feel free to try it!

For simplicity, define . The equation then reads

Two linearly independent solutions to this equation are

The solution to this homogeneous equation is then

The eigenvalue, , as well as one of the constant coefficients, can be determined using the boundary conditions.

In turn, using the properties of the function, it is now possible to find the allowed values of and hence also . The previous equation implies,

The values are the eigenvalues. Now that we have determined , it enters into the time equation, only as a constant. We can therefore simply solve,

In the previous equation, the coefficient can be determined if the original PDE is supplied with an initial condition.

Putting the solutions to the two ODEs together and redefining , we arrive at the solutions for the PDE,

Notice that there is one solution for each natural number . These are also very special solutions that are important in the context of physics. We will next discuss how to obtain the general solution in our example.

8.3. Self-adjoint differential operators

8.3.1. Connection to Hilbert spaces

As hinted earlier, it is possible to re-write the previous equation by defining a linear operator, , acting on the space of functions which satisfy :

Then, the ODE can be written as

This equation looks exactly like, and it turns out to be, an eigenvalue equation!

Connecting function spaces to Hilbert spaces

Recall that a space of functions can be transformed into a Hilbert space by equipping it with a inner product,

Use of this inner product also has utility in demonstrating that particular operators are Hermitian. The term "Hermitian" is precisely defined below. Of considerable interest is that Hermitian operators have a set of convenient properties including all real eigenvalues and orthonormal eigenfunctions.

The nicest type of operators for many practical purposes are Hermitian operators. In quantum physics, for example, all physical operators must be Hermitian.

Hermiticity of an operator

Denote a Hilbert space . An operator is said to be Hermitian if it satisfies

Now, we would like to investigate whether the operator we have been working with, , satisfies the criterion of being Hermitian over the function space equipped with the inner product defined above (i.e. it is a Hilbert space).

  1. First, denote this Hilbert space and consider which are two functions from the Hilbert space. Then, we can investigate

  2. In the next step, use the fact that it is possible to do integration by parts in the integral, The boundary term vanishes due to the boundary conditions , which directly imply .

  3. Now, integrate by parts a second time As before, the boundary term vanishes, due to the boundary conditions . After canceling the boundary term, the expression on the right hand side contained in the integral simplifies to .
  4. Therefore,

Thus, we demonstrated that is a Hermitian operator on the space . As a hermitian operator, has the property that its eigenfunctions form an orthonormal basis for the space . Hence, it is possible to expand any function in terms of the eigenfunctions of .

Connection to quantum states

Recall that a quantum state can be written in an orthonormal basis as

In the case of Hermitian operators, their eigenfunctions play the role of the orthonormal basis. In the context of our running example, the 1D Schrödinger equation of a free particle, the eigenfunctions play the role of the basis functions .

To close our running example, consider the initial condition . Since the eigenfunctions form a basis, we can now write the general solution to the problem as

where in the above we have defined the coefficients as a Fourier coefficient,

8.3.2. General recipe for separable PDEs

General recipe for separable PDEs

  1. Make the separation ansatz to obtain separate ordinary differential equations.
  2. Choose which equation to treat as the eigenvalue equation. This will depend upon the boundary conditions. Additionally, verify that the linear differential operator in the eigenvalue equation is Hermitian.
  3. Solve the eigenvalue equation. Substitute the eigenvalues into the other equations and solve those too.
  4. Use the orthonormal basis functions to write down the solution corresponding to the specified initial and boundary conditions.

One natural question is: "What if the operator from step 2 is not Hermitian?"

  • It is possible to try and make it Hermitian by working on a Hilbert space equipped with a different inner product. This means that one can consider modifications to the definition of such that is Hermitian with respect to the modified inner product. This type of technique falls under the umbrella of Sturm-Liouville Theory, which forms the foundation for a lot of the analysis that can be done analytically on PDEs.

Another question is of course: "What if the equation is not separable?"

  • One possible approach is to try working in a different coordinate system. There are a few more analytic techniques available. However, in many situations, it becomes necessary to work with numerical methods of solution.

8.4. Problems

  1. [😀] Which of the following equations for is linear?

  2. [😀] Find the general solution to the equation

    Show explicitly by computing the Wronski determinant that the basis for the solution space is actually linearly independent.

  3. [😀] Find the general solution to the equation

    Then find the solution to the initial conditions , , .

  4. [😏] Take the Laplace equation in 2D:

    1. Make a separation ansatz and write down the resulting ordinary differential equations.

    2. Now assume that the boundary conditions for all y, i.e. . Find all solutions and the corresponding eigenvalues.

    3. Finally, for each eigenvalue, find the general solution for this eigenvalue. Combine this with all solutions to write down the general solution (we know from the lecture that the operator is Hermitian - you can thus directly assume that the solutions form an orthogonal basis).
  5. [😏] Consider the following partial differential equations, and try to make a separation ansatz . What do you observe in each case? (Only attempt the separation, do not solve the problem fully)

  6. [😓] We consider the Hilbert space of functions defined for with .

    Which of the following operators on this space is Hermitian?