Antonio Franca
The Sampling Problem · 04

The Energy Landscape

Rugged surfaces, local minima, barriers, and why naive simulation gets trapped

The potential energy function U(q)U(\mathbf{q}) assigns a single real number to every configuration. In three paragraphs, Chapter 1 treated it as a black box that enters the Boltzmann weight eβU(q)e^{-\beta U(\mathbf{q})}. Chapters 2 and 3 described Monte Carlo and molecular dynamics as procedures for sampling from that weight. None of this depends on what UU actually looks like — and yet the shape of UU is everything. It determines which configurations are stable, how quickly the system moves between them, and whether any simulation method will work at all. This chapter examines that shape.

The Potential Energy Surface

The potential energy surface (PES) is the graph of U:R3NRU: \mathbb{R}^{3N} \to \mathbb{R} — a scalar function on configuration space. For a system of NN atoms in three dimensions, this surface lives in 3N+13N + 1 dimensions: 3N coordinates plus the energy axis. For any system of biological interest, 3N3N is of order 10510^5 to 10610^6. The surface cannot be visualized directly. It must be reasoned about analytically and probed computationally.

[!definition] 4.1 — The Potential Energy Surface The potential energy surface of a molecular system is the function U:R3NRU: \mathbb{R}^{3N} \to \mathbb{R} that assigns to each configuration q=(r1,,rN)\mathbf{q} = (\mathbf{r}_1, \ldots, \mathbf{r}_N) the total potential energy. A point q\mathbf{q}^* is a critical point if

$$\nabla_{\mathbf{q}} U(\mathbf{q}^*) = \mathbf{0}.$$

Critical points are classified by the Hessian matrix Hij(q)=2U/qiqjH_{ij}(\mathbf{q}^*) = \partial^2 U / \partial q_i \partial q_j evaluated at q\mathbf{q}^*:

  • Local minimum: all eigenvalues of HH are positive (positive-definite Hessian). The system oscillates stably about q\mathbf{q}^*.
  • First-order saddle point (transition state): exactly one negative eigenvalue. The saddle is a minimum in all directions perpendicular to the reaction coordinate, and a maximum along it.
  • Local maximum: all eigenvalues negative. Mechanically unstable; generically rare in high dimensions.

The forces on each atom are the negative gradient:

At a local minimum, forces vanish. The eigenvalues of the Hessian are the squared normal-mode frequencies ωk2\omega_k^2: positive eigenvalues correspond to real frequencies and stable oscillations; the negative eigenvalue at a saddle point corresponds to an imaginary frequency, which characterizes the unstable mode pointing along the reaction path.

[!remark] 4.1 In 3N3N dimensions, even enumerating the local minima of a realistic molecular system is a hard computational problem. A protein with N104N \sim 10^4 atoms has a configuration space of dimension 3×104\sim 3 \times 10^4. The number of local minima grows exponentially with NN — the energy landscape is not a simple bowl but an astronomically rugged terrain. The study of this complexity is sometimes called the energy landscape theory of molecular systems, developed extensively by Wales, Doye, and coworkers starting in the 1990s.

Basins and Metastability

A basin of attraction of a local minimum q\mathbf{q}^* is the set of configurations from which gradient descent — following q˙=U(q)\dot{\mathbf{q}} = -\nabla U(\mathbf{q}) — converges to q\mathbf{q}^*. Basins partition configuration space into regions, separated by dividing surfaces that pass through saddle points. Within a basin, the system oscillates rapidly about the local minimum; transitions between basins require crossing an energy barrier.

[!definition] 4.2 — Metastability A state is metastable if it corresponds to a local minimum of the potential energy (or, more generally, of the free energy — see below) separated from other states by a barrier ΔEkBT\Delta E \gg k_B T. A metastable state is thermodynamically disfavored — it is not the global minimum — but kinetically stable: the barrier is large enough that thermal fluctuations rarely drive the system across it. The system persists in the metastable state for a time that grows exponentially with ΔE/kBT\Delta E / k_B T.

The canonical examples are everywhere in chemistry and biology. A protein with NN possible folded conformations has N1N - 1 metastable states separated from the native fold by free energy barriers of order 5–25 kBTk_B T at room temperature. A small molecule in solution may inhabit several rotational isomers (rotamers), separated by torsional barriers of 3–10 kBTk_B T. A crystal polymorph — a metastable solid form of a drug compound — may persist for years or decades despite being thermodynamically disfavored relative to the stable polymorph.

The central observation is this: the timescale for transitions between metastable states is exponentially long in the barrier height. A barrier of 10kBT10\, k_BT at room temperature suppresses crossing by a factor of e1022,000e^{10} \approx 22{,}000 relative to an unobstructed fluctuation. A barrier of 20kBT20\, k_BT suppresses it by e205×108e^{20} \approx 5 \times 10^8. These are the barriers that govern protein folding, receptor–ligand binding, enzyme catalysis, and ion transport — essentially all the processes that make molecular simulation scientifically valuable. And these are the barriers that make naive simulation fail.

Kramers’ Rate Theory

The quantitative theory of barrier crossing begins with Kramers (1940), who solved the problem of a particle escaping from a metastable well in the presence of friction and thermal noise. Consider a one-dimensional system with a potential U(q)U(q) having a minimum at qAq_A (the reactant state) and a maximum at qq^{\ddagger} (the transition state), separated by a barrier ΔE=U(q)U(qA)\Delta E = U(q^{\ddagger}) - U(q_A).

In the overdamped (high-friction) limit, where Langevin dynamics reduces to

γq˙=U(q)+η(t),η(t)η(t)=2γkBTδ(tt),\gamma \dot{q} = -U'(q) + \eta(t), \quad \langle \eta(t)\eta(t') \rangle = 2\gamma k_B T \delta(t-t'),

Kramers derived the mean first-passage time from qAq_A to qq^{\ddagger} by solving the stationary Fokker–Planck equation. The result for the rate kABk_{A \to B} of escape from the well is:

where ωA=U(qA)/m\omega_A = \sqrt{U''(q_A) / m} is the angular frequency of oscillation at the bottom of the well, ωb=U(q)/m\omega_b = \sqrt{|U''(q^{\ddagger})| / m} is the curvature of the inverted parabola at the barrier top, and γ\gamma is the friction coefficient. The exponential eΔE/kBTe^{-\Delta E / k_B T} is the Boltzmann factor for the barrier — the Arrhenius factor. The prefactor ωAωb/(2πγ)\omega_A \omega_b / (2\pi\gamma) encodes the geometry of the well and barrier and has dimensions of inverse time. In typical molecular systems, it is of order 10910^91012 s110^{12}\ \mathrm{s}^{-1}.

The Arrhenius approximation discards the prefactor and writes simply

kABνeΔE/kBT,k_{A \to B} \approx \nu\, e^{-\Delta E / k_B T},

where ν\nu is a characteristic attempt frequency. The exponential dependence on ΔE/kBT\Delta E / k_B T is the dominant factor: a barrier of 5 kBTk_BT gives kν/150k \sim \nu / 150; a barrier of 20 kBTk_BT gives kν/5×108k \sim \nu / 5 \times 10^8. The prefactor is at most a few orders of magnitude; the Boltzmann factor can span dozens.

[!remark] 4.2 Kramers’ theory in three or more dimensions is more involved. The relevant barrier ΔE\Delta E is the minimum energy path (MEP) — the path through configuration space that crosses the ridge between basins at the lowest point. Along the MEP, the reaction coordinate is the arc length, and the rate is determined by the energy at the saddle point relative to the minimum. Finding the MEP is itself a nontrivial problem, addressed by methods such as the nudged elastic band (NEB) and the string method.

From the Energy Landscape to the Free Energy Landscape

The potential energy surface U(q)U(\mathbf{q}) is a function of all 3N3N atomic coordinates. But most physical questions are phrased in terms of a small number of order parameters or collective variables: the end-to-end distance of a polymer, the dihedral angle of a peptide bond, the separation between two domains of a protein. Reducing the 3N3N-dimensional PES to a low-dimensional picture requires integrating out the remaining degrees of freedom — which introduces entropy.

[!definition] 4.3 — Collective Variables and the Potential of Mean Force A collective variable (CV) is a smooth function ξ:R3NRd\xi: \mathbb{R}^{3N} \to \mathbb{R}^d with d3Nd \ll 3N that captures the slow, large-scale motions of interest. The marginal probability distribution of the CV is

$$p(s) = \frac{1}{Z} \int e^{-\beta U(\mathbf{q})}\, \delta(\xi(\mathbf{q}) - s)\, d\mathbf{q},$$

where the delta function restricts the integral to configurations for which ξ(q)=s\xi(\mathbf{q}) = s. The potential of mean force (PMF) or free energy profile along ξ\xi is defined by

$$F(s) = -k_B T \ln p(s) + \mathrm{const.}$$

The constant is chosen so that FF is defined up to an additive reference.

The PMF is the free energy surface projected onto the CV. It combines energy and entropy: a region of configuration space with low energy UU but very few microstates (low entropy) may have a high PMF, while a high-energy but entropically favorable region may have a low PMF. The equilibrium distribution over the CV is p(s)eβF(s)p(s) \propto e^{-\beta F(s)} — exactly the Boltzmann distribution, but with the free energy replacing the potential energy.

The free energy barrier ΔF=F(s)F(sA)\Delta F = F(s^{\ddagger}) - F(s_A) between metastable states governs thermodynamics and kinetics alike. It differs from the energy barrier ΔE\Delta E by the entropic contribution:

ΔF=ΔETΔS,\Delta F = \Delta E - T\Delta S,

where ΔS\Delta S is the entropy difference between the transition state and the reactant state. In many molecular systems, the entropic contribution is as large as the energetic one — and it can either raise or lower the effective barrier. A conformational transition that requires the molecule to thread through a geometrically constrained region incurs an entropic penalty; one that opens into a broad, flat region of configuration space gains an entropic advantage.

[!remark] 4.3 The terminology “energy landscape” is pervasive but often used loosely. Strictly, the potential energy landscape refers to U(q)U(\mathbf{q}) as a function of all 3N3N coordinates. The free energy landscape refers to the PMF F(s)F(s) as a function of one or more collective variables. The two are related but distinct: the PES has local minima separated by first-order saddle points; the PMF can have a much smoother topology because integration over the remaining coordinates smooths out the ruggedness of UU. When practitioners say a protein “has a rugged free energy landscape,” they typically mean that the PMF projected onto some useful CV has many local minima with barriers of several kBTk_BT.

Why Naive Simulation Fails

The mismatch between barrier-crossing timescales and simulation timescales is the central computational challenge of molecular simulation. Consider a biomolecular system with two metastable states AA and BB separated by a free energy barrier of ΔF=15kBT\Delta F = 15\, k_BT. At room temperature:

kABνe151012×3×107 s13×105 s1,k_{A \to B} \approx \nu\, e^{-15} \approx 10^{12} \times 3 \times 10^{-7}\ \mathrm{s}^{-1} \approx 3 \times 10^{5}\ \mathrm{s}^{-1},

corresponding to a mean waiting time of 3μs\sim 3\, \mu\mathrm{s} per crossing event. With a timestep of Δt=2fs\Delta t = 2\, \mathrm{fs}, one would need

3×106 s2×1015 s/step=1.5×109 steps\frac{3 \times 10^{-6}\ \mathrm{s}}{2 \times 10^{-15}\ \mathrm{s}/\mathrm{step}} = 1.5 \times 10^{9}\ \mathrm{steps}

just to observe a single transition. State-of-the-art GPU-accelerated MD can perform roughly 10810^810910^9 steps per day for biomolecular systems, depending on system size. A 3μs3\, \mu\mathrm{s} mean first-passage time thus requires of order days of continuous simulation to observe a single event — and statistical accuracy requires many events. For slower processes, the situation is worse by orders of magnitude.

This is not a limitation of current hardware that will be overcome by faster computers. It is an intrinsic property of the exponential relationship between barrier height and crossing rate. A 2× faster computer gives a 2× longer trajectory — but moving from a 15 kBTk_BT barrier to a 16 kBTk_BT barrier increases the mean first-passage time by a factor of e2.7e \approx 2.7. Hardware improvements are linear; the timescale problem is exponential.

The ergodic hypothesis of Chapter 3 requires the simulation to sample all of configuration space in proportion to the Boltzmann weight. A naive MD or MC simulation of a system with metastable states separated by barriers of 5kBT\gtrsim 5\, k_BT will fail to do so on any accessible timescale: the trajectory will remain trapped in whichever basin it started in, producing incorrect ensemble averages for any observable that depends on the distribution between states.

Choosing Collective Variables

The free energy landscape is not a property of the molecule alone — it depends on which collective variables are used to describe it. A poor choice of CV can produce a PMF that appears smooth and barrier-free while hiding the true complexity of the system; a good choice reveals the metastable states and barriers that govern the process of interest.

Common collective variables in molecular simulation include:

  • Geometric CVs: bond lengths, bond angles, dihedral angles, distances between groups of atoms (e.g., center-of-mass separation, radius of gyration). These are interpretable and computationally cheap but may not capture the essential physics of complex conformational changes.
  • Path-based CVs: the progress along a reference reaction path in configuration space, measuring simultaneously how far the system has advanced along the path and how far it has deviated from it. Effective for known reaction mechanisms.
  • Contact-based CVs: the fraction of native contacts formed in a protein folding simulation, or the number of hydrogen bonds between two domains. These are collective in the sense that they summarize many pairwise interactions.
  • Data-driven CVs: principal components of the configuration space sampled by a short simulation; time-lagged independent components (TICA) that maximize the autocorrelation time; committor-based coordinates learned by neural networks from transition path data. These can capture the true slow modes of the system without assuming a specific functional form, but require sufficient sampling to estimate.

The ideal collective variable is the committor: the probability that, starting from a given configuration, the system reaches state BB before state AA. The committor is a function of configuration space that is 0 in state AA, 1 in state BB, and 1/2 at the transition state ensemble. It is the theoretically optimal reaction coordinate, but it is generally unknown and expensive to estimate. Much of the advanced methodology in Chapters 5 through 7 can be understood as strategies for either approximating the committor or sampling rare events without knowing it.


The systematic study of the energy landscape as a geometric object originated in the work of Murrell and Laidler (1968), who defined the concept of a transition structure for polyatomic systems. Kramers’ celebrated paper on thermally activated barrier crossing appeared in 1940 and has been analyzed and extended ever since; the review by Hänggi, Talkner, and Borkovec (1990) remains the standard reference. The connection between the PES topology and thermodynamic and kinetic properties of supercooled liquids, glasses, and biomolecules was developed by Stillinger and Weber (1982, 1984) through the concept of inherent structures — the local minima reached by quenching configurations sampled at finite temperature. Wales and collaborators extended this to systematic mapping of the energy landscape, leading to the disconnectivity graph representation and the folding funnel concept for proteins. The potential of mean force and its computation via thermodynamic integration were introduced by Kirkwood (1935); the terminology “potential of mean force” is due to Yvon (1935). Data-driven collective variables using time-lagged independent component analysis (TICA) were introduced for molecular simulation by Schwantes and Pande (2013) and Pérez-Hernández et al. (2013).