Statistical Expression of Thermodynamic Potentials

In thermodynamics, thermodynamic potentials serve as the fundamental macroscopic quantities used to describe a system's energy state, dictate the direction of spontaneous processes, and define the conditions for equilibrium. While classical thermodynamics provides a robust framework for observing these quantities, it remains silent on their underlying microscopic origins.

The essence of statistical mechanics lies in bridging this gap. By establishing a mathematical connection between the probabilistic distribution of microscopic states and macroscopic observables, statistical mechanics provides a rigorous foundation for thermodynamic potentials. The primary vehicle for this connection is the partition function, a mathematical construct that encodes the statistical information of a system and allows for the derivation of all macroscopic properties.
The most fundamental framework in statistical mechanics is the microcanonical ensemble, which describes an isolated system. In this ensemble, the total energy $E$, the volume $V$, and the number of particles $N$ are strictly constant.

For such a system, the macroscopic state is characterized by the total number of accessible microscopic states, denoted as $\Omega(E, V, N)$. This quantity represents the "multiplicity" of the system. The profound insight provided by Ludwig Boltzmann is that the macroscopic property of entropy ($S$) is directly proportional to the natural logarithm of this multiplicity:

$$S = k_B \ln \Omega(E, V, N)$$

Here, $k_B$ represents the Boltzmann constant. This relationship reveals that entropy is essentially a measure of the microscopic uncertainty or the degree of "disorder" within a system. In the microcanonical framework, entropy acts as the bridge connecting the counting of microstates to the laws of thermodynamics.

The Canonical Ensemble: Helmholtz Free Energy

In most physical scenarios, systems are not isolated; instead, they interact with their surroundings—typically a large heat reservoir—to maintain a constant temperature $T$. To model such systems, we employ the canonical ensemble, where the constraints are $N$, $V$, and $T$.

In the canonical ensemble, the probability $P_i$ of the system occupying a specific microstate $i$ with energy $E_i$ is given by the Boltzmann distribution:

$$P_i = \frac{e^{-\beta E_i}}{Z}$$

where $\beta = \frac{1}{k_B T}$ is the thermodynamic beta, and $Z$ is the canonical partition function, defined as:

$$Z(N, V, T) = \sum_{i} e^{-\beta E_i}$$

The partition function $Z$ is the "generating function" for the system's thermodynamics. The most critical potential derived from this ensemble is the Helmholtz free energy ($F$), expressed as:

$$F = -k_B T \ln Z$$

Once the Helmholtz free energy is determined, all other thermodynamic variables can be extracted through partial differentiation:

• Entropy: $S = -\left( \frac{\partial F}{\partial T} \right)_{V, N}$
• Pressure: $P = -\left( \frac{\partial F}{\partial V} \right)_{T, N}$
• Chemical Potential: $\mu = \left( \frac{\partial F}{\partial N} \right)_{T, V}$
• Internal Energy: $U = F + TS$

The Grand Canonical Ensemble: The Grand Potential

When dealing with open systems—where both energy and particles can be exchanged with a reservoir—the number of particles $N$ is no longer fixed. In this case, we use the grand canonical ensemble, characterized by constant temperature $T$, volume $V$, and chemical potential $\mu$.

The statistical weight of the system in this ensemble is captured by the grand partition function $\Xi$:

$$\Xi(\mu, V, T) = \sum_{N=0}^{\infty} e^{\beta \mu N} Z(N, V, T) = \sum_{N} \sum_{i} e^{-\beta(E_{i,N} - \mu N)}$$

The corresponding thermodynamic potential is the grand potential (also known as the Landau free energy), denoted as $\Phi$ or $\Omega_{GP}$:

$$\Phi = -k_B T \ln \Xi$$

For a homogeneous system, the grand potential exhibits a simple and elegant relationship with pressure and volume: $\Phi = -PV$. This ensemble is particularly powerful for studying phase transitions, chemical equilibria, and systems where particle fluctuations are significant.

Summary of Ensemble-Potential Mappings

The following table summarizes the correspondence between the statistical frameworks (ensembles) and their respective thermodynamic potentials:

Illustrative Example: A Two-Level System

To demonstrate the practical application of these concepts, consider a simple model of a single particle that can exist in only two energy states: a ground state with energy $0$ and an excited state with energy $\epsilon$.

1. Calculate the canonical partition function $Z$:
   $$Z = e^{-\beta \cdot 0} + e^{-\beta \epsilon} = 1 + e^{-\beta \epsilon}$$

2. Determine the Helmholtz free energy $F$:
   Using the relation $F = -k_B T \ln Z$:
   $$F = -k_B T \ln(1 + e^{-\beta \epsilon})$$

3. Derive the internal energy $U$:
   Using the identity $U = -\frac{\partial}{\partial \beta} \ln Z$:
   $$U = -\frac{\partial}{\partial \beta} \ln(1 + e^{-\beta \epsilon}) = \frac{\epsilon e^{-\beta \epsilon}}{1 + e^{-\beta \epsilon}} = \frac{\epsilon}{e^{\beta \epsilon} + 1}$$

This exercise illustrates the core strength of statistical mechanics: by simply summing over the discrete energy levels of a microscopic system, we can reconstruct the complete macroscopic thermodynamic profile of that system.