Statistical Calculation of Heat Capacity and Degrees of Freedom

In classical thermodynamics, heat capacity is treated as a macroscopic property that quantifies a system's ability to absorb thermal energy per unit change in temperature. However, this macroscopic description provides little insight into the underlying physical mechanisms. To truly understand why different substances exhibit different heat capacities, we must transition from thermodynamics to statistical mechanics.

From a microscopic perspective, heat capacity is not merely a constant parameter; it is a direct manifestation of how energy is distributed among the various microstates of a system and how those states fluctuate around equilibrium. By analyzing the degrees of freedom and the partition function, we can derive the heat capacity from first principles, bridging the gap between individual molecular motions and bulk thermal properties.

Microscopic Foundations: Degrees of Freedom

The concept of degrees of freedom (DoF) refers to the number of independent coordinates required to fully describe the microstate of a system. For a system composed of $N$ particles, the total internal energy is distributed among several distinct modes of motion. These modes are generally categorized into three types:

  • Translational Degrees of Freedom: These describe the movement of a particle's center of mass through three-dimensional space. In the classical limit, every particle possesses 3 translational degrees of freedom, corresponding to the $x, y,$ and $z$ Cartesian coordinates.
  • Rotational Degrees of Freedom: These describe the rotation of a molecule around its center of mass. The number of rotational DoF depends on the molecular geometry:
    • Linear molecules (e.g., $\text{H}_2$, $\text{CO}_2$) have 2 rotational degrees of freedom (rotation about two axes perpendicular to the molecular bond).
    • Non-linear molecules (e.g., $\text{H}_2\text{O}$) have 3 rotational degrees of freedom (rotation about all three principal axes).
  • Vibrational Degrees of Freedom: These involve the relative motion of atoms within a molecule. Unlike translation or rotation, a single vibrational mode in a classical framework contributes 2 degrees of freedom: one for kinetic energy and one for potential energy.

The Classical Approach: The Equipartition Theorem

In the classical regime, the relationship between degrees of freedom and heat capacity is elegantly captured by the Equipartition Theorem. This theorem states that for a system in thermal equilibrium, every independent quadratic term in the Hamiltonian (representing energy) contributes exactly $\frac{1}{2}k_B T$ to the average internal energy, where $k_B$ is the Boltzmann constant.

If a system possesses a total of $f$ quadratic degrees of freedom, the total average internal energy $U$ is given by:
$$U = \frac{f}{2} N k_B T$$

From this, the constant-volume heat capacity $C_V$ can be derived by differentiating the internal energy with respect to temperature:
$$C_V = \left( \frac{\partial U}{\partial T} \right)_V = \frac{f}{2} N k_B$$

While the Equipartition Theorem provides a quick way to estimate heat capacity, it is fundamentally a classical approximation that fails when quantum effects become significant.

Rigorous Statistical Derivation

To account for the complexities of real systems, particularly at low temperatures, we must utilize the canonical ensemble and the partition function ($Z$).

From the Partition Function to Internal Energy

The partition function $Z$ serves as the bridge between microscopic energy levels $E_i$ and macroscopic thermodynamics. It is defined as:
$$Z = \sum_i e^{-\beta E_i}$$
where $\beta = \frac{1}{k_B T}$. The average internal energy $U$ of the system is the ensemble average of the energy levels:
$$U = \langle E \rangle = -\frac{\partial \ln Z}{\partial \beta}$$

The Statistical Expression for Heat Capacity

Since $C_V$ is the temperature derivative of $U$, we can use the chain rule to express it in terms of $\beta$:
$$C_V = \frac{\partial U}{\partial T} = \frac{\partial U}{\partial \beta} \frac{d \beta}{d T} = \left( -\frac{\partial^2 \ln Z}{\partial \beta^2} \right) \left( -\frac{1}{k_B T^2} \right) = k_B \beta^2 \frac{\partial^2 \ln Z}{\partial \beta^2}$$

Heat Capacity as Energy Fluctuation

A profound result of this derivation is the connection between heat capacity and energy fluctuations. By expanding the second derivative of $\ln Z$, it can be shown that:
$$C_V = \frac{\langle E^2 \rangle - \langle E \rangle^2}{k_B T^2}$$

This identity reveals that heat capacity is directly proportional to the variance of the energy distribution. In physical terms, a higher heat capacity implies that the system undergoes larger energy fluctuations around its mean value at equilibrium. This is a cornerstone of the fluctuation-dissipation theorem, linking the system's response to external thermal changes to its spontaneous internal fluctuations.

Comparative Analysis of Gas Models

We can observe the impact of degrees of freedom by comparing different idealized gas models:

  1. Monatomic Ideal Gas (e.g., $\text{He}$, $\text{Ar}$):
    These atoms are treated as point masses with no rotational or vibrational structure.

    • Total DoF ($f$): 3 (translational only).
    • Heat Capacity: $C_V = \frac{3}{2} N k_B$.
  2. Diatomic Ideal Gas (Classical Limit):
    For a molecule like $\text{N}_2$ at high temperatures, we must account for all modes.

    • Translational: 3 DoF.
    • Rotational: 2 DoF (for a linear molecule).
    • Vibrational: 2 DoF (1 kinetic + 1 potential).
    • Total DoF ($f$): $3 + 2 + 2 = 7$.
    • Heat Capacity: $C_V = \frac{7}{2} N k_B$.

Quantum Effects and the "Freezing" of Degrees of Freedom

The classical predictions above suggest that heat capacity should be a constant. However, experimental data shows that $C_V$ varies with temperature. This discrepancy is resolved by acknowledging that energy is quantized.

A degree of freedom only contributes to the heat capacity if the available thermal energy ($k_B T$) is sufficient to excite the system to the next quantized energy level ($\Delta E$). When $k_B T \ll \Delta E$, the degree of freedom cannot be effectively excited and is said to be "frozen out."

  • Rotational Freezing: At extremely low temperatures, the spacing between rotational energy levels becomes large relative to $k_B T$. The rotational DoF "freeze," causing the heat capacity of a diatomic gas to drop from $\frac{5}{2} R$ to $\frac{3}{2} R$.
  • Vibrational Freezing: For most diatomic gases at room temperature, the vibrational energy spacing is quite large. Consequently, the vibrational mode remains frozen, and the observed heat capacity is $\frac{5}{2} R$ rather than the classical $\frac{7}{2} R$.

This transition from quantum-dominated behavior at low temperatures to classical behavior at high temperatures is precisely described by models such as the Einstein or Debye models, underscoring the indispensable role of statistical mechanics in understanding the thermal nature of matter.