Skip to content

Relative Entropy for QFT States

Relative entropy compares two states only through observables in a declared algebra. In continuum QFT that algebraic formulation is the intrinsic one: it remains meaningful for type-III local algebras, is ultraviolet finite in many local comparisons, and does not require a reduced density matrix.

Required background. Use operator algebras and normal positive functionals and restricted states on subregions. Helpful background. Type-III local algebras explain why the density-matrix formula is not the continuum definition.

Let ω\omega and φ\varphi be normal positive functionals on a von Neumann algebra M\mathfrak M, represented in standard form. Their relative modular operator Δφ,ω\Delta_{\varphi,\omega} acts on the support selected by the two states. With the usual support convention, Araki relative entropy is

S(ωφ)=ξω,logΔφ,ωξω,S(\omega\Vert\varphi) =-\langle \xi_\omega,\log\Delta_{\varphi,\omega}\,\xi_\omega\rangle,

and is ++\infty when the required absolute-continuity condition fails. For M=B(H)\mathfrak M=\mathcal B(\mathcal H) this reduces to the Umegaki expression

D(ρσ)=Trρ(logρlogσ)D(\rho\Vert\sigma) =\operatorname{Tr}\rho(\log\rho-\log\sigma)

provided suppρsuppσ\operatorname{supp}\rho\leq\operatorname{supp}\sigma. The algebraic definition and its positivity, lower semicontinuity, and monotonicity were established in Araki 1976, pp. 809–833.

The diagram locates this quantity among the operational comparisons developed later. Its arrows are conditional: the algebra, support, allowed tests, and resources must be fixed before an interpretation is chosen.

Relative entropy on a fixed algebra connects to hypothesis testing, overlap, correlations, and constrained recovery only after the relevant resources are declared.

Relative entropy is the algebraic state-comparison core. Many-copy tests, fidelity bounds, mutual information, and recovery or channel statements require distinct support, copy, algebra, and energy hypotheses. Schematic.

For a vacuum state ω0\omega_0 and a coherent excitation ωf\omega_f restricted to an interval algebra A(O)\mathfrak A(O), S(ωfω0)S(\omega_f\Vert\omega_0) compares every admissible local measurement at once. In situations with a known vacuum modular Hamiltonian KOK_O, a regulated computation often takes the form

D(ρfOρ0O)=ΔKOΔSO.D(\rho_f^O\Vert\rho_0^O)=\Delta\langle K_O\rangle-\Delta S_O.

The separate terms may depend on the cutoff, while their matched difference has a continuum limit. This identity is a regulated representation of the algebraic quantity, not evidence for an intrinsic trace on A(O)\mathfrak A(O).

Relative entropy is asymmetric and does not itself equal an error probability. Its usefulness comes from inequalities and asymptotic theorems whose hypotheses are stated on the following pages. It also depends on the observable algebra: enlarging the algebra can only increase distinguishability.

The lower figure summarizes the conditions that prevent a finite formula from being used outside its domain. In particular, a state with support outside that of the reference has infinite relative entropy; deleting the singular directions changes the question.

A valid relative-entropy claim fixes the algebra, support, positive map, and resources; changing any of them leads to an invalid comparison.

The algebra and reference support are part of the relative-entropy problem. Channel monotonicity and operational bounds additionally require a positive physical map and fixed resource constraints. The lower row shows characteristic failures when those hypotheses are changed. Schematic.

In the coherent-state example, first verify normality on the chosen interval algebra and finite modular energy relative to the vacuum. A mismatched reference representation, a projection that discards unsupported components, or a different algebra on the two sides invalidates the comparison.

  • Araki, Huzihiro. “Relative Entropy of States of von Neumann Algebras.” Publications of the Research Institute for Mathematical Sciences 11 (1976): 809–833. DOI.
  • Umegaki, Hisaharu. “Conditional Expectation in an Operator Algebra, IV: Entropy and Information.” Kodai Mathematical Seminar Reports 14 (1962): 59–85. DOI.