Dynamical Kaluza–Klein compactification: stabilizing the extra dimensions and deriving the observed gauge couplings without fine-tuning

In Kaluza–Klein theory, four-dimensional gauge symmetries arise as isometries of a compact internal manifold, so charges are automatically quantized and gauge couplings are fixed by the geometry through root-mean-square circumferences of Killing-vector orbits. Steven Weinberg's 1983 paper "Charges from extra dimensions" established this correspondence for an arbitrary compact manifold and speculated that if the one-loop vacuum (Casimir) energy of $n$ massless matter species stabilizes the compact space, then typical couplings scale as $1/\sqrt{n}$ — while leaving open whether the dynamics of any higher-dimensional theory can (i) stabilize the compact dimensions at a radius well above the Planck length, (ii) reproduce the observed gauge-coupling ratios, and (iii) do so without a fine-tuned cancellation of the higher-dimensional cosmological constant against internal curvature and vacuum energy. Subsequent work answered pieces negatively within pure Kaluza–Klein theory: the five-dimensional Casimir energy destabilizes the fifth dimension, chiral fermions are obstructed, coupling ratios computed for studied manifolds do not match observation, and stabilization succeeds only with a tuned cosmological constant and roughly $10^4$–$10^5$ matter fields. The questions survive as the moduli-stabilization and vacuum-selection problems of string compactification, which remain open. The problem asks whether a self-consistent construction or a no-go theorem exists for a dynamically stabilized compactification that reproduces the observed gauge-coupling pattern.

Background

Kaluza–Klein (KK) theory is the idea that spacetime has more than four dimensions, with the extra $N$ spatial dimensions curled up ("compactified") on a small compact manifold $\mathcal{M}$, so small that only the four familiar dimensions are visible at accessible energies. In such a theory the components of the higher-dimensional metric along the extra directions appear in four dimensions as gauge fields: the group of metric-preserving symmetries of $\mathcal{M}$ (its isometry group), generated by Killing vector fields, becomes a four-dimensional gauge symmetry. In the original five-dimensional model the compact space is a circle $S^1$, its isometry group is $U(1)$, and electromagnetism appears with electric charge $e=\kappa/R$, where $R$ is the circle's radius (circumference $2\pi R$) and $\kappa^2=16\pi G_N$ is the four-dimensional gravitational coupling. Because the isometry group of a compact space is compact, charges arising this way are automatically quantized — the observation that motivated the source paper.

Weinberg's 1983 paper "Charges from extra dimensions" generalized the charge–geometry relation to an arbitrary compact manifold. For a one-parameter isometry subgroup generated by $e^\alpha t_\alpha$ (with generators $t_\alpha$ of the isometry group and $\delta_{\alpha\beta}e^\alpha e^\beta=1$), the closed orbits ("Killing curves") have a metric length $s$ whose root-mean-square value over the manifold fixes the coupling eigenvalue

$$g_e=\frac{2\pi\kappa}{\langle s^2\rangle^{1/2}\,N_e},$$

where the average $\langle\cdot\rangle$ is taken with the manifold's volume weight and $N_e$ is an integer accounting for multi-valuedness of the matter representations. Worked examples (spheres $S^N$ and the complex projective plane $CP^2$) show that different generators of the same isometry group can acquire different couplings, so the geometry fixes not only an overall scale but also ratios among gauge couplings — raising the question of whether the observed coupling ratios, which approximately unify at a single scale in grand-unified theories (extensions embedding the Standard Model gauge group $SU(3)\times SU(2)\times U(1)$ into a simple group such as $SU(5)$, which predict definite relations among the three couplings), could be a geometric consequence of compactification.

To estimate the magnitude of the couplings, the paper appealed to stabilization by vacuum energy: the Casimir energy — the zero-point energy of quantum fields on a compact space — of $n$ species of massless matter fields is parametrically of order $nR^{-4-N}$, and balancing it against the curvature terms in the $(4+N)$-dimensional Einstein equations gives $\kappa^2/R^2\sim 1/n$, so typical couplings $g\sim\kappa/R$ scale as $1/\sqrt{n}$. Small gauge couplings would then reflect a large number of matter species driving the compactification radius up to values much larger than the Planck length (the natural gravitational length scale $\ell_P\sim\sqrt{G_N}$), where the loop expansion is controlled. The paper itself flagged this estimate as speculative and left its dynamical foundations open.

Two earlier results framed those open questions. Appelquist and Chodos (1983) computed the one-loop effective potential of the five-dimensional KK model and found that the Casimir energy exerts a force contracting the fifth dimension to the Planck length: quantum vacuum energy alone destabilizes rather than stabilizes the simplest compactification. Witten (1981) had shown that although a gauge group containing $SU(3)\times SU(2)\times U(1)$ can arise from the isometries of a suitably high-dimensional compact space, obtaining the correct chiral fermion quantum numbers (left–right asymmetry of the observed fermions) is very difficult. Finally, the stabilization equations require a higher-dimensional cosmological constant $\bar\Lambda$ tuned to cancel the average internal curvature $\langle\tilde R\rangle$ and the vacuum contributions, so that four-dimensional spacetime comes out nearly flat — a cancellation assumed rather than explained. These caveats motivate the problem.

Problem Statement

Within a $(4+N)$-dimensional theory whose four-dimensional gauge bosons arise as isometry gauge fields of a compact internal manifold (the Kaluza–Klein mechanism, with general matter content allowed), determine whether the theory's own dynamics can produce a self-consistent compactification that reproduces the observed gauge couplings. The source paper left three linked questions that jointly define this objective:

(1) Stabilization. Can the quantum vacuum energy — the one-loop Casimir energy together with graviton-loop, higher-loop, and back-reaction corrections, plus the classical dynamics — stabilize the compact manifold at a radius parametrically larger than the Planck length (the regime where couplings are small and the semiclassical expansion is controlled), without adding matter fields whose sole purpose is to engineer the equilibrium? The five-dimensional one-loop calculation destabilizes; the question is whether any dimension, geometry, and matter spectrum does better, or whether a no-go holds.

(2) Coupling ratios. Does any dynamically selectable compactification geometry induce gauge-coupling ratios matching the observed values (extrapolated to the compactification scale by the running of the couplings), as expected in grand-unified theories, which predict definite relations among them? The root-mean-square-circumference formula fixes such ratios geometrically once the manifold is given; the open question is whether a stabilized solution exists whose ratios agree with observation, or whether this is excluded.

(3) Vacuum-energy cancellation. Can the tuning of the higher-dimensional cosmological constant $\bar\Lambda$ against the average internal curvature $\langle\tilde R\rangle$ and the quantum vacuum energy — needed so that four-dimensional spacetime is nearly flat — be explained dynamically within the theory rather than imposed by hand?

These three components are facets of one objective — a compactification whose stability, coupling values, and vacuum energy are all fixed by the theory's dynamics rather than by adjustment. The open question is whether any higher-dimensional theory and matter spectrum yield a self-consistent compactified solution that is stable against all metric moduli (the radius and shape-deformation modes of the internal space), whose induced couplings match the observed pattern, and which requires no tuned cancellation — or whether a no-go theorem holds, under stated assumptions, within the isometry-based mechanism.

References

1. S. Weinberg, Charges from extra dimensions, Physics Letters B 125 (1983) 265–269. DOI: 10.1016/0370-2693(83)91281-9. https://doi.org/10.1016/0370-2693(83)91281-9 (source paper)
2. T. Appelquist and A. Chodos, Quantum effects in Kaluza-Klein theories, Physical Review Letters 50 (1983) 141–145. DOI: 10.1103/PhysRevLett.50.141. https://doi.org/10.1103/PhysRevLett.50.141
3. E. Witten, Search for a realistic Kaluza-Klein theory, Nuclear Physics B 186 (1981) 412–428. DOI: 10.1016/0550-3213(81)90021-3. https://doi.org/10.1016/0550-3213(81)90021-3
4. P. Candelas and S. Weinberg, Calculation of gauge couplings and compact circumferences from self-consistent dimensional reduction, Nuclear Physics B 237 (1984) 397–441. DOI: 10.1016/0550-3213(84)90001-4. https://doi.org/10.1016/0550-3213(84)90001-4
5. D. Bailin and A. Love, Coupling constant ratios from extra spatial dimensions, Physics Letters B 137 (1984) 348–352. DOI: 10.1016/0370-2693(84)91730-1. https://doi.org/10.1016/0370-2693(84)91730-1
6. D. Bailin and A. Love, Coupling constant ratios from the Kaluza-Klein manifolds Mpqr, Physics Letters B 144 (1984) 359–364. DOI: 10.1016/0370-2693(84)91279-6. https://doi.org/10.1016/0370-2693(84)91279-6
7. A. Chodos and E. Myers, Gravitational contribution to the Casimir energy in Kaluza-Klein theories, Annals of Physics 156 (1984) 412–441. DOI: 10.1016/0003-4916(84)90039-3. https://doi.org/10.1016/0003-4916(84)90039-3
8. G. Gilbert, B. McClain and M. A. Rubin, Dynamical quantum effects in Kaluza-Klein theories, Physics Letters B 142 (1984) 28–34. DOI: 10.1016/0370-2693(84)91129-8. https://doi.org/10.1016/0370-2693(84)91129-8
9. D. Bailin and A. Love, Kaluza-Klein theories, Reports on Progress in Physics 50 (1987) 1087–1170. DOI: 10.1088/0034-4885/50/9/001. https://doi.org/10.1088/0034-4885/50/9/001
10. S. Weinberg, The cosmological constant problem, Reviews of Modern Physics 61 (1989) 1–23. DOI: 10.1103/RevModPhys.61.1. https://doi.org/10.1103/RevModPhys.61.1
11. J. M. Overduin and P. S. Wesson, Kaluza-Klein gravity, Physics Reports 283 (1997) 303–378. DOI: 10.1016/S0370-1573(96)00046-4; arXiv: gr-qc/9805018. https://arxiv.org/abs/gr-qc/9805018
12. W. D. Goldberger and I. Z. Rothstein, Quantum stabilization of compactified AdS5, Physics Letters B 491 (2000) 339–344. DOI: 10.1016/S0370-2693(00)01047-9; arXiv: hep-th/0007065. https://arxiv.org/abs/hep-th/0007065
13. M. R. Douglas and S. Kachru, Flux compactification, Reviews of Modern Physics 79 (2007) 733–796. DOI: 10.1103/RevModPhys.79.733; arXiv: hep-th/0610102. https://arxiv.org/abs/hep-th/0610102
14. J. Baptista, Internal symmetries in Kaluza-Klein models, Journal of High Energy Physics 2024 (05) 178. DOI: 10.1007/JHEP05(2024)178; arXiv: 2306.01049. https://arxiv.org/abs/2306.01049