Open problems in the non-equilibrium chemical master equation theory of phosphorylation–dephosphorylation cycles: energy cost of bistability, n-step generalization, cycle variants, transient dynamics, and flux-controlled plasticity

Bazzani, Castellani, Giampieri, Remondini and Cooper (J. Chem. Phys. 136, 235102, 2012) analyzed the two-dimensional chemical master equation (CME) of the homogeneous dual phosphorylation–dephosphorylation cycle (PdPC) with Michaelis–Menten propensities: they obtained the equilibrium stationary distribution in closed form under detailed balance, decomposed the non-equilibrium driving field into conservative and rotational parts via a Helmholtz decomposition, and showed that stationary chemical fluxes can drive or delay the transition to a bimodal stationary distribution. The paper left open an agenda: its Conclusions explicitly flagged (1) a full thermodynamic analysis quantifying how much energy is required to maintain or create bistability in the non-equilibrium regime and (2) generalization to n-step phosphorylation/dephosphorylation cycles; its body identified (4) transient relaxation and finite-size effects beyond the Fokker–Planck approximation as requiring further study; and the paper suggested (3) extension to other PdPC variants, such as the cycle with a non-specific phosphatase and two specific kinases relevant to synaptic plasticity, while observing that flux-controlled distribution shapes suggest (5) a possible generic mechanism for plastic behavior in biochemical systems out of thermodynamic equilibrium. Substantial adjacent progress exists — thermodynamically consistent deterministic switch models (2016–2024), exact CME schemes for the two-step cycle, and rigorous large-N scaling limits — but no work is known that completes the stochastic thermodynamic analysis of the dual-cycle CME, the non-equilibrium stationary theory of n-step cycles, the CME analysis of the named variants, the finite-size transient dynamics, or a test of the flux-plasticity hypothesis. The agenda remains open, with its energetic core narrowed by deterministic progress but not closed.

Background

Phosphorylation–dephosphorylation cycles (PdPCs, also called futile cycles) are the most common reversible covalent-modification motifs in cell signaling: a kinase enzyme transfers a phosphate group onto a substrate protein at specific sites (consuming ATP), and a phosphatase removes it. When the substrate carries two sites modified sequentially and distributively (the enzyme releases the substrate between steps), the resulting dual futile cycle is the minimal building block of MAPK-type cascades (MAPK, mitogen-activated protein kinase: the three-tier kinase relays that carry signals from cell-surface receptors to their intracellular targets). At the deterministic level, using Michaelis–Menten (MM) rate laws — the standard quasi-steady-state approximation (QSSA) of enzyme kinetics, in which each modification step runs at a saturable rate $v_{max}c/(K_M+c)$ — single cycles show zero-order ultrasensitivity, a steep switch-like dependence of the steady-state modified fraction on the ratio of enzyme activities that arises when the enzymes operate at saturation (Goldbeter–Koshland), and dual cycles can be bistable, i.e., possess two stable steady states for the same input; bistability conditions for dual cycles are known from competition analysis (Huang–Qian) and catalytic-constant criteria (Conradi–Mincheva). Noise can itself create bistability in such networks (Samoilov–Plyasunov–Arkin).

In a single cell the molecule counts are small, so the appropriate description is the chemical master equation (CME): the continuous-time Markov chain on the discrete counts of the species, whose probability distribution evolves through gain and loss terms for every reaction. Bazzani, Castellani, Giampieri, Remondini and Cooper (2012) studied the stationary distribution of the two-dimensional CME for the homogeneous dual PdPC (one kinase and one phosphatase acting on both sites) with MM-type propensities and a conserved total substrate number $N_T$; the lattice states $(n_1,n_2)$ count the unphosphorylated and doubly phosphorylated substrate, the singly phosphorylated form being fixed by conservation. Their results: (i) when the detailed balance (DB) condition holds — the effective transition network carries no stationary current, realized at a symmetry point of the MM constants — the stationary distribution is available in closed product form; (ii) away from DB the non-equilibrium stationary state (NESS) carries stationary chemical fluxes (currents), and the ratio of generation to recombination rates defines a vector field on the state lattice whose Helmholtz decomposition (a standard split of a vector field into a gradient, conservative part and a rotational part) yields a conservative potential and a rotor potential, enabling a perturbative computation of the stationary distribution; (iii) in a finite-size diffusion region around the deterministic fixed points the distribution is approximated by a Fokker–Planck equation (the diffusion approximation of the CME), and the transition to a bimodal — stochastically bistable — distribution can be driven or delayed by the currents.

Thermodynamically, the currents mean the cycle is an open system driven by an external energy source, ultimately ATP hydrolysis (the phosphorylation energy hypothesis of Qian; single-cycle CME and NESS analyses of Ge–Qian). In equilibrium the stationary theory reduces to a free-energy landscape; out of equilibrium the selection between competing attractors is a genuinely thermodynamic question (Maxwell-type constructions — analogues of the equal-area rule of first-order phase transitions — for bistable NESS by Ge–Qian; entropy-production selection among multiple NESS by Endres), and the relation between stationary and transient behavior becomes singular as the system size diverges (Keizer's paradox, Vellela–Qian). Deterministic multisite cycles are known to admit unlimited multistability as the number of sites grows (Thomson–Gunawardena), and the graph-theoretic structure of detailed balance, complex balance (vanishing net flux through each chemical complex) and product-form stationary distributions of stochastic reaction networks has been clarified in general (Jia–Jiang–Li; Müller–Joshi). Related deterministic work established that noise-averaged and stochastic descriptions of enzymatic switching can disagree qualitatively (Bishop–Qian). What was missing in 2012, and what the source paper left open, is the corresponding non-equilibrium, finite-size, stochastic theory for phosphorylation cycles themselves. Among biologically important variants, a cycle with a non-specific phosphatase and two site-specific kinases controls the phosphorylation of AMPA receptors (AMPA: the glutamate-gated ion channels that mediate most fast excitatory synaptic transmission) in models of long-term potentiation and depression (LTP/LTD), the persistent activity-dependent strengthening and weakening of synapses (Castellani–Quinlan–Cooper–Shouval; Castellani–Bazzani–Cooper).

Problem Statement

The problem is the research agenda that Bazzani et al. (2012) left open and suggested for their chemical master equation (CME) analysis of the homogeneous dual phosphorylation–dephosphorylation cycle (PdPC): to complete the non-equilibrium, finite-size statistical-mechanical theory of PdPCs within their framework — MM-QSSA propensities on the conserved-substrate state lattice, detailed balance as the reference equilibrium, and the Helmholtz decomposition of the driving field into conservative and rotational (current) parts. Concretely, the agenda comprises items (1), (2) and (4), which the paper explicitly flagged as open directions in its Conclusions and body, together with items (3) and (5), which are extensions suggested by the paper's discussion of cycle variants and of flux-controlled distribution shapes:

(1) A full thermodynamic analysis of the dual phosphorylation cycle: quantify how much energy (free-energy input, equivalently entropy production) is required to maintain or create bistability in the non-equilibrium regime — that is, connect the rotational part of the driving field and the resulting stationary fluxes to the entropy production rate of the stationary state, and determine the energetic cost of sustaining a bimodal stationary distribution at finite total molecule number $N_T$, including the minimal driving needed to create bimodality where the detailed-balance distribution is unimodal.

(2) The generalization of this stationary-state analysis to n-step phosphorylation/dephosphorylation cycles: establish (or refute) that under detailed balance the stationary distribution of the n-step cycle equals the product of its n single-step marginal distributions along the modification coordinate — concretely, that the joint stationary distribution over the n+1 conserved substrate forms of total number $N_T$ factors into n independent one-dimensional factors, in the sense stated for this cycle in reference 1 and not merely in the weaker sense of admitting a closed-form expression as in the two-step case above — and characterize the non-equilibrium stationary distributions and their multimodality, as a function of $n$ and the Michaelis–Menten constants, for cycles with $n\geq 3$ sites.

(3) Extension of the method to other PdPC variants — the paper's Conclusions suggests extending the approach to other cycles, and its Introduction motivates this in particular by the cycle with a non-specific phosphatase and two specific kinases (the architecture arising in AMPA-receptor-mediated LTP/LTD models) and by the symmetric cycle with two phosphatases and a non-specific kinase.

(4) The dynamics of transient states: determine how the system relaxes toward the stationary state and derive the finite-size effects governing this relaxation beyond the Fokker–Planck approximation, which is valid only inside the diffusion region and near stationarity, since the relaxation may depend critically on finite-size effects.

(5) The hypothesis suggested by the paper's observation that chemical fluxes controlling the distribution shape provide a generic mechanism used by biochemical systems out of thermodynamic equilibrium to obtain plastic behavior; the extension suggested here is to evaluate that hypothesis in realistic signaling pathways. Unlike items (1), (2) and (4), this item is not flagged as an open task in the paper's Conclusions.

These five items are linked facets of one framework: items (1), (2) and (4) — the energetics, the number of sites, and the finite-size dynamical counterpart of the stationary-state theory — constitute the open core explicitly left by the source, while items (3) and (5) are extensions suggested by the paper, respectively architectural and functional-biological, rather than tasks flagged in its Conclusions.

References

1. A. Bazzani, G. C. Castellani, E. Giampieri, D. Remondini, L. N. Cooper, "Bistability in the chemical master equation for dual phosphorylation cycles", The Journal of Chemical Physics 136, 235102 (2012). DOI: 10.1063/1.4725180, https://doi.org/10.1063/1.4725180 (arXiv:1106.4445, https://arxiv.org/abs/1106.4445)
2. A. Goldbeter, D. E. Koshland, "An amplified sensitivity arising from covalent modification in biological systems", Proceedings of the National Academy of Sciences 78, 6840–6844 (1981). DOI: 10.1073/pnas.78.11.6840, https://doi.org/10.1073/pnas.78.11.6840
3. Q. Huang, H. Qian, "Ultrasensitive dual phosphorylation dephosphorylation cycle kinetics exhibits canonical competition behavior", Chaos 19, 033109 (2009). DOI: 10.1063/1.3187790, https://doi.org/10.1063/1.3187790
4. C. Conradi, M. Mincheva, "Catalytic constants enable the emergence of bistability in dual phosphorylation", Journal of the Royal Society Interface 11, 20140158 (2014). DOI: 10.1098/rsif.2014.0158, https://doi.org/10.1098/rsif.2014.0158
5. M. Samoilov, S. Plyasunov, A. P. Arkin, "Stochastic amplification and signaling in enzymatic futile cycles through noise-induced bistability with oscillations", Proceedings of the National Academy of Sciences 102, 2310–2315 (2005). DOI: 10.1073/pnas.0406841102, https://doi.org/10.1073/pnas.0406841102
6. L. M. Bishop, H. Qian, "Stochastic bistability and bifurcation in a mesoscopic signaling system with autocatalytic kinase", Biophysical Journal 98, 1–11 (2010). DOI: 10.1016/j.bpj.2009.09.055, https://doi.org/10.1016/j.bpj.2009.09.055
7. H. Ge, M. Qian, "Sensitivity amplification in the phosphorylation-dephosphorylation cycle: Nonequilibrium steady states, chemical master equation and temporal cooperativity", The Journal of Chemical Physics 129, 015104 (2008). DOI: 10.1063/1.2948965, https://doi.org/10.1063/1.2948965 (arXiv:0904.2250, https://arxiv.org/abs/0904.2250)
8. H. Qian, "Phosphorylation energy hypothesis: Open chemical systems and their biological functions", Annual Review of Physical Chemistry 58, 113–142 (2007). DOI: 10.1146/annurev.physchem.58.032806.104550, https://doi.org/10.1146/annurev.physchem.58.032806.104550
9. H. Ge, H. Qian, "Thermodynamic limit of a nonequilibrium steady state: Maxwell-type construction for a bistable biochemical system", Physical Review Letters 103, 148103 (2009). DOI: 10.1103/physrevlett.103.148103, https://doi.org/10.1103/physrevlett.103.148103
10. R. G. Endres, "Entropy production selects nonequilibrium states in multistable systems", Scientific Reports 7, 14437 (2017). DOI: 10.1038/s41598-017-14485-8, https://doi.org/10.1038/s41598-017-14485-8 (arXiv:1710.02600, https://arxiv.org/abs/1710.02600)
11. M. Vellela, H. Qian, "A quasistationary analysis of a stochastic chemical reaction: Keizer's paradox", Bulletin of Mathematical Biology 69, 1727–1746 (2007). DOI: 10.1007/s11538-006-9188-3, https://doi.org/10.1007/s11538-006-9188-3
12. M. Polettini, A. Wachtel, M. Esposito, "Dissipation in noisy chemical networks: The role of deficiency", The Journal of Chemical Physics 143, 184103 (2015). DOI: 10.1063/1.4935064, https://doi.org/10.1063/1.4935064 (arXiv:1507.00058, https://arxiv.org/abs/1507.00058)
13. M. Thomson, J. Gunawardena, "Unlimited multistability in multisite phosphorylation systems", Nature 460, 274–277 (2009). DOI: 10.1038/nature08102, https://doi.org/10.1038/nature08102
14. C. Jia, D.-Q. Jiang, Y. Li, "Detailed balance, local detailed balance, and global potential for stochastic chemical reaction networks", Advances in Applied Probability 53, 886–922 (2021). DOI: 10.1017/apr.2021.3, https://doi.org/10.1017/apr.2021.3
15. S. Müller, B. Joshi, "Detailed balance = complex balance + cycle balance: A graph-theoretic proof for reaction networks and Markov chains", Bulletin of Mathematical Biology 82, 116 (2020). DOI: 10.1007/s11538-020-00792-1, https://doi.org/10.1007/s11538-020-00792-1
16. G. C. Castellani, E. M. Quinlan, L. N. Cooper, H. Z. Shouval, "A biophysical model of bidirectional synaptic plasticity: Dependence on AMPA and NMDA receptors", Proceedings of the National Academy of Sciences 98, 12772–12777 (2001). DOI: 10.1073/pnas.201404598, https://doi.org/10.1073/pnas.201404598
17. G. C. Castellani, A. Bazzani, L. N. Cooper, "Toward a microscopic model of bidirectional synaptic plasticity", Proceedings of the National Academy of Sciences 106, 14091–14095 (2009). DOI: 10.1073/pnas.0905988106, https://doi.org/10.1073/pnas.0905988106
18. De Zhao, Teng Wang, Jian Zhao, Dianjie Li, Zhili Lin, Zeyan Chen, Qi Ouyang, Hong Qian, Yu V. Fu, Fangting Li, "Nonequilibrium and nonlinear kinetics as key determinants for bistability in fission yeast G2-M transition" (2016, revised 2024). arXiv:1610.09637, https://arxiv.org/abs/1610.09637 (unpublished preprint; bioRxiv counterpart under an earlier title and with a shorter author list: DOI 10.1101/084400, https://doi.org/10.1101/084400)
19. Teng Wang, Chenzi Jin, Fangting Li, "Phosphorylation potential and chemical fluxes govern the biological performance of multiple PdP cycles" (2016). arXiv:1612.01233, https://arxiv.org/abs/1612.01233
20. Dianjie Li, Siqi Liao, Qi Ouyang, Fangting Li, "Interplay between ATP and hydrolysis free energy in promoting and restraining biochemical switches", Physical Review Research 6, 033050 (2024). DOI: 10.1103/PhysRevResearch.6.033050, https://doi.org/10.1103/PhysRevResearch.6.033050
21. L. R. de Oliveira, A. Bazzani, E. Giampieri, G. C. Castellani, "The role of non-equilibrium fluxes in the relaxation processes of the linear chemical master equation", The Journal of Chemical Physics 141, 065102 (2014). DOI: 10.1063/1.4891515, https://doi.org/10.1063/1.4891515
22. A. Borri, F. Carravetta, G. Mavelli, P. Palumbo, "Chemical Master Equations – A Mathematical Scheme for the Multi-site Phosphorylation Case", Proceedings of the International Conference on Simulation and Modeling Methodologies, Technologies and Applications (SIMULTECH 2013), 681–688 (2013). DOI: 10.5220/0004632306810688, https://doi.org/10.5220/0004632306810688
23. A. M. Bersani, A. Borri, F. Carravetta, G. Mavelli, P. Palumbo, "On a stochastic approach to model the double phosphorylation/dephosphorylation cycle", Mathematics and Mechanics of Complex Systems 8, 261–285 (2020). DOI: 10.2140/memocs.2020.8.261, https://doi.org/10.2140/memocs.2020.8.261
24. S. Polizzi, T. Marzi, T. Matteuzzi, G. Castellani, A. Bazzani, "Random walk approximation for stochastic processes on graphs", Entropy 25, 394 (2023). DOI: 10.3390/e25030394, https://doi.org/10.3390/e25030394
25. A. Terebus, C. Liu, J. Liang, "Discrete and continuous models of probability flux of switching dynamics: Uncovering stochastic oscillations in a toggle-switch system", The Journal of Chemical Physics 151, 185104 (2019). DOI: 10.1063/1.5124823, https://doi.org/10.1063/1.5124823
26. G. Castellani, L. N. Cooper, L. R. De Oliveira, B. S. Blais, "Energy Consumption and Entropy Production in a Stochastic Formulation of BCM Learning", Journal of Computational Biology 28, 257–268 (2021). DOI: 10.1089/cmb.2020.0118, https://doi.org/10.1089/cmb.2020.0118
27. A. Gupta, J. Mikelson, M. Khammash, "A finite state projection algorithm for the stationary solution of the chemical master equation", The Journal of Chemical Physics 147, 154101 (2017). DOI: 10.1063/1.5006484, https://doi.org/10.1063/1.5006484
28. Lucie Laurence, Philippe Robert, "Thermodynamic limits of stochastic chemical reaction networks with phosphorylation" (2026). arXiv:2606.30325, https://arxiv.org/abs/2606.30325
29. Badal Joshi, Tung D. Nguyen, Matthew D. Johnston, "Bistability, absolute concentration robustness, and hysteresis in dual-site futile cycles with bifunctional enzymes" (2026). arXiv:2605.11389, https://arxiv.org/abs/2605.11389