โŒ

Normal view

  • โœ‡cs.AI, q-bio.NC updates on arXiv.org
  • Grokking as Dimensional Phase Transition in Neural Networks Ping Wang
    arXiv:2604.04655v1 Announce Type: cross Abstract: Neural network grokking -- the abrupt memorization-to-generalization transition -- challenges our understanding of learning dynamics. Through finite-size scaling of gradient avalanche dynamics across eight model scales, we find that grokking is a \textit{dimensional phase transition}: effective dimensionality~$D$ crosses from sub-diffusive (subcritical, $D 1$) at generalization onset, exhibiting self-organized criticality (SOC). Crucially, $D$
     

Grokking as Dimensional Phase Transition in Neural Networks

arXiv:2604.04655v1 Announce Type: cross Abstract: Neural network grokking -- the abrupt memorization-to-generalization transition -- challenges our understanding of learning dynamics. Through finite-size scaling of gradient avalanche dynamics across eight model scales, we find that grokking is a \textit{dimensional phase transition}: effective dimensionality~$D$ crosses from sub-diffusive (subcritical, $D 1$) at generalization onset, exhibiting self-organized criticality (SOC). Crucially, $D$ reflects \textbf{gradient field geometry}, not network architecture: synthetic i.i.d.\ Gaussian gradients maintain $D \approx 1$ regardless of graph topology, while real training exhibits dimensional excess from backpropagation correlations. The grokking-localized $D(t)$ crossing -- robust across topologies -- offers new insight into the trainability of overparameterized networks.

Thermodynamic connectivity reveals functional specialization and multiplex organization of extrasynaptic signaling

arXiv:2604.02057v1 Announce Type: new Abstract: Neural communication operates on both fast synaptic transmission and slower, diffusive extrasynaptic signaling, yet how these two modes jointly organize brain function remains unclear. Here, using the complete synaptic and neuropeptidergic connectomes of \emph{Caenorhabditis elegans}, we develop a unified multiplex framework linking anatomical wiring to functional communication. We infer structure-derived functional connectivity from the synaptic connectome using equilibrium principles from statistical physics, yielding a probabilistic map of information flow across all synaptic pathways, and compare this functional layer directly with the extrasynaptic connectome. This reveals a principled functional specialization across four communication regimes: (i) a topology-dependent layer that reinforces and stabilizes synaptic motor circuits, (ii) a topology-resilient modulatory layer supporting global regulation and behavioral state control, (iii) a purely extrasynaptic network sustaining survival and homeostasis, and (iv) a purely synaptic regime mediating rapid, low-latency sensorimotor processing. Together, these findings reveal that synaptic and extrasynaptic signaling form complementary architectures optimized for speed, modulation, robustness, and survival, and provide a general strategy for integrating structural and modulatory connectomes to understand how distinct communication modes cooperate to sustain coherent brain function.

Copy-Spread-Annihilate Dynamics in Degree-Assortative Networks

arXiv:2603.29833v1 Announce Type: new Abstract: In many systems, communication proceeds by broadcasting rather than single source-target routing, but network structures that maximize signal lifetime are not well understood. Degree correlations are known to influence robustness and spreading, yet their effect on signal persistence has remained unclear. Here we introduce Copy-Spread-Annihilate dynamics, a minimal synchronous broadcasting model with annihilation. We show that signal lifetimes vary non-monotonically with assortativity and are maximized near neutral assortativity, where hub-driven amplification is strong but annihilation via short cycles is still limited. Applying this framework to the mouse connectome suggests assortativity as a structural control parameter for broadcast signal persistence in brain-like and other complex networks.

Pulse desynchronization of neural populations by targeting the centroid of the limit cycle in phase space

arXiv:2603.12878v1 Announce Type: new Abstract: The synchronized activity of neuronal populations can lead to pathological over-synchronization in conditions such as epilepsy and Parkinson disease. Such states can be desynchronized by brief electrical pulses. But when the underlying oscillating system is not known, as in most practical applications, to determine the specific times and intensities of pulses used for desynchronizaton is a difficult inverse problem. Here we propose a desynchronization scheme for neuronal models of bi-variate neural activity, with possible applications in the medical setting. Our main argument is the existence of a peculiar point in the phase space of the system, the centroid, that is both easy to calculate and robust under changes in the coupling constant. This important target point can be used in a control procedure because it lies in the region of minimal return times of the system.

Two-phase quadratic integrate-and-fire neurons: Exact low-dimensional description for ensembles of finite-voltage neurons

arXiv:2603.03870v1 Announce Type: new Abstract: We introduce a two-phase quadratic integrate-and-fire (QIF) neuron whose membrane potential evolves according to two alternating Riccati equations within finite bounds. This simple extension removes the unphysical voltage divergence of the standard QIF model while producing realistic spike waveforms. Despite this modification, the system retains an exact low-dimensional description in the thermodynamic limit, governed by a single complex Riccati equation. Expressions for collective quantities such as the firing rate and mean voltage remain compact and analytically tractable. Because the formalism preserves the mathematical structure of the standard QIF ensemble, it inherits its many generalizations and can serve as a drop-in replacement in existing mean-field frameworks, providing a more biologically plausible yet still exactly solvable neuronal model.
โŒ