❌

Normal view

Grokking From Abstraction to Intelligence

arXiv:2603.29262v1 Announce Type: new Abstract: Grokking in modular arithmetic has established itself as the quintessential fruit fly experiment, serving as a critical domain for investigating the mechanistic origins of model generalization. Despite its significance, existing research remains narrowly focused on specific local circuits or optimization tuning, largely overlooking the global structural evolution that fundamentally drives this phenomenon. We propose that grokking originates from a spontaneous simplification of internal model structures governed by the principle of parsimony. We integrate causal, spectral, and algorithmic complexity measures alongside Singular Learning Theory to reveal that the transition from memorization to generalization corresponds to the physical collapse of redundant manifolds and deep information compression, offering a novel perspective for understanding the mechanisms of model overfitting and generalization.

Spontaneous Functional Differentiation in Large Language Models: A Brain-Like Intelligence Economy

arXiv:2603.29735v1 Announce Type: new Abstract: The evolution of intelligence in artificial systems provides a unique opportunity to identify universal computational principles. Here we show that large language models spontaneously develop synergistic cores where information integration exceeds individual parts remarkably similar to the human brain. Using Integrated Information Decomposition across multiple architectures we find that middle layers exhibit synergistic processing while early and late layers rely on redundancy. This organization is dynamic and emerges as a physical phase transition as task difficulty increases. Crucially ablating synergistic components causes catastrophic performance loss confirming their role as the physical entity of abstract reasoning and bridging artificial and biological intelligence.

ATP-Bench: Towards Agentic Tool Planning for MLLM Interleaved Generation

arXiv:2603.29902v1 Announce Type: new Abstract: Interleaved text-and-image generation represents a significant frontier for Multimodal Large Language Models (MLLMs), offering a more intuitive way to convey complex information. Current paradigms rely on either image generation or retrieval augmentation, yet they typically treat the two as mutually exclusive paths, failing to unify factuality with creativity. We argue that the next milestone in this field is Agentic Tool Planning, where the model serves as a central controller that autonomously determines when, where, and which tools to invoke to produce interleaved responses for visual-critical queries. To systematically evaluate this paradigm, we introduce ATP-Bench, a novel benchmark comprising 7,702 QA pairs (including 1,592 VQA pairs) across eight categories and 25 visual-critical intents, featuring human-verified queries and ground truths. Furthermore, to evaluate agentic planning independent of end-to-end execution and changing tool backends, we propose a Multi-Agent MLLM-as-a-Judge (MAM) system. MAM evaluates tool-call precision, identifies missed opportunities for tool use, and assesses overall response quality without requiring ground-truth references. Our extensive experiments on 10 state-of-the-art MLLMs reveal that models struggle with coherent interleaved planning and exhibit significant variations in tool-use behavior, highlighting substantial room for improvement and providing actionable guidance for advancing interleaved generation. Dataset and code are available at https://github.com/Qwen-Applications/ATP-Bench.

LLM-Meta-SR: In-Context Learning for Evolving Selection Operators in Symbolic Regression

arXiv:2505.18602v3 Announce Type: replace-cross Abstract: Large language models (LLMs) have revolutionized algorithm development, yet their application in symbolic regression, where algorithms automatically discover symbolic expressions from data, remains limited. In this paper, we propose a meta-learning framework that enables LLMs to automatically design selection operators for evolutionary symbolic regression algorithms. We first identify two key limitations in existing LLM-based algorithm evolution techniques: lack of semantic guidance and code bloat. The absence of semantic awareness can lead to ineffective exchange of useful code components, while bloat results in unnecessarily complex components; both can hinder evolutionary learning progress or reduce the interpretability of the designed algorithm. To address these issues, we enhance the LLM-based evolution framework for meta-symbolic regression with two key innovations: a complementary, semantics-aware selection operator and bloat control. Additionally, we embed domain knowledge into the prompt, enabling the LLM to generate more effective and contextually relevant selection operators. Our experimental results on symbolic regression benchmarks show that LLMs can devise selection operators that outperform nine expert-designed baselines, achieving state-of-the-art performance. Moreover, the evolved operator can further improve a state-of-the-art symbolic regression algorithm, achieving the best performance among 28 symbolic regression and other machine learning algorithms across 116 regression datasets. This demonstrates that LLMs can exceed expert-level algorithm design for symbolic regression.

Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles

arXiv:2506.10848v3 Announce Type: replace-cross Abstract: Diffusion-based language models (dLLMs) have emerged as a promising alternative to traditional autoregressive LLMs by enabling parallel token generation and significantly reducing inference latency. However, existing sampling strategies for dLLMs, such as confidence-based or semi-autoregressive decoding, often suffer from static behavior, leading to suboptimal efficiency and limited flexibility. In this paper, we propose SlowFast Sampling, a novel dynamic sampling strategy that adaptively alternates between exploratory and accelerated decoding stages. Our method is guided by three golden principles: certainty principle, convergence principle, and positional principle, which govern when and where tokens can be confidently and efficiently decoded. We further integrate our strategy with dLLM-Cache to reduce redundant computation. Extensive experiments across benchmarks and models show that SlowFast Sampling achieves up to 15.63$\times$ speedup on LLaDA with minimal accuracy drop, and up to 34.22$\times$ when combined with caching. Notably, our approach outperforms strong autoregressive baselines like LLaMA3 8B in throughput, demonstrating that well-designed sampling can unlock the full potential of dLLMs for fast and high-quality generation.

Integrated transcriptomic and proteomic analyses elucidate the stress tolerance network of <em>Saccharomyces boulardii</em> under gastrointestinal challenge

Food Funct. 2026 Mar 31. doi: 10.1039/d5fo04958j. Online ahead of print.

ABSTRACT

The probiotic yeast Saccharomyces boulardii is renowned for its clinical efficacy, which is intrinsically linked to its exceptional ability to survive the harsh gastrointestinal (GI) environment. However, a comprehensive understanding of the molecular mechanisms and regulatory pathways underlying the stress tolerance of S. boulardii remains limited. This study employed an integrated transcriptomic and proteomic approach to systematically map the dynamic responses of S. boulardii to simulated GI transit. Our analysis revealed that the intestinal phase posed a significantly greater challenge than the gastric phase, triggering extensive molecular reprogramming. A core adaptive strategy was the marked upregulation of the central carbon metabolism, particularly glycolysis, as evidenced by the concerted overexpression of key enzymes at both transcriptional and translational levels, indicating a heightened demand for energy to fuel stress defence mechanisms. Furthermore, significant enrichment was observed in the pathways related to nitrogen and fatty acid metabolism. Integration of the multi-omics datasets highlighted the complexity of the regulatory response, with frequent discordance between mRNA and protein abundance underscoring the importance of post-transcriptional regulation. This study provides a detailed molecular profile of the stress tolerance network in S. boulardii, elucidating the strategic metabolic rewiring and multi-layered regulation that underpin its probiotic resilience. The findings offer valuable insights and a foundational resource for the future development of enhanced probiotic therapies.

PMID:41914832 | DOI:10.1039/d5fo04958j

Integrated transcriptomic and proteomic analyses elucidate the stress tolerance network of <em>Saccharomyces boulardii</em> under gastrointestinal challenge

Food Funct. 2026 Mar 31. doi: 10.1039/d5fo04958j. Online ahead of print.

ABSTRACT

The probiotic yeast Saccharomyces boulardii is renowned for its clinical efficacy, which is intrinsically linked to its exceptional ability to survive the harsh gastrointestinal (GI) environment. However, a comprehensive understanding of the molecular mechanisms and regulatory pathways underlying the stress tolerance of S. boulardii remains limited. This study employed an integrated transcriptomic and proteomic approach to systematically map the dynamic responses of S. boulardii to simulated GI transit. Our analysis revealed that the intestinal phase posed a significantly greater challenge than the gastric phase, triggering extensive molecular reprogramming. A core adaptive strategy was the marked upregulation of the central carbon metabolism, particularly glycolysis, as evidenced by the concerted overexpression of key enzymes at both transcriptional and translational levels, indicating a heightened demand for energy to fuel stress defence mechanisms. Furthermore, significant enrichment was observed in the pathways related to nitrogen and fatty acid metabolism. Integration of the multi-omics datasets highlighted the complexity of the regulatory response, with frequent discordance between mRNA and protein abundance underscoring the importance of post-transcriptional regulation. This study provides a detailed molecular profile of the stress tolerance network in S. boulardii, elucidating the strategic metabolic rewiring and multi-layered regulation that underpin its probiotic resilience. The findings offer valuable insights and a foundational resource for the future development of enhanced probiotic therapies.

PMID:41914832 | DOI:10.1039/d5fo04958j

❌