❌

Normal view

Received — 15 September 2026 ⏭

EvoRS: On-Policy Self-Evolution of Reward Systems for Open-Ended Reinforcement Learning

✇cs.AI, q-bio.NC updates on arXiv.org
By: Weiyuan Li · Aili Chen · Xintao Wang · Yikai Zhang · Qingqing Dong · Jinghan Xu · Hongru Hou · Wenxuan Zhao · Chengkun Lang · Jun Gao · Yuanli Guo · Hongcheng Guo · Yanghua Xiao · Deqing Yang
14 September 2026 at 12:00
arXiv:2609.12459v1 Announce Type: new Abstract: Open-ended reinforcement learning often relies on rubric-based rewards for tasks without directly verifiable answers. Yet the policy and reward system form a dynamic feedback loop: as the policy optimizes the current reward, an initially useful reward system may become unreliable due to reward hacking or reduced response discriminability. The reward system should therefore evolve rather than remain fixed during training. Existing dynamic-rubric methods adapt evaluation criteria, but reward failures can also arise from scoring mechanisms or signal composition. We introduce EvoRS, a self-evolving RL framework that evolves the reward system from on-policy experience, representing it as an executable Reward-DAG. Specifically, an agentic designer updates this system from on-policy rollouts and reward traces to maintain train-time reliability. Across writing and roleplay, EvoRS achieves the best quality under all three judges, outperforming the policy by \(2.107\) and \(4.767\) points, respectively, while reducing reward hacking and coverage failures and preserving reward informativeness. Ablations confirm that a comprehensive fixed reward system cannot remain reliable in open-ended tasks and must evolve throughout training.
Received — 10 September 2026 ⏭

From the invasive front to organotropic pre-metastatic niches: spatial immune regulatory networks governing cholangiocarcinoma dissemination and metastasis-intercepting immunotherapy

✇Omics In Lung
By: Longhao Zhang · Kai Zhang · Zhihong Chen · Xin Lu
4 September 2026 at 18:00

Front Immunol. 2026 Aug 20;17:1919864. doi: 10.3389/fimmu.2026.1919864. eCollection 2026.

ABSTRACT

Cholangiocarcinoma is an aggressive biliary tract malignancy in which metastatic relapse and primary or acquired resistance to immunotherapy remain major causes of mortality. Although immune checkpoint inhibitors have improved first-line treatment for advanced biliary tract cancer, most patients do not achieve durable benefit, indicating that immune failure is not explained by a single checkpoint pathway. In this Review, we propose a spatial immune-regulatory continuum for cholangiocarcinoma dissemination. Most direct single-cell and spatial evidence currently derives from intrahepatic cholangiocarcinoma, and its applicability to perihilar and distal disease remains to be established. This continuum begins in the tumor core and invasive front, where malignant cells, cancer-associated fibroblasts, tumor-associated macrophages, endothelial and lymphatic cells, regulatory T cells, immature neutrophils and excluded or dysfunctional cytotoxic T cells form a pro-invasive ecosystem. It then extends through extracellular vesicles, soluble mediators and lymphovascular routes that may educate organotropic pre-metastatic niches. Finally, lymph node, lung, liver, peritoneal and bone microenvironments provide organ-specific extracellular matrix, myeloid and stromal programs that enable immune evasion and metastatic colonization. By integrating clinical evidence, multi-omics studies, single-cell and spatial transcriptomics, extracellular vesicle biology, pre-metastatic niche concepts and emerging therapeutic strategies, we argue that cholangiocarcinoma metastasis should be targeted before overt dissemination whenever possible. In this Review, "metastasis-intercepting immunotherapy" is used as an author-defined conceptual framework for strategies intended to prevent or disrupt the immune-stromal conditions that enable dissemination and colonization, rather than merely shrink established metastatic lesions. Metastasis-intercepting immunotherapy will likely require rational combinations that reprogram the invasive front, restore dendritic-cell-mediated antigen presentation, block tumor-stroma-myeloid circuits, disrupt EV-mediated communication that may contribute to niche formation and select patients using spatial biomarkers rather than bulk immune markers alone.

PMID:42694469 | PMC:PMC13539491 | DOI:10.3389/fimmu.2026.1919864

Received — 27 May 2026 ⏭

FrontierOR: Benchmarking LLMs' Capacity for Efficient Algorithm Design in Large-Scale Optimization

✇cs.AI, q-bio.NC updates on arXiv.org
By: Minwei Kong · Chonghe Jiang · Ao Qu · Wenbin Ouyang · Zhaoming Zeng · Xiaotong Guo · Zhekai Li · Junyi Li · Yi Fan · Xinshou Zheng · Xi Jing · Yikai Zhang · Zhiwei Liang · Seonghoo Kim · Runqing Yang · Zijian Zhou · Sirui Li · Han Zheng · Wangyang Ying · Ou Zheng · Chonghuan Wang · Jinglong Zhao · Hanzhang Qin · Cathy Wu · Paul Pu Liang · Jinhua Zhao · Hai Wang
26 May 2026 at 12:00
arXiv:2605.25246v2 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for optimization modeling and solver-code generation, yet practical operations research and optimization problems often require a harder capability: designing scalable algorithms that exploit problem structure and outperform direct formulation-and-solve baselines. Existing benchmarks are limited to small or simplified examples far below real-world scale and complexity. We introduce FrontierOR, among the first benchmarks to systematically evaluate LLM-based efficient algorithm design for realistic large-scale optimization problems. FrontierOR includes 180 tasks derived from methodologically diverse papers published in top-tier operations research venues, each with standardized instances and a hidden, expert-verified evaluation suite. We evaluate seven LLMs spanning frontier, cost-effective, and open-source models both in one-shot and test-time evolution settings. The results reveal that frontier models still struggle to move from executable formulations to efficient optimization algorithms: the strongest one-shot model outperforms Gurobi in only 31% of cases in both solution quality and computational efficiency, and even strong coding agents with test-time evolution achieve only 50% on selected hard tasks. FrontierOR establishes a practical evaluation platform for LLM-based optimization algorithm design, which enables future LLMs and agents to be systematically tested on whether they can move beyond correct formulation toward a feasible, high-quality, and efficient algorithm.

IVR-R1: Refining Trajectories through Iterative Visual-Grounded Reasoning in Reinforcement Learning

✇cs.AI, q-bio.NC updates on arXiv.org
By: Chenghao Li · Fusheng Hao · Xikai Zhang · Likang Xiao · Yanwei Ren · Fuxiang Wu · Quan Chen · Liu Liu
26 May 2026 at 12:00
arXiv:2605.23997v1 Announce Type: cross Abstract: Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual hallucination and logical error. Current methods typically pre-encode high-dimensional visual scenes into discrete textual proxies to facilitate downstream reasoning. As the reasoning chain unfolds, however, the inherent information asymmetry between text and visual scenes tends to erode visual grounding, resulting in misguided reasoning and erroneous outputs. To address this issue, we introduce IVR-R1 (Iterative Visual-grounded Reasoning), a novel RL training framework that facilitates dynamic visual re-alignment that actively rectifies reasoning trajectories to guide policy optimization. Specifically, by leveraging a reward-driven screening mechanism to identify flawed rollouts, IVR-R1 executes a fine-grained, step-level error attribution within the multimodal context. By iteratively cross-referencing intermediate reasoning states against pristine visual priors, a Re-Reasoning Loop enables automated trajectory rectification, effectively synthesizing expert-level demonstrations that serve as high-fidelity reasoning templates for the policy model. Our experiments across diverse multimodal benchmarks demonstrate that IVR-R1 consistently outperforms existing reinforcement learning methods, establishing a superior paradigm for maintaining logical and visual consistency in complex multimodal reasoning.

Agent Learning via Early Experience

✇cs.AI, q-bio.NC updates on arXiv.org
By: Kai Zhang · Xiangchao Chen · Bo Liu · Tianci Xue · Zeyi Liao · Zhihan Liu · Xiyao Wang · Yuting Ning · Zhaorun Chen · Xiaohan Fu · Jian Xie · Yuxuan Sun · Boyu Gou · Qi Qi · Zihang Meng · Jianwei Yang · Ning Zhang · Xian Li · Ashish Shah · Dat Huynh · Hengduo Li · Zi Yang · Sara Cao · Lawrence Jang · Shuyan Zhou · Jiacheng Zhu · Huan Sun · Jason Weston · Yu Su · Yifan Wu
26 May 2026 at 12:00
arXiv:2510.08558v3 Announce Type: replace Abstract: A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains difficult in many environments, which either lack verifiable rewards (e.g., websites) or require inefficient long-horizon rollouts (e.g., multi-turn tool use). As a result, most current agents rely on supervised fine-tuning on expert data, which is challenging to scale and generalizes poorly. This limitation stems from the nature of expert demonstrations: they capture only a narrow range of scenarios, and expose the agent to limited environment diversity. We address this limitation with a middle-ground paradigm we call early experience: interaction data generated by the agent's own actions, where the resulting future states serve as supervision without reward signals. Within this paradigm, we study two strategies of using such data: (1) implicit world modeling, which uses collected states to ground the policy in environment dynamics; and (2) self-reflection, where the agent learns from its suboptimal actions to improve reasoning and decision-making. Evaluation across eight diverse environments and multiple model families shows that our approaches consistently improve effectiveness and out-of-domain generalization, highlighting the value of early experience. Moreover, in environments with verifiable rewards, our results provide promising signals that early experience offers a strong foundation for subsequent reinforcement learning, making it a practical bridge between imitation learning and fully experience-driven agents.
Received — 8 April 2026 ⏭

Beyond Retrieval: Modeling Confidence Decay and Deterministic Agentic Platforms in Generative Engine Optimization

✇cs.AI, q-bio.NC updates on arXiv.org
By: XinYu Zhao · ChengYou Li · XiangBao Meng · Kai Zhang · XiaoDong Liu
7 April 2026 at 12:00
arXiv:2604.03656v1 Announce Type: new Abstract: Generative Engine Optimization (GEO) is rapidly reshaping digital marketing paradigms in the era of Large Language Models (LLMs). However, current GEO strategies predominantly rely on Retrieval-Augmented Generation (RAG), which inherently suffers from probabilistic hallucinations and the "zero-click" paradox, failing to establish sustainable commercial trust. In this paper, we systematically deconstruct the probabilistic flaws of existing RAG-based GEO and propose a paradigm shift towards deterministic multi-agent intent routing. First, we mathematically formulate Semantic Entropy Drift (SED) to model the dynamic decay of confidence curves in LLMs over continuous temporal and contextual perturbations. To rigorously quantify optimization value in black-box commercial engines, we introduce the Isomorphic Attribution Regression (IAR) model, leveraging a Multi-Agent System (MAS) probe with strict human-in-the-loop physical isolation to enforce hallucination penalties. Furthermore, we architect the Deterministic Agent Handoff (DAH) protocol, conceptualizing an Agentic Trust Brokerage (ATB) ecosystem where LLMs function solely as intent routers rather than final answer generators. We empirically validate this architecture using EasyNote, an industrial AI meeting minutes product by Yishu Technology. By routing the intent of "knowledge graph mapping on an infinite canvas" directly to its specialized proprietary agent via DAH, we demonstrate the reduction of vertical task hallucination rates to near zero. This work establishes a foundational theoretical framework for next-generation GEO and paves the way for a well-ordered, deterministic human-AI collaboration ecosystem.

BAAI Cardiac Agent: An intelligent multimodal agent for automated reasoning and diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging

✇cs.AI, q-bio.NC updates on arXiv.org
By: Taiping Qu · Hongkai Zhang · Lantian Zhang · Can Zhao · Nan Zhang · Hui Wang · Zhen Zhou · Mingye Zou · Kairui Bo · Pengfei Zhao · Xingxing Jin · Zixian Su · Kun Jiang · Huan Liu · Yu Du · Maozhou Wang · Ruifang Yan · Zhongyuan Wang · Tiejun Huang · Lei Xu · Henggui Zhang
7 April 2026 at 12:00
arXiv:2604.04078v1 Announce Type: cross Abstract: Cardiac magnetic resonance (CMR) is a cornerstone for diagnosing cardiovascular disease. However, it remains underutilized due to complex, time-consuming interpretation across multi-sequences, phases, quantitative measures that heavily reliant on specialized expertise. Here, we present BAAI Cardiac Agent, a multimodal intelligent system designed for end-to-end CMR interpretation. The agent integrates specialized cardiac expert models to perform automated segmentation of cardiac structures, functional quantification, tissue characterization and disease diagnosis, and generates structured clinical reports within a unified workflow. Evaluated on CMR datasets from two hospitals (2413 patients) spanning 7-types of major cardiovascular diseases, the agent achieved an area under the receiver-operating-characteristic curve exceeding 0.93 internally and 0.81 externally. In the task of estimating left ventricular function indices, the results generated by this system for core parameters such as ejection fraction, stroke volume, and left ventricular mass are highly consistent with clinical reports, with Pearson correlation coefficients all exceeding 0.90. The agent outperformed state-of-the-art models in segmentation and diagnostic tasks, and generated clinical reports showing high concordance with expert radiologists (six readers across three experience levels). By dynamically orchestrating expert models for coordinated multimodal analysis, this agent framework enables accurate, efficient CMR interpretation and highlights its potentials for complex clinical imaging workflows. Code is available at https://github.com/plantain-herb/Cardiac-Agent.

Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics

✇cs.AI, q-bio.NC updates on arXiv.org
By: Lianhao Zhou · Hongyi Ling · Cong Fu · Yepeng Huang · Michael Sun · Wendi Yu · Xiaoxuan Wang · Xiner Li · Xingyu Su · Junkai Zhang · Xiusi Chen · Chenxing Liang · Xiaofeng Qian · Heng Ji · Wei Wang · Marinka Zitnik · Shuiwang Ji
7 April 2026 at 12:00
arXiv:2510.09901v2 Announce Type: replace Abstract: Computing has long served as a cornerstone of scientific discovery. Recently, a paradigm shift has emerged with the rise of large language models (LLMs), introducing autonomous systems, referred to as agents, that accelerate discovery across varying levels of autonomy. These language agents provide a flexible and versatile framework that orchestrates interactions with human scientists, natural language, computer language and code, and physics. This paper presents our view and vision of LLM-based scientific agents and their growing role in transforming the scientific discovery lifecycle, from hypothesis discovery, experimental design and execution, to result analysis and refinement. We critically examine current methodologies, emphasizing key innovations, practical achievements, and outstanding limitations. Additionally, we identify open research challenges and outline promising directions for building more robust, generalizable, and adaptive scientific agents. Our analysis highlights the transformative potential of autonomous agents to accelerate scientific discovery across diverse domains.
Received — 4 April 2026 ⏭

SelfGrader: Stable Jailbreak Detection for Large Language Models using Token-Level Logits

✇cs.AI, q-bio.NC updates on arXiv.org
By: Zikai Zhang · Rui Hu · Olivera Kotevska · Jiahao Xu
3 April 2026 at 12:00
arXiv:2604.01473v1 Announce Type: cross Abstract: Large Language Models (LLMs) are powerful tools for answering user queries, yet they remain highly vulnerable to jailbreak attacks. Existing guardrail methods typically rely on internal features or textual responses to detect malicious queries, which either introduce substantial latency or suffer from the randomness in text generation. To overcome these limitations, we propose SelfGrader, a lightweight guardrail method that formulates jailbreak detection as a numerical grading problem using token-level logits. Specifically, SelfGrader evaluates the safety of a user query within a compact set of numerical tokens (NTs) (e.g., 0-9) and interprets their logit distribution as an internal safety signal. To align these signals with human intuition of maliciousness, SelfGrader introduces a dual-perspective scoring rule that considers both the maliciousness and benignness of the query, yielding a stable and interpretable score that reflects harmfulness and reduces the false positive rate simultaneously. Extensive experiments across diverse jailbreak benchmarks, multiple LLMs, and state-of-the-art guardrail baselines demonstrate that SelfGrader achieves up to a 22.66% reduction in ASR on LLaMA-3-8B, while maintaining significantly lower memory overhead (up to 173x) and latency (up to 26x).
Received — 2 April 2026 ⏭

$V_0$: A Generalist Value Model for Any Policy at State Zero

✇cs.AI, q-bio.NC updates on arXiv.org
By: Yi-Kai Zhang · Zhiyuan Yao · Hongyan Hao · Yueqing Sun · Qi Gu · Hui Su · Xunliang Cai · De-Chuan Zhan · Han-Jia Ye
1 April 2026 at 12:00
arXiv:2602.03584v2 Announce Type: replace-cross Abstract: Policy gradient methods rely on a baseline to measure the relative advantage of an action, ensuring the model reinforces behaviors that outperform its current average capability. In the training of Large Language Models (LLMs) using Actor-Critic methods (e.g., PPO), this baseline is typically estimated by a Value Model (Critic) often as large as the policy model itself. However, as the policy continuously evolves, the value model requires expensive, synchronous incremental training to accurately track the shifting capabilities of the policy. To avoid this overhead, Group Relative Policy Optimization (GRPO) eliminates the coupled value model by using the average reward of a group of rollouts as the baseline; yet, this approach necessitates extensive sampling to maintain estimation stability. In this paper, we propose $V_0$, a Generalist Value Model capable of estimating the expected performance of any model on unseen prompts without requiring parameter updates. We reframe value estimation by treating the policy's dynamic capability as an explicit context input; specifically, we leverage a history of instruction-performance pairs to dynamically profile the model, departing from the traditional paradigm that relies on parameter fitting to perceive capability shifts. Focusing on value estimation at State Zero (i.e., the initial prompt, hence $V_0$), our model serves as a critical resource scheduler. During GRPO training, $V_0$ predicts success rates prior to rollout, allowing for efficient sampling budget allocation; during deployment, it functions as a router, dispatching instructions to the most cost-effective and suitable model. Empirical results demonstrate that $V_0$ significantly outperforms heuristic budget allocation and achieves a Pareto-optimal trade-off between performance and cost in LLM routing tasks.
Received — 26 March 2026 ⏭

Research on the compatibility mechanism of the Tingli Dazao Xiefei Decoction by multi-organ metabolomics strategy

✇(Multiomics OR Omics) AND (Lung OR gastric OR Hepatocellular)
By: Rui-Feng Wang · Pei-Pei Yuan · Long Chen · Zhen-Kai Zhang · Bing-Xian Zhang · Lin Chen · Shu-Miao Yuan · Yan-Fang Zhao · Ning Zhou · Xiao-Ke Zheng · Wei-Sheng Feng
23 March 2026 at 18:00

J Ethnopharmacol. 2026 Mar 21:121548. doi: 10.1016/j.jep.2026.121548. Online ahead of print.

ABSTRACT

ETHNOPHARMACOLOGICAL RELEVANCE: The Tingli Dazao Xiefei Decoction (TD) is a traditional phlegm-eliminating prescription composed of Descurainia sophia (L.) Webb. ex Prantl (TLZ) and Ziziphus jujuba Mill. (DZ), which can relieve lung, heart and kidney injury in asthma. TLZ acts as the monarch drug in the TD. Based on the research mode of "material basis of traditional Chinese medicinal properties can be divided and combined", we have confirmed that the flavonoid glycosides components /the oligosaccharide components/the fatty oil component (FG/Oli/FO) are effective components of TLZ. However, the compatibility mechanism of the TD, and the contribution of the effective components of TLZ to the efficacy were still unclear.

AIM OF THE STUDY: To clarify the compatibility mechanism of TD, and the contribution of the effective components of TLZ to the efficacy from a comprehensive perspective of lung, heart, and kidney.

METHODS: First, we chose the asthma model corresponding to the efficacy of TD in purging the lungs and relieving asthma, and the rats were divided into the normal (NC) group, model (M) group, dexamethasone (DEX) group, and treatment groups of TD/TLZ/DZ/FO+DZ/Oli+DZ/FG+DZ. Second, metabolomics and network pharmacology were applied to elucidate the comprehensive protective effect of TD/FG+DZ/Oli+DZ/FO+DZ. Third, the multi-omics results were validated using Western blotting, RT-qPCR, flow cytometry, and immunofluorescence.

RESULTS: FO+DZ/Oli+DZ/FG+DZ had different degrees of protective effects against lung/heart/kidney injury in asthma. In metabolomics research, the principal component analysis (PCA) and cluster analysis results showed that the TLZ group was closer to TD group than DZ group, the FO+DZ and Oli+DZ group clustered with TD/NC groups in the lung and kidney, and the FO+DZ and FG+DZ group clustered with TD/NC groups in the heart. Pathway enrichment analysis suggested that the comprehensive protective effect of TLZ and its effective components combined with DZ on lung/heart/kidney may be achieved by regulating the arginine and proline metabolism, alanine, aspartate and glutamate metabolism, and unsaturated fatty acid biosynthesis. Multi-organ metabolomics and network pharmacology revealed consistent biological functions in KEGG pathways. Validation experiment showed that TLZ and its effective components combined with DZ could reverse the abnormal expression of proteins and RNA related to inflammation, airway remodeling, excitotoxicity, and energy-supply, apoptosis at different levels. Furthermore, FO+DZ may reduce asthma damage by inhibiting the FABP4/PPAR-γ/NF-κB signaling pathway.

CONCLUSION: TLZ played the key role in TD, and FO had the best therapeutic effect on each organ; the efficacy of Oli was mainly reflected in reducing lung and kidney damage, and FG was mainly involved in enhancing energy metabolism in the heart. These findings proved that traditional Chinese medicine could exert comprehensive efficacy in a 'multi-components trigger multi-channel' way.

PMID:41871629 | DOI:10.1016/j.jep.2026.121548

Research on the compatibility mechanism of the Tingli Dazao Xiefei Decoction by multi-organ metabolomics strategy

✇Omics In Lung
By: Rui-Feng Wang · Pei-Pei Yuan · Long Chen · Zhen-Kai Zhang · Bing-Xian Zhang · Lin Chen · Shu-Miao Yuan · Yan-Fang Zhao · Ning Zhou · Xiao-Ke Zheng · Wei-Sheng Feng
23 March 2026 at 18:00

J Ethnopharmacol. 2026 Mar 21:121548. doi: 10.1016/j.jep.2026.121548. Online ahead of print.

ABSTRACT

ETHNOPHARMACOLOGICAL RELEVANCE: The Tingli Dazao Xiefei Decoction (TD) is a traditional phlegm-eliminating prescription composed of Descurainia sophia (L.) Webb. ex Prantl (TLZ) and Ziziphus jujuba Mill. (DZ), which can relieve lung, heart and kidney injury in asthma. TLZ acts as the monarch drug in the TD. Based on the research mode of "material basis of traditional Chinese medicinal properties can be divided and combined", we have confirmed that the flavonoid glycosides components /the oligosaccharide components/the fatty oil component (FG/Oli/FO) are effective components of TLZ. However, the compatibility mechanism of the TD, and the contribution of the effective components of TLZ to the efficacy were still unclear.

AIM OF THE STUDY: To clarify the compatibility mechanism of TD, and the contribution of the effective components of TLZ to the efficacy from a comprehensive perspective of lung, heart, and kidney.

METHODS: First, we chose the asthma model corresponding to the efficacy of TD in purging the lungs and relieving asthma, and the rats were divided into the normal (NC) group, model (M) group, dexamethasone (DEX) group, and treatment groups of TD/TLZ/DZ/FO+DZ/Oli+DZ/FG+DZ. Second, metabolomics and network pharmacology were applied to elucidate the comprehensive protective effect of TD/FG+DZ/Oli+DZ/FO+DZ. Third, the multi-omics results were validated using Western blotting, RT-qPCR, flow cytometry, and immunofluorescence.

RESULTS: FO+DZ/Oli+DZ/FG+DZ had different degrees of protective effects against lung/heart/kidney injury in asthma. In metabolomics research, the principal component analysis (PCA) and cluster analysis results showed that the TLZ group was closer to TD group than DZ group, the FO+DZ and Oli+DZ group clustered with TD/NC groups in the lung and kidney, and the FO+DZ and FG+DZ group clustered with TD/NC groups in the heart. Pathway enrichment analysis suggested that the comprehensive protective effect of TLZ and its effective components combined with DZ on lung/heart/kidney may be achieved by regulating the arginine and proline metabolism, alanine, aspartate and glutamate metabolism, and unsaturated fatty acid biosynthesis. Multi-organ metabolomics and network pharmacology revealed consistent biological functions in KEGG pathways. Validation experiment showed that TLZ and its effective components combined with DZ could reverse the abnormal expression of proteins and RNA related to inflammation, airway remodeling, excitotoxicity, and energy-supply, apoptosis at different levels. Furthermore, FO+DZ may reduce asthma damage by inhibiting the FABP4/PPAR-γ/NF-κB signaling pathway.

CONCLUSION: TLZ played the key role in TD, and FO had the best therapeutic effect on each organ; the efficacy of Oli was mainly reflected in reducing lung and kidney damage, and FG was mainly involved in enhancing energy metabolism in the heart. These findings proved that traditional Chinese medicine could exert comprehensive efficacy in a 'multi-components trigger multi-channel' way.

PMID:41871629 | DOI:10.1016/j.jep.2026.121548

Received — 17 February 2026 ⏭

Reinforcement Learning with Promising Tokens for Large Language Models

✇cs.AI, q-bio.NC updates on arXiv.org
By: Jing-Cheng Pang · Liang Lu · Xian Tang · Kun Jiang · Sijie Wu · Kai Zhang · Xubin Li
17 February 2026 at 13:00
arXiv:2602.03195v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has emerged as a key paradigm for aligning and optimizing large language models (LLMs). Standard approaches treat the LLM as the policy and apply RL directly over the full vocabulary space. However, this formulation includes the massive tail of contextually irrelevant tokens in the action space, which could distract the policy from focusing on decision-making among the truly reasonable tokens. In this work, we verify that valid reasoning paths could inherently concentrate within a low-rank subspace. Based on this insight, we introduce Reinforcement Learning with Promising Tokens (RLPT), a framework that mitigates the action space issue by decoupling strategic decision-making from token generation. Specifically, RLPT leverages the semantic priors of the base model to identify a dynamic set of promising tokens and constrains policy optimization exclusively to this refined subset via masking. Theoretical analysis and empirical results demonstrate that RLPT effectively reduces gradient variance, stabilizes the training process, and improves sample efficiency. Experiment results on math, coding, and telecom reasoning show that RLPT outperforms standard RL baselines and integrates effectively across various model sizes (4B and 8B) and RL algorithms (GRPO and DAPO).
There are no more articles
❌